The under-fire taxi firm has apologised after Transport for London refused to renew its licence, but union bosses say "actions speak louder than words".