There are a variety of ways to remove rust from concrete, including lemon juice, vinegar and chemical rust removers made just for concrete.