The treatment of people who came to the UK from the Caribbean added to historic injustices, a report says.