The changes have been made with the help of InstructGPT, a group of GPT-3-based models that are less flawed and don’t generate text as problematic as its counterparts.