Those flaps are called the "tragus" — by holding it in, you block out a lot of the peripheral sounds, making it easier to hear the person right next to you. H/T r/LifeProTips and r/LifeHacks.