You can enable the classic Classic Alt+Tab dialog in Windows 11, which doesn't show window thumbnails but only shows app icons. It is less distractive