If you find the preview size of the Taskbar thumbnails a little smaller, you can change them and make them bigger. There is a simple way to change the size of Windows 11/10/8/7 Taskbar Thumbnails.

You can change Thumbnail Preview Border in Windows 11/10 FIle Explorer to Miniature Photographs, No border, Straight, Photo or Shadow border.