Edit the thumbnails
The thumbnail that displays on a collection page is by default the first image of the gallery. There will not be any default thumbnail if the page is a text page or another collection page.
In order to add a thumbnail or edit the current one, click on Pages and select the collection page you want to edit. In order to add a thumbnail click on Thumbnail and choose an image.