Photos in Collections Not Appearing on "Photos" Page

No, there’s no such setting. If you’re comfortable with code, it’s possible to add those photos to the Photos page using the Site.Data.collections parameter. Maybe someone here on the help center has already done that and is willing to share a code snippet?

The other route is to ask @manton nicely if he could consider adding this to the default Photos template.