This one's always a silly little configuration problem, but there's a quick and easy fix:  Install the Desktop Experience feature on your SharePoint server.

This may require a restart, so plan accordingly.

Without this feature installed, you'll see something like the image below that says: "We're having a problem opening this location in File Explorer. Add this web site to your Trusted Sites list and try again."