Forgive me if this has already been addressed, I searched for it but couldn't find a similar issue. I'm using the file entity module and it automatically generates a page for each of the files. This causes SEO problems (Not sure how the crawler is finding them) because the pages arn't setup for it. I would really like to just eliminate the pages from show up. Does anyone know how to pull this off?
AFAICT the File entity module is all about adding the feature how to handle files by creating entities and their pages. If you delete the page, you also delete the file.
Is there any reason why you're using this module? Maybe you don't even need it?
If you disable and uninstall the module the files will remain, although you should test this first before applying to the main site (backup everything first, although backups are a must either way).
Have you tried
view files Permission? Maybe you can restrict viewing the pages, while the files may be available through a reference on Content types.
Add this to your robots.txt to make the search engines not index these pages:
# Custom - added on Feb 28 2019 Disallow: /file/