Whenever I add new taxonomy terms I have to manually go into my exposed view filter to have them show up in the dropdown box when filtering. Is there a way to just select all terms with what im filtering by?
You have the answer in the attached image itself.
Just Un-select the Limit list to selected items then save the configuration. Now the all the terms for that selected vocabulary will be listed automatically.
When you selected Limit list to selected items options, only the selected terms alone will be exposed to the user.