[890] Static build does not work, assets not found 404

So I built my project, and hit npm run build. The files appear in my dist folder, all bundled up. However, it doesn't work. When I try and upload the files to a server I get a bunch of 404 errors that none of the bundled files can be found.

I don't understand if this has something to do with dynamic routes. For my project, all I did was make a new .vue file for each page. I don't think these are dynamic routes. I don't understand the documentation. You have to make a .vue file to define dynamic routes? or you put them in nuxt.config.js?