Most static hosting providers provides an option for custom error page, and it should be possible to prerender the error template too.
<!--cmty--><!--cmty_prevent_hook--><div align="right"><sub><em>This question is available on <a href="https://nuxtjs.cmty.io">Nuxt.js</a> community (<a href="https://nuxtjs.cmty.io/nuxt/nuxt.js/issues/c833">#c833</a>)</em></sub></div>