Let nginx handle 404 pages instead of wordpress 404 page to reduce server load

Question

I'm quite new to WordPress and nginx. How do I let nginx handle 404 pages instead of WordPress?

I tried putting these codes into the server block but it still

error_page 404 /404.html;
location  /404.html {
  internal;
}