Swift Performance can cache 404 pages as well. If you have a lot of hits which leads 404 it can be useful to cache them, to save server resources.
On other hand it can generate a lot of data, also generating the cache can use some CPU. Because of these you may should disable this feature based on your server resources (CPU, RAM, disk space) and visitors behavior.