Agreed, but all the static assets shouldn't be served by your application server but either from a completely different machine (or CDN), or at least from a reverse proxy in front of the application server. Aside of eventual port or file handle starvation, serving assets should have no effect on your application server.

So while having one file with all the assets is advantageous for the end users, it should have no or next to no influence on application server performance.