Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It seems like the OP really wants to use a database instead of a file system.


I don't think so; HPC is a different beast There are very few if any organizations on earth that have a database that can write a sustained 1TByte/second+ from as few as 300-400 node to 100s of PB of stateful media for years on end.

Ken Batcher (maybe of OSU?) wrote a quote that the rest of us have been using for years: "Supercomputers are a tool for converting a CPU-bound problem into a HPC-bound problem."

The filesystems start to look more like databases over time, but it's not like they can throw down a nice Cassandra cluster and have it pick up the slack. I'm not saying it will never happen, but I don't think it's am option at the moment.


Rather "into an I/O-bound problem". Apologies for ruining Ken's great joke.


Exactly. Layer a system on top of the usual I/O and you get the ratio of performance / statefulness you want.


They do, more or less. It's called MPI-IO, but it's still tough.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: