These wafers only have 44GB of RAM though. Very curious why the quantity is so l...

		wkat4242 on Aug 27, 2024 \| parent \| context \| favorite \| on: Cerebras launches inference for Llama 3.1; benchma... These wafers only have 44GB of RAM though. Very curious why the quantity is so low considering the chips are absolutely massive. It's SRAM though so very fast, comparable to cache in a modern CPU. But I assume being fast and loading the whole model there is the point.

probably largely because dram is a lot more dense than sea.