RunPod [0] is pricing MI300X at $4.89/hr vs $3.89-4.69/hr for H100s. So, probabl... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		huevosabio on June 13, 2024 \| parent \| context \| favorite \| on: AMD's MI300X Outperforms Nvidia's H100 for LLM Inf... RunPod [0] is pricing MI300X at $4.89/hr vs $3.89-4.69/hr for H100s. So, probably around the same price? The tests look promising, though! [0] https://runpod.io/

latchkey on June 17, 2024 [–]

We are starting at $4.50/hr [0]. The catch is that we won't have availability until mid August.

The weird thing on Runpod is the virtual CPUs, you can't run MI300x in virtual machines yet. It is a missing feature that AMD is working on.

[0] https://hotaisle.xyz/pricing/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact