Hacker Newsnew | past | comments | ask | show | jobs | submit | fromlogin
Show HN: Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone (github.com/leonickson1)
312 points by leonickson 39 days ago | past | 141 comments
Show HN: ModelSweep - Open-Source Benchmarking for Local LLMs (github.com/leonickson1)
2 points by leonickson 5 months ago | past

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: