you already have TVM for the cross platform stuff see https://tvm.apache.org/doc... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		homarp on Sept 12, 2023 \| parent \| context \| favorite \| on: Fine-tune your own Llama 2 to replace GPT-3.5/4 you already have TVM for the cross platform stuff see https://tvm.apache.org/docs/how_to/deploy/android.html or https://octoml.ai/blog/using-swift-and-apache-tvm-to-develop... or https://github.com/mlc-ai/mlc-llm

refulgentis on Sept 12, 2023 [–]

My deepest thanks, I owe you one. Overlooked this completely. & spent dozens of hours learning way too much to still fall short of understanding how to make it work in ONNX.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact