Do you have the answer to the second question? Is an LLM trained on the internet... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		brcmthrowaway 47 days ago \| parent \| context \| favorite \| on: The Illustrated Transformer Do you have the answer to the second question? Is an LLM trained on the internet just GPT-3?

libraryofbabel 47 days ago [–]

I don't know - perhaps someone who's more of an expert or who's worked a lot with open source models that haven't been RL-ed can weigh in here!

But certainly without the RL step, the LLM would be much worse at coding and would hallucinate more.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact