Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Just to note that Tiktoken is still the tokenizer behind the GPT-4x series, it just uses a different token model. (Post only says GPT-3, implying they were using something else for subsequent iterations.)


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: