Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

True, Grammar has been around with Llama.cpp since the early days IIRC. Microsoft had Guidance as well & now TGI supports it as well. End game for Langchain/Llamaindex if just guarantee or structure adherence was the only reason to use & beg the LLM for usable output.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: