Is that lossy? Isn't the vector representation of the text (and the ANN index it... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		benpacker on Feb 8, 2024 \| parent \| context \| favorite \| on: How we got fine-tuning Mistral-7B to not suck Is that lossy? Isn't the vector representation of the text (and the ANN index itself) lossy, and the source text itself the source of truth?

kkzz99 on Feb 8, 2024 [–]

You use the vector embedding only for retrieval of the actual text, which then gets injected into the prompt.

nl on Feb 8, 2024 | [–]

The conversion of a conversation context to vector for retrieval is lossy and often very manual.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact