Tokens are not words. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		meindnoch 21 days ago \| parent \| context \| favorite \| on: Index, Count, Offset, Size Tokens are not words.

Onavo 20 days ago [–]

Relatively, they are the same, depends if it's word level.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact