TidbitYou shall know a word by the company it keeps.

Firth wrote that in 1957 and it is still the whole idea behind word vectors. Nothing in word2vec, GloVe or a transformer's embedding layer knows what a word means. They know which words turn up nearby, and that turns out to be enough to do arithmetic on meaning.

Firth, 1957