All tidbits Representation Code Course home

TidbitThe dog bites the man. The man bites the dog.

To a bag-of-words model these are the same sentence. Both become the same four counts: the 2, dog 1, bites 1, man 1. Word order is the first thing you throw away, and buying it back is most of what the next fifty years of NLP is about.

2 sentences, 1 vector

The dog bites the man. The man bites the dog.