All tidbits Responsible NLP Code Course home

TidbitWord vectors learn our prejudices with the same machinery they learn our grammar.

The arithmetic that gives you king minus man plus woman equals queen also gives you doctor minus man plus woman equals nurse. Nothing went wrong in the training. The model faithfully learned what the corpus contains, which is the problem.

same arithmetic, both results

Word vectors learn our prejudices with the same machinery they learn our grammar.