TidbitAttention is a soft dictionary lookup.

A query asks a question, every key offers a match score, the softmax turns those scores into weights, and the answer is a weighted blend of the values. That is it. The magic is not the mechanism, it is that you can run it on every word at once.

query, key, value