Attention Is All You Need

How can we improve the efficiency and accuracy of sequence-based models while overcoming the limitations of recurrence? In English that translates to, how can we make AI more useful? That was the question a team of researchers at Google in 2017 set off to answer. In the status quo LLMs faced a problem. Recurrent Neural…

Rollercoasters Of Mandarin

Mandarin is a tonal language, meaning the tone/pitch/intonation that you use to emphasize a word changes its meaning. You can say “hi” in a really excited or shy way but in English that doesn’t change the meaning of the word. It’s still a greeting. There are four tones used in Mandarin. First tone – Mā…

You’re AI’s Human In The Loop

You show up to a party, and someone asks you how you can see why an AI reached a specific conclusion and you answer: Then, because apparently you’re in SF, someone asks about how to refine reasoning even further and you mention: At a different party, geez people just love talking about AI, you’re asked…

Three Alphabets Walked Into An Izakaya

Hiragana, Katakana, and Kanji walk into a bar. Hiragana orders a drink easily. Katakana repeats the order, but louder and with more flair. Kanji just points at the menu—no one knows how to pronounce it, but they all pretend to understand.

Giving Back

One of the best ways to ‘give back’ is to stimulate the local economy. You’re in need of a service? If there’s a way for you to get that need met while supporting your neighbor, and the cost is reasonable, then why wouldn’t you do it?