For those who are interested in how Transformers seem more prevalent, please read this thread by Karpathy where he talks about a consolidation in ML: twitter.com/karpathy/status/14683706052… And of course one of the early classic papers in the field, as a bonus: papers.nips.cc/paper/2017/file/3f5ee243…... (The paper is mentioned in the article)

This is a really accessible write up. Although I agree with the comment elsewhere of asking for a “examples in Rust” comment somewhere to save everyone the 15 sec of squinting “is this … C++, or…” who don’t instantly recognize it. Also funny that I just shared a Twitter thread on this topic to a coworker. I was sharing the POV of this prof with the “wow, it’s amazing to think all the hard-won gains I ever did with deep feature engineering and tuning is now useless!” Sharing in case others find it helpful. twitter.com/moyix/status/14694015024228…... Which references this thread: twitter.com/karpathy/status/14683706052…...