"Why AI Is Incredibly Smart — and Shockingly Stupid" is a Ted Talk by AI Researcher and Professor, Yejin Choi. I highly recommend you watch this excellent 16 minute clip. It talks about the focus beyond just building ever larger and larger language models.

Should you watch this? Either you

• are an AI researcher in either camp (scale enthusiasts, vs. let's-get-smarter-in-building-smaller-models-with-(distilled)-knowledge).

• are looking to utilise ChatGPT-esque technology in your product. It is the user's prerogative to know the cautionary boundaries, and how to overcome them

• are a student/AI practioner without the resources to be able to play or fine tune the models. The open source community (you're a part of it) will find a way.

• are jumping wagons with each shiny new ML tool and are overwhelmed by the pace

Why I liked it

• Echoes a worry I share re: making these models smaller, sustainable and more democratised? Call for/to action.

• Excellent presentation, with insightful analogies.

• I enjoyed Yejin's take on Common Sense Reasoning being the most important task.

• Spells out cautionary lines for people to when integrating ChatGPT-esque tools

• Personally, it re-emphasised the value of going long on certain notions of how you want to contribute. Think of the bigger picture and not get swayed by latest tech

Though, I do want to say - credit where credit is due. Large Language Models and techniques like Reinforcement Learning with Human Feedback are phenomenal feats, and give us fantastic starting points to distil and fine-tune task-directed models.