Yesterday, OpenAI released the latest version of their model called GPT-4o, as in 4 Omni.
Here are five wild examples:
Real time Translation (https://vimeo.com/945587840) (another video: https://www.youtube.com/live/DQacCB9tDaw?si=2gCZdGZxZm_LJLMN&t=1348)
Real Tutor for each child (video: https://vimeo.com/945587328)
Point and do Spanish (video: https://vimeo.com/945587424)
Describing what the AI is seeing through the camera (video: https://vimeo.com/945587840)
Being actual eyes for someone who can't see (video: https://vimeo.com/945587840)
For a while now, you've been able to use ChatGPT with just your voice, and it has been quite impressive already.
The biggest improvements are lower latency (which means your answers are faster) and increased performance around the AI speaking, hearing, and seeing. Those examples above are just scratching the surface
If you want to learn more about AI in education, check out https://aileader.info