This uses the new Gemini 1.5 Pro API that was released today. It currently only supports listening to the audio content of videos. If anyone wants, please feel free to add support for video frames as well.

→ View original post on X — @mattshumer_,