This uses the new Gemini 1.5 Pro API that was released today. It currently only supports listening to the audio content of videos. If anyone wants, please feel free to add support for video frames as well.
GENERATIVE AI
-
Automated Video Analysis System Using SERPAPI and Gemini
By
–
How it works, in a nutshell:
– User provides a topic
– SERPAPI gathers relevant YouTube links
– A separate Gemini 1.5 instance listens to + summarizes each video
– A final Gemini instance takes in all of the summaries, and generates a final, comprehensive report -
Gemini YouTube Researcher: AI Agent Analyzes Video Content
By
–
Introducing `gemini-youtube-researcher` 📈
— Matt Shumer (@mattshumer_) 10 avril 2024
An open-source Gemini 1.5 Pro agent that LISTENS to videos and delivers topical reports.
Just provide a topic, and a chain of AIs with access to YouTube will analyze relevant videos and generate a comprehensive report for you. pic.twitter.com/bd0OZkvCkqIntroducing `gemini-youtube-researcher` An open-source Gemini 1.5 Pro agent that LISTENS to videos and delivers topical reports. Just provide a topic, and a chain of AIs with access to YouTube will analyze relevant videos and generate a comprehensive report for you.
-
Gemini Pro 1M Token Context Now Free Without Waitlist
By
–
Gemini Pro with the 1 million token context limit is now available for free and without a waitlist! https://t.co/eiNsXCBMBU
— Simon Willison (@simonw) 10 avril 2024Gemini Pro with the 1 million token context limit is now available for free and without a waitlist!
-
AI Reply Suggestions Ruining Social Media Feeds
By
–
AI reply suggestions that suck are ruining the feeds. My first inclination is to stay away. It's truly a blight. My second is to solve the AI-enabled reply so much better than all other apps that you wouldn't even be able to tell AI was involved.
-
Discovering Prompts Behind AI Model Research Paper
By
–
I'm trying to figure out what prompts they used. I think it's these – this is from a paper that their paper links to https://
github.com/lilakk/BooookS
core/tree/main/prompts
… -
Fiction vs Non-Fiction in AI Summary Evaluation Studies
By
–
Looks like all but one of the books in that study were fiction, which I imagine has quite different characteristics when it comes to evaluating summaries than non-fiction https://
github.com/mungg/FABLES/b
lob/main/booklist.md
… -
Training Models and Gemini 1.5 Pro Project Development
By
–
waiting on a few models to train, guess I'll be cooking up some gemini 1.5 pro projects in the meantime
-

#1 Early-Stage Startup Building LLM Apps Today
By
–
We're grateful for the recognition in Enterprise Tech 30 as the #1 ranked Early-Stage Startup! We're on a mission to make it easy to build the LLM apps of tomorrow, today. We're actively hiring across multiple roles including Software Engineer (JS, Python, SDK, &
-
AI Tool Extracts Structured Data From Text and Images
By
–
I built a tool for extracting structured data from unstructured text and images and inserting it into a SQLite database table