transformers came out in 2017, just as i was coming onto the scene (maybe slightly before)
GENERATIVE AI
-
Proprietary Data Less Useful Than Expected for Pre-trained Models
By
–
After years of AI meaning building your own models trained on proprietary data, one of the hardest things for firms to grasp is that their own data is much less immediately useful for pre-trained models The value in adding data in a use case will require experimentation to learn
-
Three Major ML Breakthroughs: What Comes Next?
By
–
since i got into ML in 2017 or so there have been exactly three major advancements: 1. web-scale language model pretraining (OpenAI, 2020)
2. diffusion models (OpenAI, 2020)
3. language model refinement via human feedback (OpenAI, 2022) what’s next? it’s been a while -

GPT-5 leak, Intel funding, and new AI tools today
By
–
Top stories in AI today: -New GPT-5 timeline and capabilities leak
-Biden awards Intel $20B in AI chip incentives
-Add sound effects to your videos using AI
-GPT Store plagued by spam bots
-6 new AI tools & 4 new AI jobs Read more: http://
therundown.ai/p/gpt-5-rumor-
mill-ignites
… -

Runway Partners Musixmatch to Launch AI-Powered Lyrics to Video
By
–
We are excited to announce that we are partnering with @Musixmatch to put Runway into the hands of millions of artists and musicians. Their upcoming feature, Lyrics to Video, will be powered by Gen-2 and enable artists to expand their creative vision with new AI tools.
— Runway (@runwayml) 21 mars 2024
Learn… pic.twitter.com/qlycavatzxWe are excited to announce that we are partnering with @Musixmatch to put Runway into the hands of millions of artists and musicians. Their upcoming feature, Lyrics to Video, will be powered by Gen-2 and enable artists to expand their creative vision with new AI tools. Learn
-
GPT-5 Expected in Summer 2024
By
–
I announced it in a video two days ago: #GPT5 will indeed be released in 2024, and it’s even expected during the summer! Source:
@BusinessInsider Some people very close to OpenAI are already testing it. And according to them, it’s incredibly powerful! https://archive.is/20240320141522/https://www.businessinsider.com/openai-launch-better-gpt-5-chatbot-2024-3
… -

Google Rolls Out Gemini 1.5 Pro API for Developers
By
–
We are rolling out Gemini 1.5 Pro API so that you can keep building amazing stuff on top of the model like we've seen in the past few weeks. Also, if you just want to play with Gemini 1.5, we removed the waitlist: http://
aistudio.google.com Last, but not least, we pushed the model -
Non-Western AI Perspectives: Access, Isolation, and AGI Narratives
By
–
You’re missing non-Western perspectives and motivations. You’re missing voices from the billions of people who can’t access the Internet let alone GenAI. You’re increasing social isolation during a pandemic of loneliness sowing constant ideology that AGI is inevitable. Why?
-
Increase Max Tokens Parameter for Better AI Performance
By
–
It might because of the max tokens parameter, have you tried setting a higher one?