Witnessing history. @AtheneLOL is interviewing in a lifestream a AI version of Asmongold (a very popular streamer) This kind of tech will hit mainstream hard.
GENERATIVE AI
-
LLMs Are English-to-English Machine Translation Systems
By
–
Lost on most people: every time you used http://
translate.google.com for past 20 years, an LLM was used. The main difference now: we’re translating English prompts to chat-inspired predictions also in English. LLMs are basically English-to-English machine translation -
Google AI Test Kitchen preview predates ChatGPT release
By
–
this is straight from the AI test kitchen app- this preview has been out for months now, way before chatGPT was released https://
blog.google/technology/ai/
join-us-in-the-ai-test-kitchen/
… assuming some lessons have been learned since then -
AI Feature vs Product: Retention and Integration as Key Metrics
By
–
toughest questions right now in AI are – is it a feature or a product?
– is it a fad/novelty or a repeat use case? hint: if your retention sucks, it might just be a fad or novelty hint: if an incumbent can easily integrate it, & the best most is “model quality”, it’s a feature -
Active Learning and Transfer Learning in Few-Shot LLM Settings
By
–
How can we mix active and transfer learning in few-shot learning setting with pre-trained LLMs? We show that you need to label only few samples in-domain and leverage on transfer learning from out-domain along with ingrained knowledge in pretrained models
-
MP3 Files: Clarifying the Term Generated vs Generative
By
–
Calling an MP3 *generative* though, is a bit misleading… Hence "generated".
-
REPLUG: Retrieval-Augmented Black-Box Language Models
By
–
REPLUG: Retrieval-Augmented Black-Box Language Models Shi et al.: https://
arxiv.org/abs/2301.12652 #Artificialintelligence #DeepLearning #MachineLearning -
Deepfake Risks: Text, Audio, and Video Concerns
By
–
Can you spell that out? my immediate concerns are mainly around text and audio, though definitely fake video w public figures etc surely has risks.
-
Generated vs Generative: Distinguishing Static Output from Interactive Code
By
–
I vote for "Generated Music". It's only "generative music" (active verb) if you ship the generator and it's somehow interactive. Same for art, "Generated Art" vs. "Generative Art". The second implies you ship the code to the user IMHO.
-
Historical AI Agreements and Paradigm Shift Debates
By
–
Amazing how many people believe this, even when I have written extensively (even this week!) about agreements going back several years. Eg see here 2017 slide https://
garymarcus.substack.com/p/some-things-
garymarcus-might-say
… and see long essay on 2022 https://
garymarcus.substack.com/p/does-ai-real
ly-need-a-paradigm-shift
…