Distill Whisper exhibits fewer 'hallucination errors' in transcribing long audio, crucial for customer service and accessibility. Its detailed training underscores the efforts to enhance AI efficiency.
LLMS
-
AI Voice Interaction Evolution: Whisper and Distill Whisper Advances
By
–
AI voice interaction is evolving to match text communication. @OpenAI
's Whisper converts voice to text effectively, and Distill Whisper by @huggingface now offers similar accuracy with increased speed and less complexity. -
GPT-4.5 Turbo released in secret?
By
–
Was GPT-4.5 Turbo released in stealth? Numerous ChatGPT Plus users are getting this response. Mass hallucination or something is cooking.
-
Quip: 2-Bit Quantization for Large Language Models
By
–
10/ Quip – compresses trained model weights into a lower precision format; combines lattice codebooks with incoherence processing to create 2 bit quantized models; significantly closes the gap between 2 bit quantized LLMs and unquantized 16 bit models.
-
Self-Training LLMs: Reducing Dependence on Human-Generated Data
By
–
7/ Beyond Human Data for LLMs – an approach for self-training with feedback that substantially reduces dependence on human-generated data; the model-generated data combined with a reward function improves the performance of LLMs on problem-solving tasks.
-
Mathematical LLMs: Progress in Problem-Solving and Theorem Proving
By
–
4/ Mathematical LLMs – a survey on the progress of LLMs on mathematical tasks; covers papers and resources on LLM research around prompting techniques and tasks such as math word problem-solving and theorem proving.
-
LLM360: Transparent Open-Source Large Language Model Training
By
–
5/ Towards Fully Transparent Open-Source LLMs – proposes LLM360 to support open and collaborative AI research by making the end-to-end LLM training process transparent and reproducible.
-
LLMs in Medicine: Comprehensive Survey of Applications and Challenges
By
–
6/ LLMs in Medicine – a comprehensive survey (analyzing 300+ papers) on LLMs in medicine; includes an overview of the principles, applications, and challenges faced by LLMs in medicine.
-
Weak-to-Strong Generalization: Eliciting Full Capabilities of Strong Models
By
–
2/ Weak-to-strong Generalization – studies if weak model supervision can elicit the full capabilities of stronger models; when naively fine-tuning strong pretrained models on weak model generated labels they can perform better than their weak supervisors.
-
Top ML Papers of the Week: SLAM, LLMs, Medical AI
By
–
The Top ML Papers of the Week (Dec 11 – Dec 17): – Gaussian-SLAM
– LLMs in Medicine
– Mathematical LLMs
– Beyond Human Data for LLMs
– Weak-to-strong Generalization
– Towards Fully Transparent Open-Source LLM
…