MIT, Northeastern & Technion Propose ROME for Efficient Locating and Editing of Factual Associations in GPT Models
LLMS
-
Non-Experts Answer Expert Questions on MMLU and QuALITY
By
–
We ask non-experts to answer expert-level questions on MMLU, and also ask people to answer questions about long QuALITY passages under a time limit that’s too short for a careful read.
-
Scalable Oversight Framework and Language Model Question-Answering Proof of Concept
By
–
Along with developing a framework for scalable oversight, we also conduct a proof of concept experiment that demonstrates a couple of question-answering tasks that work well under this paradigm with current language models:
-
AI Systems Improving Human Oversight of Large Language Models
By
–
In "Measuring Progress on Scalable Oversight for Large Language Models” we show how humans could use AI systems to better oversee other AI systems, and demonstrate some proof-of-concept results where a language model improves human performance at a task.
-
LangChain 0.0.9: Hugging Face Embeddings and API Key Management
By
–
LangChain version 0.0.9 Support for embeddings with @huggingface through `sentence_transformers` from @abdrahman_issam (example notebook: https://colab.research.google.com/drive/1lbjO0-nITa5c8RXfagsIZDqxZ_mVl_2k?usp=sharing…) Better support for different ways of specifying API keys from @camjuu
-
How Much Does Attention Actually Attend in Transformers?
By
–
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers Hassid et al.: https://
arxiv.org/abs/2211.03495 #ArtificialIntelligence #DeepLearning #MachineLearning -
Smaller Models with Better Data Can Outperform Larger Ones
By
–
Great point. We are seeing more and more than smaller models with better objectives or data can beat big ones! My main point is that an approach shouldnt go away as models get better. Scale is just one way of getting better
-
Large Language Models Insufficient for Pharma and Finance
By
–
Large language models like #GPT3 aren’t good enough for pharma and finance https://
thenextweb.com/news/large-lan
guage-models-like-gpt-3-arent-good-enough-for-pharma-finance
… @thenextweb #AI #MachineLearning #BigData #Analytics #Robots #DeepLearning #100DaysofCode #IoT #serverless #DEVCommunity #womenwhocode #DigitalTransformation #Python #DataScience -
Unleashing LLM Potential: Cohere and Scale AI Leaders Discuss
By
–
Check out this fireside chat with Cohere Co-founder and CEO @aidangomezzz and @scale_AI Founder and CEO @alexandr_wang about how to unleash the full potential of large language models. ↓
-
NLLB-200 Achieves Superior Translation Quality Across All Languages
By
–
Across all languages, NLLB-200 is seeing the best results for translations modified <10% compared to all other MT services on the platform — a strong signal for the quality of translations that are being generated. 4/5