Multimodal evals are coming!! Stay tuned!
RESEARCH
-
Claude 3.5 Sonnet Tops SEAL Evals in Instruction Following Coding
By
–
We re-ran SEAL evals on the new @AnthropicAI Claude 3.5 Sonnet model. It is now:
– #1 on Instruction Following
– #1 on Coding Congratulations to Anthropic on a great new model! P.S. we’re adding new evals to SEAL, so if you have an idea for an eval, let us know below -
Anthropic Deciphers Claude’s Internal Patterns Breakthrough
By
–
¡¡NUEVO VÍDEO!! ¿Creéis eso de que las IAs son cajas negras que no podemos entender? ¡Pues la cosa ha cambiado! Y un trabajo reciente de Anthropic ha permitido descifrar muchos de los patrones internos de su modelo Claude! Ah… y volver LOCA a la IA
-
Analyzing LLM Family Trees Through Prompt Genetics
By
–
Cool work from @nicolas__yax to analyze LLMs by treating prompts as genes and tokens as alleles. It can recreate models' family trees based only on outputs (e.g., OpenHermes → NeuralHermes). It's particularly nice to get insights into how closed-source models are related.
-
Synthetic Data Superiority in Generative AI Models
By
–
It amazes me that so many (even tech) people still don't get the transformative power of generative AI. The best text to image and video models in existence today all use synthetically generated captions (see e.g. Dalle 3 paper). Human generated data is substantially inferior.
-
AI Ethicist Jibu Elias Discusses Technology Ethics and Policy
By
–
Catch @jibuelias, Fellow at Mozilla for Responsible Computing Challenge live at the Global IndiaAI Summit. As a distinguished AI Ethicist and Researcher, Jibu's insights on the intersection of technology, law, and public policy will be invaluable in shaping the future of AI.… pic.twitter.com/zag7vwKUj1
— IndiaAI (@OfficialINDIAai) 1 juillet 2024Catch @jibuelias
, Fellow at Mozilla for Responsible Computing Challenge live at the Global IndiaAI Summit. As a distinguished AI Ethicist and Researcher, Jibu's insights on the intersection of technology, law, and public policy will be invaluable in shaping the future of AI. -
Brain-Inspired AI Raises Unique Ethical Concerns and Challenges
By
–
A recent study demonstrates that brain-inspired AI raises unique ethical concerns, distinct from traditional AI. It explores conceptual, technical, and societal issues, highlighting the need for a heuristic approach to address these complexities. Brain-inspired AI, while
-
Brute Force Limitations in AI Development and Jensen Huang’s Perspective
By
–
Brute force will not solve AI, but Jensen Huang wants us to try.
