Here's the original Attention Is All You Need paper from June 2017 https://
arxiv.org/abs/1706.03762
RESEARCH
-
Attention Is All You Need: Seminal Transformer Paper From 2017
By
–
-
Transformer Architecture: Foundation of Modern Generative AI
By
–
In 2017, a team of eight researchers on the Google Brain team (now part of Google Deepmind) published a research paper titled, Attention is All You Need. That paper invented the Transformer architecture that became the basis for ChatGPT from OpenAI (GPT stands for Generative
-
Biologically Plausible Language Organ Architecture with Realistic Neural Simulation
By
–
The Architecture of a Biologically Plausible Language Organ https://
arxiv.org/abs/2306.15364 “We present a simulated biologically plausible language organ, made up of stylized but realistic neurons, synapses, brain areas, plasticity, and a simplified model of sensory perception. We show -
Sakana AI Hiring Researchers Engineers Nature-Inspired Foundation Models
By
–
Sakana AI is hiring researchers and engineers who are passionate about novel approaches to develop the next generation of nature-inspired foundation AI models! For more details → https://
sakana.ai/careers/ We’re looking for candidates who we believe have the potential to build -
Meta’s Self-Rewarding Language Models Paper Released
By
–
Iterative self-improvement LLMs from Meta? “[in order to] achieve superhuman agents, future models require superhuman feedback” Self Rewarding Language Models paper just dropped. Link in alt.
-
First Look at Stable Diffusion 3 Model Release
By
–
Is this our first look at Stable Diffusion 3? Emad hinted at this in July last year. My guess is that this is a new model not an SDXL iteration. Also quoting again because I like the new cat picture better.
-
An Amusing Case for Language Model Alignment
By
–
An amusing case for LM alignment https://t.co/YlOezWG4Dl
— Nando de Freitas (@NandoDF) 19 janvier 2024An amusing case for LM alignment
-
Responsible Generative AI: Essential Guide for Data Scientists
By
–
In the realm of data science, Generative AI (GenAI) can be a game-changer. Our new white paper, "Responsible Generative AI," is a must-read for anyone stepping into the GenAI world. https://
domino.buzz/48X2sOL #GenerativeAI #ResponsibleAI -
Student AI Tournament Highlights Participation and Volunteer Contributions
By
–
A fantastic tournament, participating students and our volunteers
-
Groq Shares Monarch Matrices and Structured Matrices Presentation
By
–
Talent density is core to #Groq. We try to think differently & reimagine efficiency. We're excited to share @cdsmithus
's presentation on Monarch Matrices & Structured Matrices, part of our Lunch & Learn playlist featuring Groqsters sharing their wisdom. https://
youtu.be/Pr6nNuGSbCE