Pumped about the future and what it holds after a catch up with @Dan_Jeffries1 about #GenerativAI this morning! If you haven't read Dan's essay recently, highly recommend taking a look: https://
danieljeffries.substack.com/p/the-age-of-i
ndustrialized-ai
…
GENERATIVE AI
-
Excitement About Future of Generative AI and Dan Jeffries Essay
By
–
-
Training a 10M Parameter GPT Model on Shakespeare in 15 Minutes
By
–
We get a ~10M parameter model trained for about 15 minutes on 1 GPU on all of Shakespeare concatenated into one 1MB file. We then sample infinite fake Shakespeare from our baby GPT. Can you spot which one is real? At only 10M params on 1M characters, from-scratch, I hope so 🙂
-
Building Transformers: Self-Attention, Training, and GPT-3 Comparison
By
–
The second ~1hr builds up the Transformer: multi-headed self-attention, MLP, residual connections, layernorms. Then we train one and compare it to OpenAI's GPT-3 (spoiler: ours is around ~10K – 1M times smaller but the ~same neural net) and ChatGPT (i.e. ours is pretraining only)
-
ChatGPT Money Making Resources Free for 48 Hours
By
–
Making money using ChatGPT is a once-in-a-lifetime opportunity. We organized ALL of the best resources to use ChatGPT into one page. Free for 48 hrs. To get it:
1. Retweet, Follow, Comment 'me'
2. Subscribe to free newsletter in bio (optional) 🙂 & We'll DM it to you, free. -
Standard Interfaces for LLM and Embeddings Providers
By
–
pretty easy to swap this out! we have standard interfaces for most llm/embeddings providers
-
For embedding retrieval, hallucinating lies beats ‘I don’t know’
By
–
I love how this is a clear use case for hallucination. If the reason you’re generating an “answer” is merely to produce an embedding suitable for retrieving one, saying “I don’t know” is useless and confidently making up lies is better.
-
HyDE: Generating Hypothetical Answers for Better Document Retrieval
By
–
Clever paper — HyDE: Hypothetical Document Embeddings Instead of encoding the user's query to retrieve relevant documents, generate a "hypothetical" answer and encode that. Documents with right answers more similar to wrong answers than to questions. https://
arxiv.org/abs/2212.10496 -
AI21 Labs Releases Paper on Grounded Text Generation and Fact Attribution
By
–
We are proud to announce the release of our latest scientific paper about improving grounded text generation and fact attribution – for any off-the-shelf LMs!
Read more details about this exciting development and its implications for the future of #AI: -
Getty Images Sues AI Image Generation Companies Over Copyright
By
–
Varias demandas se empiezan a sumar para las compañías de generación de imágenes como Stability, Midjourney y otras. En este caso Getty Images es otra de las que ha dado el paso para llevar acabo esta denuncia. Irá para largo. A ver cómo se desarrolla. Seguiremos informando https://
x.com/jjvincent/stat
/jjvincent/status/1615296166241140737
… -
LangChain Chat Projects and Open Source AI Applications
By
–
Other links GitHub Repo: https://
github.com/hwchase17/chat
-langchain
… @huggingface Space: https://
huggingface.co/spaces/hwchase
17/chat-langchain
… Related projects that are also great: GitHub support bot from @floydophone
: https://
dagster.io/blog/chatgpt-l
angchain
…
Converse with PDFs from @deskriders_twt: https://
github.com/namuan/dr-doc-
search
…