Why are people celebrating the Godfather-like economics of this OpenAI-Microsoft deal like it’s a good thing? 49% ownership with 33% of funds? with 75% cut of profits to EARN OUT the investment? Was OpenAI strongarmed into this deal? wtf? We do NOT know the full story here.
@swyx
-
Evolution of Function Keywords Across Programming Languages
By
–
also if you are designing a language and need a keyword for functions, take heed on the trends over time javascript: function
golang: func
kotlin: fun
rust: fn you know what to do -
RLHF reduces prompt engineering needs but unlocking full LLM potential requires prompting
By
–
useful counterpoint – RLHF diminishes the need for prompt eng for the median usecase, but the capabilities of LLMs are much more vast and will be unlocked with some amount of prompting (remains to be seen HOW MUCH engineering is required; is @langchain a feature or bug?)
-
OpenAI API calls with Pinecone embeddings dependency concerns
By
–
wait so you still have to run every api call thru openai after the embeddings are done? what is pinecone doing then? seems like an unreliable dependency
-
2022 Visual Text States of the Art from LAION and SavvyRL
By
–
Couple more 2022 visual text States of the Art from @laion_ai and @savvyRL et al (which was even more slept on!!)
-
Text-to-Image Visual Text Rendering Problems Solved Early 2023
By
–
I am still not over how we are 1 (ONE) week into 2023 and the big Text-to-Image visual text rendering problems of last year appears to be completely solved… (with a new architectural approach to boot! Rumors that hands might be solved too) Diffusion models are so 2022?
-
Simplifying Embeddings Creation and Module Shipping
By
–
make it easier to make and ship embeddings as modules?
-
Prompt Engineering Won’t Disappear Soon Despite Diminishing Importance
By
–
i dont think prompt eng will disappear all that “soon” actually but this is a good thread covering our attempts to at least greatly diminish its importance
-
PPO Explanation Gaps and InstructGPT Fine-tuning Data Requirements
By
–
thanks man its a good thread. i feel like people dont explain PPO very well in these threads, thats the main part that always feels handwavy. i’d also like an idea of order of magnitude of finetune data needed for instructgpt but havent seen good numbers
-
Cloud Costs to Coffee Costs Pivot Appreciation
By
–
love to see the cloud costs -> coffee costs pivot