I turned down a job at google research to do a PhD at Cornell right before chatGPT came out and I don’t regret it at all. I see it like this. Do you want to work with a large group on building the fastest & fanciest system in the world, or in a small group testing crazy theories
@jxmnop
-
Industry vs Academia: Comparing Career Satisfaction in Tech
By
–
personally I prefer the latter, but there’s certainly satisfaction in both. I’m sure shipping products to users feels good, and obviously it’s nice to have compute and data (and $$) though in academia you can often get more personal credit for your ideas which can be rewarding
-
Research Presentation on Text Embedding Inversion Tomorrow
By
–
tomorrow I'll be presenting my research about text embedding inversion to this group at 10am est! follow the link if you want to tune in
-
Pretraining Without Attention: Novel ML Architecture Approach
By
–
oh yeah! That was Pretraining without attention: https://
arxiv.org/abs/2212.10544 -
OpenAI Ada Model Token Limit Technical Capabilities
By
–
What do you think openAI does for Ada? since it supports up to 8000 tokens.
-
V Information Quantum Computing Research Attempt Referenced
By
–
there already is one attempt to do this, in “V information”: https://
arxiv.org/abs/2002.10689 -
Programming with GPT-4 and Mathematica Made Simple
By
–
programming with gpt-4 + mathematica is a joy I used to be good at mathematica (at least, I knew the syntax well) but I've completely forgotten it but with gpt-4 i whipped this up in 60 seconds
-
Embedding Models: Lower Barrier Entry for AI Startups
By
–
the barrier to entry for training good embedding models is 100x lower than for training good LLMs – requires significantly less compute, expertise, and data. seems like a good area for building a business
-
Text Embeddings Dimensional Encoding Research Investigation
By
–
reading this thread and I feel obligated to shill my own research! I’ve been investigating this question wrt to text embeddings, specifically how many dimensions can perfectly encode text up to what length
-
Austrian Developer Masters Puzzle Solving with Prolog Language
By
–
have now pivoted to watching videos of this Austrian guy solving puzzles with Prolog. prolog is a beautiful language but I think it might be time for me to log off for the evening lol