Normal people: count sheep to sleep.
Top tier people: force brain to OOM!!
@yitayml
-
Pushing Brain Performance Limits Through Computational Overload
By
–
-
LlamaIndex Dismissed as Noise by LLM Practitioners
By
–
LlamaIndex is something i see around so much but never figured out what it does. i've always considered it noise. A general rule of thumb is anyone serious about LLMs should not touch either of these.
-
Critical thinking and research methodology in AI development
By
–
Fundamentally agree. But I don't think it's about knowledge or facts about certain techniques. Old school for old school sake is also a bit strange. I think it's about reasoning, good research taste and critical thinking which is not necessarily about math and science.
-
Scaling Challenges in Universal Transformer Parameter Sharing
By
–
It's hard to scale UT in terms of param sharing because of the shared params across all layers (similar to ALBERT). If you want to have like a 1B UT model, it's going to be super slow. That said, we didn't try scaling non-shared UT which could be okay. More about
-
Google’s proprietary AI significantly outperforms open source alternatives
By
–
Yea. I'm still 200% convinced that everything in the open is still garbage compared to what's inside Google. It was quite depressing honestly to see this level difference.
-
Google’s Infrastructure Changes Drive Promotion Cycles
By
–
It's a googley thing to change infra every 6 months so that more people can get promoted.
-
Reka Secures $58M Funding for Generative AI Models
By
–
Launch announcement: https://
reka.ai/announcing-our
-58m-funding-to-build-generative-models-and-advance-ai-research/
… -
Reka AI Launches with $58M to Build Generative Models
By
–
We’re coming out of stealth with $58M in funding to build generative models and advance AI research at @RekaAILabs Language models and their multimodal counterparts are already ubiquitous and massively impactful everywhere. That said, we are still at the beginning of this
-
PaLM 540B vs Inflection-1 TriviaQA benchmark comparison
By
–
Nice! But yo @MaartenBosma where is triviaqa 0-shot and 1shot for PaLM 540B? It's definitely in the paper. Is it not there just to be able to bold Inflection-1