it feels like an inflection point for open source — do you get that sense? (i'm very much an outsider but it appears to me, at least, that the last year or so we've seen so much progress in AI coming from the open-source community.)
OPEN SOURCE
-
Formatting Alone Cannot Explain Performance Gap with LLaMA
By
–
I don't think that formatting alone can explain such a gap. You could maybe try to reproduce LLaMA numbers given the available model. It is likely that fixing these differences for LLaMA will also improve the numbers you report for your model.
-
Shap·E: OpenAI’s 3D generative model
By
–
Shap·E is a conditional generative model for 3D assets, and you can read the full paper here: https://arxiv.org/pdf/2305.02463.pdf … GitHub: https://github.com/openai/shap-e
-
ChromaDB Self-Querying Retriever with LLM Integration
By
–
ChromaDB Self-Querying Retriever Last week we introduced the self-querying retriever Basic idea is to use an LLM to turn a user query into a "query" and a "filter" We now implemented to work with @trychroma
! Docs: https://
github.com/hwchase17/lang
chain/blob/master/docs/modules/indexes/retrievers/examples/chroma_self_query_retriever.ipynb
… -
Early OSS lightweight models testing formats private beta
By
–
As a funny aside, one of the early private beta stories I circulated among friends a few months ago as I was testing formats was literally titled “a model in your pocket” and about low-param OSS models. Whoops.
-
JAX Omission Raises Questions About AI Training Technology Strategy
By
–
There’s no mention of JAX. That was a little weird as they own an extremely powerful next-generation training technology in the same way they owned TensorFlow at first.
-
Google’s Strategic Missteps in AI and Open Source Innovation
By
–
Google keeps falling asleep at the wheel here. It didn’t productize MapReduce, allowing Hadoop to happen. It let PyTorch blossom and take over the DS/DL community. And now it has basically let competitors run off with the Transformers technology.
-
Meta’s LLaMA Leak: Legal Implications and Open Source Adoption
By
–
And you have to appreciate the stance here which is basically like “what is Meta going to do, sue all the people using the leaked LLaMA model?”
-
Meta’s FAIR Outpaces Google in Open Source AI Leadership
By
–
Meta comes out looking so good from this. Meta’s AI division FAIR has consistently outmaneuvered Google in the open source deep learning community, starting with PyTorch and now with LLaMA.
-
Custom Language Models Spawn New Generation of AI Startups
By
–
An entire generation of startups are going to be born and grow on the back of these technologies because they are so lightweight and cheap to make custom implementations. I have yet to talk to a company deploying language modeling that is not playing around with custom models.