Analyzing documents just got a lot easier with v0.0.39 (with major assist from @OpenAI
) Added a `collapse` step into the map-reduce chain (
@johnjnay
)
Added support for @OpenAI new embeddings
Added support for @OpenAI new tokenizer Heres how they all work together
AI
-
LangChain v0.0.39: Document Analysis with OpenAI Integration
By
–
-
Collapse Step for Map-Reduce Chain Scaling
By
–
Adding a `collapse` step into the map-reduce chain This recursively collapses documents into smaller and smaller chunks, allowing you to scale to arbitrarily many documents This was a @johnjnay special – see his thread for more
-
OpenAI Releases New Embedding Model for Semantic Search
By
–
@OpenAI released a new embedding model (`text-embedding-ada-002`) This makes it possible to more easily do semantic search over collections of documents This is now the default OpenAI embedding model in LangChain
-
Stability SDK failure dumps all data
By
–
Okay looks like if Stability SDK fails it dumps all of this
-
Stability SDK Python generates massive 3.5 GB ProtoBuffer files
By
–
Anyone know why @StabilityAI
's Stability SDK Python lib generates massive 3.5 GB folders full of ProtoBuffer *.pb files? -
Constitutional AI: Moving Beyond Researcher-Defined Constitutions
By
–
In our paper we used an ad hoc constitution drafted purely for research purposes. Ultimately, we think constitutions shouldn’t be just defined by researchers in isolation, but by groups of experts from different disciplines working together.
-
Constitutional AI: Making Implicit Principles Explicit in AI Systems
By
–
While the name “Constitutional AI” may sound ambitious, we chose it to emphasize that powerful, general-purpose AI systems will always be operating according to *some* principles, even if they are left implicit, or encoded in privately held data.
-

Hugging Face Reaches 100,000 Public AI Models Milestone
By
–
We crossed 100,000 public AI models on the @huggingface hub available for free to all. Thank you to the whole community of contributors. Proud to make ML more open & collaborative!
-

Favorite Use Case Demonstration with Perplexity AI SQL
By
–
This is actually one of my favorite use cases. https://
perplexity.ai/sql?uuid=a2528
57b-284f-45a2-a7bc-3a797db17188
…