And of course, lots of usual docs/bug fixes! s/o @eltociear @tangjeff0 (x2) @concaption @kevin_w_huo Jon Luo, Peng Qu Happy weekend!
@langchain
-
LangChain PagedPDF Tracks Page Numbers for Source Citations
By
–
PDFs with pages @andrewwhite01 added a PagedPDF that keeps track of page numbers in the metadata This metadata is useful when doing question answering with sources! Docs: https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/examples/pdf.html
… -
LangChain YouTube Metadata Integration Feature
By
–
YouTube metadata Speaking of metadata, thanks to Alex Zhangji you can now specify `add_video_info=True` and it will add relevant metadata from YouTube to the document Docs: https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/examples/youtube.html#add-video-info
… -
Tiktoken Improvements: Enhanced Special Token Parameters
By
–
Tiktoken improvements Thanks to @jamescalam you can now specify `allowed_special` and `disallowed_special` as parameters for the tiktoken tokenizer PR: https://
github.com/hwchase17/lang
chain/pull/924
… -
LangChain Adds Batch Embeddings Support for OpenAI
By
–
Batch embeddings While we have support for batch processing of LLM calls, we didn't have support for batch processing of embeddings until now. @jmdagdelen added it for the @OpenAI embedding module PR: https://
github.com/hwchase17/lang
chain/pull/969/files
… -
LangChain 0.0.82 Release: New Document Loaders and Embeddings
By
–
End of week release! 0.0.82 Some new/improved document loaders:
URLs – @UnstructuredIO Matt Robinson
EveryNote
PDFs @andrewwhite01 YouTube (Alex Zhangji) Some new features:
Batch embeddings @jmdagdelen Tiktoken improvements And the usual docs/bug fixes! -
LangChain URL Document Loader Integration with UnstructuredIO
By
–
URL document loader Using @UnstructuredIO
, now load data from URLs directly into the LangChain document format s/o Matt Robinson for adding! Docs: https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/examples/url.html
… -
LangChain Adds EveryNote File Loading Support
By
–
EveryNote By popular demand, added support for loading EveryNote files (.enex) Docs: https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/examples/everynote.html
… -
LangChain Obsidian Document Loader Integration Now Available
By
–
should be done! https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/examples/obsidian.html
… -
LangChain Adds Data Loaders for Cloud Storage and Popular Platforms
By
–
We added a lot of data loaders over the past few days: Cloud Storage: s3, GCS
Prosumer: Roam, Obsidian
Fun Websites: YouTube, AZLyrics, College Confidential https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/how_to_guides.html
… Which ones are you favorites?