CODE

HybridRAG Combines GraphRAG VectorRAG for Superior Performance

By

–

18 August 2024 18h24

6/ HybirdRAG – combines GraphRAG and VectorRAG leading to a HybridRAG system that outperforms both individually; it was tested on a set of financial earning call transcripts. Combining the advantages of both approaches provides more accurate answers to queries.

LongWriter AgentWrite Enables LLMs Generate Beyond 20K Words

By

–

18 August 2024 18h24

3/ LongWriter – proposes AgentWrite to enable off-the-shelf LLMs to generate coherent outputs beyond 20K words; AgentWrite breaks down the long generation task into subtasks and in a divide-and-conquer approach generates…

EfficientRAG: Auto-Encoder LM for Intelligent Chunk Retrieval

By

–

18 August 2024 18h24

4/ EfficientRAG – trains an auto-encoder LM to label and tag chunks; it retrieves relevant chunks, tags them as either or , and annotates chunks for continuous processing; then a filter model is trained to formulate the next-hop query based on the

Grok-2: New Frontier Model Surpasses Claude and GPT-4

By

–

18 August 2024 18h23

2/ Grok-2 – a new frontier model with strong code, math, and reasoning capabilities which includes a large and small model; outperforms both Claude 3.5 Sonnet and GPT-4-Turbo on the LMSYS Chatbot Arena; claims to improve capabilities including instruction following, retrieval,

→ View original post on X — @nandodf

JAX vs PyTorch: Choosing the right ML framework

By

@nandodf

–

18 August 2024 17h55

It depends. If you have TPUs, Jax. If you have GPUs, PyTorch. It also depends on who your community is, and whether you need to distribute models or not. For simple ML, either is fine and then it comes down to popularity within your circle.