Mainly for writing so it can enrich given context with info from search results and apply certain writing rules like 5whys etc
GENERATIVE AI
-
Copyright concerns in AI model training and fine-tuning
By
–
For that one, I don't believe the original poster. Either they were doing a fine-tune only, or used an existing CLIP model — but both options imply there was Copyrighted data used. No way you could know "Sonic" means a blue hedgehog with cartoon shoes otherwise.
-
Data Quality and Legal Optimization in AI Model Development
By
–
You mean that people will get used to the features? I still think there'll be a wave of legal "optimization" just like they are now optimizing performance. If you can build a model with 100% clean data, that has inherent value to those wanting to minimize risk (govt, bigcorp).
-
Model Collapse: Training AI on Synthetic Data Risks
By
–
9/ Model Collapse on Synthetic Data – investigates the effects of training models on recursively generated data; finds that training on model-generated content can cause irreversible defects where the original content distribution disappears; shows that the effect, referred to as
-
Training-Free Method Mitigates LLM Hallucination Via Generation Constraints
By
–
10/ Mitigating Hallucination via Generation Constraint – proposes a new training-free approach to mitigate hallucination in LLMs; they scaled the readout vector that constrains generation in a memory-augmented LLM decoder; recent works claim that LLMs with explicit memory
-
MINT-1T Open-Sources 1 Trillion Token Multimodal Dataset
By
–
8/ MINT-1T – open-sources a large-scale multimodal interleaved dataset consisting of 1 trillion tokens which has 3.4 billion images; it also includes new sources such as PDFs and ArXiv papers.
-
LazyLLM Dynamic Token Pruning Accelerates LLM Inference by 2.34x
By
–
5/ LazyLLM – introduces a novel dynamic token pruning method for efficient long-context LLM inference; it can accelerate the prefilling stage of a Llama 2 7B model by 2.34x and maintain high accuracy; it selectively computes the KV for tokens that are important for the next token
-
Teaching LLM Agents to Self-Improve Through Iterative Feedback
By
–
6/ Teaching LLM Agents to Self-Improve – claims it is possible to iteratively fine-tune LLMs with the ability to improve their own response over multiple turns with additional environment feedback; the LLM learns to detect and correct its previous mistakes in subsequent
-
AlphaProof Solves IMO Mathematics Problems with Formal Reasoning
By
–
2/ AlphaProof & Alpha Geometry 2 – solved 4 out of 6 problems in this year’s IMO which is the equivalent of a silver-medal score; AlphaProof consists of a Gemini model that automatically translates natural language problem statements into formal statements (i.e., formalizer
-
OpenDevin Platform Enables Generalist Software Agents
By
–
4/ OpenDevin – presents a platform to develop generalist agents that interact with the world through software; features include 1) an interaction mechanism for interaction between agents, interfaces, and environments, 2) an environment including a sandboxed operating system and