LLaMa-2 from @MetaAI is here!
Open weights, free for research and commercial use. Pre-trained on 2T tokens.
Fine-tuned too (unlike v1). Lets gooo…. https://
ai.meta.com/llama/
The paper lists the amazing authors who worked to make this happen night and day. Be sure to thank
GENERATIVE AI
-
Meta releases LLaMa-2 open-weight language model free
By
–
-
Anthropic improves language model reasoning through faithful explanations
By
–
We’re excited about ways to make language models generate more faithful explanations that help them reason better! We encourage you to check out our papers for more results and details: https://
www-files.anthropic.com/production/fil
es/measuring-faithfulness-in-chain-of-thought-reasoning.pdf
… https://
www-files.anthropic.com/production/fil
es/question-decomposition-improves-the-faithfulness-of-model-generated-reasoning.pdf
… -
Question Decomposition Methods: Chain-of-Thought and Factored Approaches
By
–
These question-decomposition methods help mark points on a spectrum, with chain-of-thought prompting occupying one end, factored decomposition occupying the other, and chain-of-thought decomposition bridging the middle.
-
Decomposition techniques reduce model reasoning bias
By
–
Decomposition could mitigate issues with models ignoring their reasoning by clearly specifying the relationship between reasoning steps. Answering subquestions in isolated contexts could also reduce the model’s ability to generate biased reasoning.
-
Decomposition Methods Improve Reasoning Faithfulness Trade-offs
By
–
We find different methods for generating reasoning make different tradeoffs between question-answering accuracy and reasoning faithfulness. Our decomposition-based methods push the performance-faithfulness Pareto frontier, making us optimistic for further improvements.
-
Factored vs Chain-of-Thought Decomposition in Prompt Engineering
By
–
Factored decomposition prompts the model to generate subquestions, but has the model answer subquestions in separate contexts. Chain-of-thought decomposition also has the model generate subquestions, but answers all of them in a single context, like chain-of-thought prompting.
-
Reasoning Faithfulness Decreases as AI Models Scale
By
–
We find that reasoning faithfulness shows inverse scaling: as models increase in size and capability, the faithfulness of their reasoning decreases for most tasks studied. In cases where reasoning faithfulness is important, using smaller models may help.
-
Improving Model Reasoning Through Question Decomposition Methods
By
–
To improve the faithfulness of model-generated reasoning, we study two other ways of eliciting reasoning from models in Radhakrishnan et al. These methods rely on question decomposition, or breaking down a question into smaller subquestions to help answer the original question.
-
Chain of Thought Impact on Model Reasoning Accuracy
By
–
For some tasks, forcing the model to answer with only a truncated version of its chain of thought often causes it to come to a different answer, indicating that the CoT isn’t just a rationalization. The same is true when we introduce mistakes into the CoT.
-
Measuring and Improving Language Model Reasoning Faithfulness
By
–
When language models “reason out loud,” it’s hard to know if their stated reasoning is faithful to the process the model actually used to make its prediction. In two new papers, we measure and improve the faithfulness of language models’ stated reasoning.