With more effort, we developed a series of LM generation/filtering stages to create a larger version of the popular Winogender bias dataset. Our “Winogenerated” evaluation contains 50x as many examples as the original while obeying complex grammatical constraints.
AI
-
Automated Generation of Yes-No Questions for LM Behavior Evaluation
By
–
We explored approaches with varying amounts of automation and human effort. In the simplest case, we generated thousands of yes-no questions for diverse behaviors just by instructing an LM (and filtering out bad examples with another LM).
-
Anthropic Explores Automating Language Model Evaluation
By
–
We explored approaches with varying amounts of automation and human effort. In the simplest case, we generated thousands of yes-no questions for diverse behaviors just by instructing an LM (and filtering out bad examples with another LM). Random examples of LM-written evals:
-
Automated Language Model Evaluations Using AI-Generated Tests
By
–
It’s hard work to make evaluations for language models (LMs). We’ve developed an automated way to generate evaluations with LMs, significantly reducing the effort involved. We test LMs using >150 LM-written evaluations, uncovering novel LM behaviors. https://
anthropic.com/model-written-
evals.pdf
… -
Should Hugging Face Expand Its Social Collaboration Features?
By
–
Should Hugging Face do more social features?
-
LangChain v0.0.41 Release: Multiple Inputs, Bug Fixes, Agent Improvements
By
–
LangChain v0.0.41 Make `run` interface work for multiple inputs (
@ankush_gola11
) Bug fix for text splitter (h/t @prof_reed
) Lots of agent improvements (see ) -
InteriorAI Reaches $8,500 MRR Two Months After Launch
By
–
http://
interiorAI.com just passed $8,500/mo MRR, seems it's finally taking off again 2 months after launch! -
Groq Delivers Record-Breaking Inference Speeds for Faster Development
By
–
Why do customers work with @GroqInc
? Faster time-to-production for developers with record-breaking inference speeds. Watch the #AISummit interview with @lifebypixels
, Head of Brand & Creative, to hear our story, solutions, and where Groq is going next. https://
aibusiness.com/companies/ai-s
ummit-new-york-2022-groq-at-the-ai-business-tv-newsdesk
… -
GPU Demand Surge Driven by Deep Learning Applications Growth
By
–
In 2023, demand for GPUs will soar as more applications founded on deep learning emerge, says our CEO Nick Elprin in @insideBigData
. Learn more about the future of deep learning in insideBigData’s 2023 Big Data Industry predictions: https://
domino.buzz/3FHemiR #MLOps #datascience -
Abacus AI: Real-Time Machine Learning at Enterprise Scale
By
–
@abacusai makes data wrangling a breeze with advanced features and support for streaming pipelines! Our MLOps platform enables real-time Machine Learning at scale for common enterprise use cases.