Skip to content

AI Dynamics

Global AI News Aggregator

Rechercher

@snorkelai

Snorkel AI Reading Group: Russell Yang on JudgmentBench

By

@snorkelai

–

08 June 2026 21h43

Join us for late-afternoon boba and research. RSVP: https://t.co/lMUBYMGPZx🧋

Next up in the Snorkel AI Reading Group: Russell Yang (@StanfordLaw) on “JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment,” stemming from a collaboration with @harvey… pic.twitter.com/bexEc52RVX
— Snorkel AI (@SnorkelAI) 8 juin 2026

Join us for late-afternoon boba and research. RSVP: https://
luma.com/qwsxqfa2 Next up in the Snorkel AI Reading Group: Russell Yang (
@StanfordLaw
) on “JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment,” stemming from a collaboration with @harvey

→ View original post on X — @snorkelai

8 June 2026
Snorkel AI Reading Group on JudgmentBench with Russell Yang

By

@snorkelai

–

08 June 2026 21h43

Join us for late-afternoon boba and research. RSVP: https://t.co/lMUBYMGPZx🧋

Next up in the Snorkel AI Reading Group: Russell Yang (@StanfordLaw) on “JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment,” stemming from a collaboration with @harvey… pic.twitter.com/bexEc52RVX
— Snorkel AI (@SnorkelAI) 8 juin 2026

Join us for late-afternoon boba and research. RSVP: https://
luma.com/qwsxqfa2 Next up in the Snorkel AI Reading Group: Russell Yang (
@StanfordLaw
) on “JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment,” stemming from a collaboration with @harvey

→ View original post on X — @snorkelai

8 June 2026
Collaborative Gym for Human-Agent Collaboration: Stanford NLP Talk

By

@snorkelai

–

04 June 2026 21h44

Our thanks to everyone who dropped by yesterday for boba to learn from @EchoShao8899 of @stanfordnlp about "Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration". Key takeaway: across 3 tasks (travel planning, related-work writing, and tabular

→ View original post on X — @snorkelai

4 June 2026
Benchtalks #2 discusses ProgramBench where frontier models scored 0%

By

@snorkelai

–

03 June 2026 21h07

Benchtalks #2 is up with @vincentsunnchen. @jyangballin of @stanfordnlp, creator of @SWEbench, on ProgramBench, the benchmark every frontier model scored 0% on at launch.

They dive into end-to-end code generation, why models reward-hack once they get internet access, and the… https://t.co/WZmhUqa8ya
— Snorkel AI (@SnorkelAI) 3 juin 2026

Benchtalks #2 is up with @vincentsunnchen
. @jyangballin of @stanfordnlp
, creator of @SWEbench
, on ProgramBench, the benchmark every frontier model scored 0% on at launch. They dive into end-to-end code generation, why models reward-hack once they get internet access, and the

→ View original post on X — @snorkelai

3 June 2026
Benchtalks #2: SWE-bench creator jyangballin discusses ProgramBench and upcoming project

By

@snorkelai

–

02 June 2026 23h24

Benchtalks #2: @jyangballin
, creator of SWE-bench, fresh off ProgramBench (every frontier model: 0% at launch). Out soon with @vincentsunnchen
.

→ View original post on X — @snorkelai

2 June 2026
AI capabilities outpace measurement, says Snorkel AI CEO

By

@snorkelai

–

31 May 2026 16h15

“Our ability to do stuff with AI has significantly outpaced our ability to measure capabilities,” says @ajratner, CEO of Snorkel AI.

Alex recently joined the @chain_ofthought podcast with @ConorBronsdon to talk all things frontier AI.

Watch the full conversation covering the… pic.twitter.com/cQZkRoY16i
— Snorkel AI (@SnorkelAI) 31 mai 2026

“Our ability to do stuff with AI has significantly outpaced our ability to measure capabilities,” says @ajratner
, CEO of Snorkel AI. Alex recently joined the @chain_ofthought podcast with @ConorBronsdon to talk all things frontier AI. Watch the full conversation covering the

→ View original post on X — @snorkelai

31 May 2026
JudgmentBench: First Public Benchmark for AI Quality Assessment Released

By

@snorkelai

–

27 May 2026 20h37

Congratulations to @StanfordLaw liftlab on the release of JudgmentBench, the first publicly available benchmark in a high-judgment domain where both methods for assessing quality are solicited over the same tasks. Snorkel was proud to contribute as research and data partners on

→ View original post on X — @snorkelai

27 May 2026
Frontier AI Models Struggle with Long-Horizon Legal Tasks, Study Finds

By

@snorkelai

–

26 May 2026 21h43

Initial LAB results from Harvey put a number on something we see across specialized AI work: under rigorous all-pass standards, frontier models complete fewer than 10% of long-horizon legal tasks, and no single model leads across practice areas. General capability isn't

→ View original post on X — @snorkelai

26 May 2026
Supporting Terminal-Bench Science for Scientific AI Benchmarking

By

@snorkelai

–

20 May 2026 19h33

We're proud to support @StevenDillmann on Terminal-Bench Science, an open benchmark pushing the frontier of scientific AI through Open Benchmark Grants. But it needs YOU – the research community – to shape the next wave of computational science workflows. → Contribute here:

→ View original post on X — @snorkelai

20 May 2026
Methodology for steering AI model behavior

By

@snorkelai

–

16 May 2026 23h50

“If you want your model to do something different, you don’t go and perform brain surgery in the neurons. You don’t reinvent the architecture of the algorithm. You don’t say ‘hey, I want my agent to be better at cobol in hospital systems, let me go and invent a new… pic.twitter.com/nhXZxntqaS
— Snorkel AI (@SnorkelAI) 16 mai 2026

“If you want your model to do something different, you don’t go and perform brain surgery in the neurons. You don’t reinvent the architecture of the algorithm. You don’t say ‘hey, I want my agent to be better at cobol in hospital systems, let me go and invent a new

→ View original post on X — @snorkelai

16 May 2026

←Previous Page

1 2 3 4 … 58

INNOVATION GENERATIVE AI RESEARCH LLMS TOOLS MACHINE LEARNING CODE MARKET TRENDS TECHNOLOGY BUSINESS BIG TECH ETHICS ENTERPRISE AI SOFTWARE AGENTS AUTOMATION APPS COMPUTING DATA POLICY OPEN SOURCE MULTIMODAL AI REGULATION CULTURE CREATIVE AI PROMPT ENGINEERING SOCIETY ECONOMY SAFETY EDUCATION INVESTMENT AI HARDWARE AGI HARDWARE JOBS STARTUPS INDUSTRY ROBOTICS WORKFORCE SECURITY CYBERSECURITY HEALTHCARE AI SYSTEMS SUSTAINABILITY WEB3 DECENTRALIZED AI

AI Dynamics

Global AI News Aggregator

About
Archives
Contact

Rechercher