Most significant is the API-compliance "code golf" type of code, which is so prevalent in ML. It's able to handle refactoring much more reliably, and helps find tricky bugs as a first-pass sanity check… I also let it write first pass of most new scripts, but they change a lot.
RESEARCH
-
LLM2LLM: Iterative Data Augmentation Strategy for Model Fine-tuning
By
–
10). LLM2LLM – an iterative data augmentation strategy that leverages a teacher LLM to enhance a small seed dataset by augmenting additional data that can be used to effectively fine-tune models.
-
FollowIR Dataset Improves Information Retrieval Model Performance
By
–
9). FollowIR – a dataset with instruction evaluation benchmark and a separate set for teaching information retrieval model to follow real-world instructions; a FollowIR-7B model has significant improvements (over 13%) after fine-tuning on a training set.
-
Long-Form Factuality Evaluation in Large Language Models
By
–
6). Long-form factuality in LLMs – investigates long-form factuality in open-domain by generating a prompt set of questions including 38 topics; also proposes an LLM-based agent to perform evaluation for the task.
-
Top ML Papers of the Week: DBRX, Grok, LLM2LLM and More
By
–
The Top ML Papers of the Week (March 25 – March 31): – DBRX
– Grok-1.5
– LLM2LLM
– Mini-Gemini
– Agent Lumos
– Long-form factuality in LLMs
… -
DBRX: New 132B Open-Source LLM Outperforms Benchmarks
By
–
1). DBRX – a new 132B parameter open LLM that outperforms all the established open-source models on common benchmarks like MMLU and GSM8K; DBRX was pretrained on 12T tokens (text and code) and uses a mixture-of-experts (MoE) architecture.
-
UBC and Honda Unveil Innovative Robot Skin Technology
By
–
UBC and Honda Unveil Innovative 'Robot Skin' Technology
— Ronald van Loon (@Ronald_vanLoon) 31 mars 2024
by @ONPASSIVE#Robotics #Engineering #MI #Innovation #FutureOfWork #Tech
cc: @pbalakrishnarao @chr1sa @bigdata pic.twitter.com/1A2wSvK3eyUBC and Honda Unveil Innovative 'Robot Skin' Technology
by @ONPASSIVE #Robotics #Engineering #MI #Innovation #FutureOfWork #Tech cc: @pbalakrishnarao @chr1sa @bigdata -
Global State Required for Information Recognition and Meaning
By
–
We cannot even recognize or integrate information without reaching some global state that allows to interpret its meaning
-
Cell Consciousness and Emergent Intelligence Systems
By
–
I don’t know whether individual cells are conscious. How do you know? (If they are, I don’t expect that the consciousness of the cell can communicate with the consciousness forming across cells.)
-
Consciousness Operates Uniformly Across All Minds
By
–
I think that consciousness itself works in the same way across minds