9). Small Language Models Survey – a comprehensive survey on small language models (SLMs) across architectures, training datasets, and training algorithms; analyzes 59 state-of-the-art open-source SLMs and capabilities such as reasoning, in-context learning, maths, and coding.
CODE
-
Minstrel: Multi-Agent System with Reflection for Automated Prompt Engineering
By
–
10). Minstrel – a multi-generative agent system with reflection capabilities to automate structural prompt generation; it presents LangGPT, an extensible framework for designing prompts.
-
RAG Task Categorization Survey: External Data Classification
By
–
7). RAG and Beyond – presents a survey that introduces a RAG task categorization method that helps to classify user queries into four levels according to the type of external data required and the focus of the task.
-
Software Development: Making Things Worse While Fixing Them
By
–
In German, the word "Verschlimmbessern" means “to make something worse while repairing it.” In English, we call that "software development."
-
Model Merging Techniques and Hidden Representation Dynamics
By
–
I'd say it barely works tbh… 🙂 It really depends on the type of merge and whether you retrain it or not. In this case, it's not really "working". The additional layers seem to push the hidden representations into new areas, which may or may not be interesting, depending on
-
Model Merges and 34B Evaluation Updates
By
–
I would usually assume that but my merges do work though. It might have been fixed after the 34B eval?
-
Open LLM WebUI: Execute Local Language Models via Web Application
By
–
Open LLM WebUI This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
-
Plasticity in Visual Reinforcement Learning: Data and Training
By
–
Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training Stages #ICLR2024 https://
arxiv.org/abs/2310.07418 https://
github.com/Guozheng-Ma/Ad
aptive-Replay-Ratio
…
we conduct a systematic empirical exploration focusing on three primary underexplored facets and derive the following conclusions: -
Real-time Object Detection with YOLOv5n6 for High-Resolution CCTV
By
–
CCTV_YOLO Fast Real-time Object Detection with High-Res Output This project demonstrates real-time object detection using the YOLOv5n6 model with low-resolution inference for high-speed processing, while drawing the results on high-resolution frames. The object detection
-
HARP: ML-Powered Audio Sample Editor with Gradio Integration
By
–
HARP HARP is a sample editor that allows for hosted, asynchronous, remote processing of audio with machine learning. HARP works by routing audio through Gradio endpoints. Since Gradio applications can be hosted locally or in the cloud (e.g. with HuggingFace Spaces), HARP lets