Defining the Differences between MLOps, ModelOps, DataOps & AIOps https://
bit.ly/42f1zP7 By @ingliguori @kenovy_it #AI #MachineLearning #MLOps
MACHINE LEARNING
-

Differences between MLOps, ModelOps, DataOps and AIOps
By
–
-
Text prediction machinery has cognitive quirks, not ideal simulation
By
–
You should care about weird machinery underlying text predictions that has its own cognitive quirks, not imagine it as an ideal simulacrum plus noise.
-
Outer Optimizers and Inner Optimizers: Beyond Naive Reward Function Pursuit
By
–
From my perspective, the point of raising the example of natural selection is that it debunks the naive belief that if in general an outer optimizer trains on reward function, it gets an inner optimizer that pursues that reward function OOD. Saying "But SGD is first-order and
-

Direct Preference Optimization: Language Models as Reward Models
By
–
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafailov et al.: https://
arxiv.org/abs/2305.18290 #ArtificialIntelligence #DeepLearning #MachineLearning -

Direct Preference Optimization: Language Model as Reward Model
By
–
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafailov et al.: https://
arxiv.org/abs/2305.18290 #ArtificialIntelligence #DeepLearning #MachineLearning -
ML Systems Cannot Magically Recover Hidden Information
By
–
A prevalent cognitive fallacy around ML systems is the belief that they can magically recover hidden information that is out of reach for human experts — "the AI detected that those Apollo pictures are fake!", "the AI can predict if the person in the picture is a criminal!",
-
Linear Regression Should Stop Being Called AI
By
–
can finally stop calling Linear Regression as AI.
-
DocLLM: Visual Document Reasoning with Bounding Box Spatial Layout
By
–
8/ DocLLM – an extension to traditional LLMs for reasoning over visual documents; focuses on using bounding box information to incorporate spatial layout structure; demonstrates SoTA on 14 of 16 datasets across several document intelligence tasks.
-

LLM Augmented LLMs: Composing Models for Expanded Capabilities
By
–
5/ LLM Augmented LLMs – explore composing existing foundation models with specific models to expand capabilities; introduce cross-attention between models to compose representations that enable new capabilities.
-

Fast Inference of Mixture-of-Experts Models via Offloading
By
–
6/ Fast Inference of Mixture-of-Experts – achieves efficient inference of Mixtral-8x7B models through offloading; designs a MoE-specific offloading strategy that enables running Mixtral-8x7B on desktop hardware and free-tier Google Colab instances.