Welcoming @MetaAI 's Angela Fan at The Research and Applied AI Summit on June 23 in London! Angela focusses on research in text generation, including her recent work on No Language Left Behind and Universal Speech Translation for Unwritten Languages.
AI
-
Building and Deploying Custom Tools for AI Agents
By
–
Tools are elementary: a name, a description, a function. Designing a tool and pushing it to the Hub can be done in a few lines of code. The toolkit of the agent serves as a base: extend it with your tools, or with other community-contributed tools: https://
huggingface.co/docs/transform
ers/custom_tools
… -
Building Super-Powerful AI Agents Together
By
–
Please play with it, add your tools, and let's create *super-powerful agents* together. Here's a notebook to get started:
-
Extensible AI Tool with Multimodal Built-in Capabilities
By
–
It comes with built-in tools: • Document QA
• Speech-to-text and Text-to-speech
• Text {classification, summarization, translation, download, QA}
• Image {generation, transforms, captioning, segmentation, upscaling, QA}
• Text to video It is EXTENSIBLE by design. -
How AI Agents Work: Prompt Building and Chain-of-Thought
By
–
How does it work in practice? It's straightforward prompt-building:
• Tell the agent what it aims to do
• Give it tools
• Show examples
• Give it a task The agent uses chain-of-thought reasoning to identify its task and outputs Python code using the tools. -
Transformers Agents: Democratizing ML with Multimodal Control
By
–
We just released Transformers' boldest feature: Transformers Agents. This removes the barrier of entry to machine learning Control 100,000+ HF models by talking to Transformers and Diffusers Fully multimodal agent: text, images, video, audio, docs… https://
huggingface.co/docs/transform
ers/transformers_agents
… -
Building AI Agents with LLMs for Multimodal Tasks
By
–
Create an agent using LLMs (OpenAssistant, StarCoder, OpenAI …) and start talking to transformers and diffusers It responds to complex queries and offers a chat mode. Create images using your words, have the agent read the summary of websites out loud, read through a PDF
-
Startup Funding Shifts: Post-LLM Hype Era Begins Now
By
–
The question now is: who else? So many startups raised at unicorn levels. While LLMs haven't permeated everything yet—and that'll take a VERY long time—that hype train has stalled and eyes have shifted to more LLM-focused startups.
-
MIT’s Liquid Neural Networks: Flexible Brain-Like AI Models
By
–
MIT inventors of liquid neural networks discuss building their brain-like flexible class of AI models: https://
bit.ly/42GRGc2 -
W&B and LLM Stack Leaders Navigate Post-GPT Era
By
–
W&B stuck the landing in the post-GPT era, along with several other hot startups like MosaicML and Anyscale that proved to be an important part of the LLM-powered stack (in particular for training and inference, respectively, based on people I've talked to).