Fuck it! Structured Generation w/ SmolLM2 running in browser & WebGPU 🔥

Powered by MLC Web-LLM & XGrammar ⚡

Define a JSON schema, Input free text, get structured data right in your browser – profit!!

To showcase how much you can do with just a 1.7B LLM, you pass free text,… pic.twitter.com/x5GYWdmTe3

— Vaibhav (VB) Srivastav (@reach_vb) 28 novembre 2024

Fuck it! Structured Generation w/ SmolLM2 running in browser & WebGPU Powered by MLC Web-LLM & XGrammar Define a JSON schema, Input free text, get structured data right in your browser – profit!! To showcase how much you can do with just a 1.7B LLM, you pass free text,

→ View original post on X — @reach_vb,