AI Dynamics

Global AI News Aggregator

About

Integrating LLM inference in Lean via ONNX Runtime

Integrate Lean and LLM and an efficient way to run the inference in Lean. After training, the model is converted into the ONNX format, which can be run as a shared library using ONNX Runtime and integrated into Lean through FFI.

→ View original post on X — @animaanandkumar