Integrate Lean and LLM and an efficient way to run the inference in Lean. After training, the model is converted into the ONNX format, which can be run as a shared library using ONNX Runtime and integrated into Lean through FFI.
Integrating LLM inference in Lean via ONNX Runtime
By
–