That starts a llamafile running Llama 3 70 B on localhost port 8080 – then talk to it from LLM like this: llm install llm-llamafile
llm -m llamafile "3 neat characteristics of a pelican"
Running Llama 3 70B locally with llamafile and LLM
By
–
By
–
That starts a llamafile running Llama 3 70 B on localhost port 8080 – then talk to it from LLM like this: llm install llm-llamafile
llm -m llamafile "3 neat characteristics of a pelican"