I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
OPEN SOURCE
-
LLaMA 3 Context Window Doubled to 16K Tokens
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
ICLR Features Hugging Face Demo Platform for AI Models
By
–
ICLR blog: https://
blog.iclr.cc/2024/04/22/hug
ging-face-demo-site/
… -
Hugging Face Demo Site for ICLR Conference Paper Submissions
By
–
Hugging Face is hosting a demo site for @iclr_conf authors to find and claim their papers and discuss those papers on dedicated pages The page includes all accepted papers, along with linked datasets, models, and demos
-
Lean Copilot Automates Over 80% of Mathematical Proof Steps
By
–
We have now posted an expanded version of our Lean Co-pilot paper and updated the code base. https://
arxiv.org/abs/2404.12534 https://
github.com/lean-dojo/Lean
Copilot
…
The credit goes to @p_song1 for driving this effort.
Our latest experiments show that our co-pilot can automate >80% of the proof steps -
Llama3-70B Achieves Top Ranking on English-only Benchmark
By
–
also, Llama3-70B is #1 on English-only, whut!!!!
-
Ollama LLM Plugin Integration for WordPress
By
–
Yes, ollama is a great option too – I only wrote about the options I'd got running myself, ran out of time! There's an LLM plugin for ollama here:
-
LLM Plugin Directory Now Features 30 Available Plugins
By
–
The LLM plugin directory lists 30 plugins now! https://
llm.datasette.io/en/stable/plug
ins/directory.html
… If you want to try writing your own there's a comprehensive tutorial included in the docs: https://
llm.datasette.io/en/stable/plug
ins/tutorial-model-plugin.html
… -
LLaMA 3-based model deployment nearing completion
By
–
Very soon. This is one of the last things I have to get working well before we can push a LLaMA 3-based model live.
-
LLaMA 3 8B Extended to 16K Token Context Window
By
–
Training a LLaMA 3 8B that supports 16K tokens, twice the current context window. If successful, will open-source it.