I have never trained a ternary LLM or BERT language model. Looks like there are only few publicly available repos out there. I would maybe start with the "TernaryBERT: Distillation-aware Ultra-low Bit BERT" paper and go from there
OPEN SOURCE
-
OpenAI Returns with Open Artifacts on Hugging Face
By
–
Welcome back! Hoping that your return also brings some life to open artefacts on the OpenAI org on the Hugging Face Hub too: https://
huggingface.co/openai -
SambaNova Cloud accelerates coding with LLM technology
By
–
SambaNova @Continue Swipe through for an overview of the ways you can accelerate coding with SambaNova Cloud. #LLM #GenAI #OpenSource
-
Neptune Benchmark: Testing AI’s Long Video Understanding Capabilities
By
–
Can #AI truly understand long videos? Tobias Weyand & the Google Research team are testing the limits w/ Neptune, an open-source benchmark for long video understanding. Dive into the details & see how AI tackles temporal reasoning, cause & effect, & more →https://t.co/jNkgEYkdFA pic.twitter.com/rXPBdRS9TM
— Google AI (@GoogleAI) 12 novembre 2024Can #AI truly understand long videos? Tobias Weyand & the Google Research team are testing the limits w/ Neptune, an open-source benchmark for long video understanding. Dive into the details & see how AI tackles temporal reasoning, cause & effect, & more →
https://
goo.gle/4esTTNM -
Qwen 2.5-Coder Now Available on Hugging Chat Platform
By
–
Qwen 2.5-Coder is now available on Hugging Chat – GPT-4 coding capabilities – Open source / Apache 2.0 – 40+ programming languages supported
– Available in 6 sizes (0.5B-32B) -
AlphaFold 3 Now Open-Source: Nobel Prize-Winning Protein Structure Prediction
By
–
The Nobel Prize-winning tool AlphaFold 3 is now open-source: https://
bit.ly/3Z3mvsO The AI model can accurately predict the structure & interactions of proteins, DNA, RNA, and more. Image v/
@GoogleDeepMind -
Unitree G1 Robot Dataset Open Sourced and Continuously Updated
By
–
„the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated“. Amazing. pic.twitter.com/pMfvqErY77
— Chubby♨️ (@kimmonismus) 12 novembre 2024„the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated“. Amazing.
-
OpenCoder: Top-Tier Open Source Code Language Model
By
–
Introducing OpenCoder, a Fully Open Code LLM. https://
arxiv.org/abs/2411.04905 https://
opencoder-llm.github.io a top-tier code LLM that not only achieves performance comparable to leading models but also serves as an "open cookbook" for the research community. -
Alibaba Qwen Releases Qwen2.5-Coder-32B-Instruct Model
By
–
introducing Qwen2.5-Coder-32B-Instruct released by @Alibaba_Qwen
-
Community Celebrates Qwen 2.5 Model Family Release
By
–
Congratulations on the release! The community loves Qwen 2.5 and the entire model family!