Get the model here: • : https://
tinyurl.com/gemma10hf
• GitHub: https://
tinyurl.com/gemma10git
• Technical blog: https://
tinyurl.com/gemma10blog
OPEN SOURCE
-
Gemma 10 Model Released: Access Hub and Technical Documentation
By
–
-
Google Gemma 10M Context Window: Local LLM Breakthrough
By
–
Google Gemma with a 10M context window LLM features:
• 1250x context length of base Gemma
• Requires less than 32GB of memory
• Infini-attention + activation compression Imagine if you can run 10 million context LLM locally on your computer with @ollama or @LMStudioAI
. -
Signal Emphasizes Open Development Security Auditing
By
–
Feel what you feel, but we're not asking you to take our word. We're developing in the open, enabling verification, and working with the security community to audit and attest to our code and the promises it keeps. That's the difference between Signal and the rest of the major
-
New open source model with 10M context window
By
–
A new open source model with 10M context window is out. “We gradually increased context size from 32K →… 4M → 10M. This allowed us to prioritize pretraining with shorter sequences in the beginning, thereby offering higher utilization rates.”
-
Open Source Fights Back Against AI Regulation at Capitol
By
–
Last week, I spoke about AI and regulations at an event at the U.S. Capitol attended by legislative and business leaders. I’m encouraged by the progress the open source community has made fending off regulations that would have stifled innovation. But opponents of open source are
-
Open-Source AI Power Concentration and M&A Business Models
By
–
Always great to catch up with @technology @CarolineHydeTV & @EdLudlow about open-source AI, concentration of power & business models & M&A for AI!
-
ORPO Fine-tuning Configuration for Llama3-8B on Single GPU
By
–
Here's the best config to orpo finetune llama3-8b on argilla capybara on a single 24GB home GPU! Github: https://
github.com/huggingface/au
totrain-advanced/blob/main/configs/llm_finetuning/llama3-8b-orpo.yml
…
You can run this config using AutoTrain: $ pip install -U autotrain-advanced
$ autotrain –config config.yaml/URL to raw config file -
Drupal Community Conference Portland 2024 Organizers Recognized
By
–
Thank you to the coordinators, marketers, and speaker reviewers for organizing, connecting, and supporting the Drupal community at this conference <3 https://
events.drupal.org/portland2024/m
eet-committees
… #opensource #drupalconportland #drupal -
85M Examples Dataset Combines 400 Datasets Open Source
By
–
85M examples, combining over 400 datasets together. This is a massive win for the open-source AI community.