You can do it with LazyMergekit. I've added all the commands and the config I've used.
OPEN SOURCE
-
AI-in-Action Club Launches DSPy Framework Training Session
By
–
our next #ai-in-action club is starting now: on @lateinteraction
’s DSPy! led by @ProgramWithAi and @kbal11 -
GGUF Quantizations Ready for Hermes-3-Llama Model Testing
By
–
GGUF quants are also ready if you want to test the model. @bartowski1182 already made fancy imatrix ones. Love the new model tree on @huggingface
! (cc @victormustar @julien_c
) GGUF: https://
huggingface.co/mlabonne/Herme
s-3-Llama-3.1-8B-lorablated-GGUF
… -
Open-Source AI Models and Abliteration Techniques Explained
By
–
Of course, special thanks to @NousResearch and @teknium for these high-quality models. Thanks to grimjim and @failspy for the abliteration techniques that were used here. You can learn more about it in my article:
-
Hermes 3 LoRA-Ablated Uncensored Model Release
By
–
A fully uncensored Hermes 3 with lorablation! The lorablated model directly answers questions without any tweaking. Here's how it was made: 1/ Create a LoRA adapter based on Llama 3.1 8B Instruct and my abliterated version. 2/ Apply it to Hermes 3 from @NousResearch using
-
Tamper-Resistant Safeguards for Open-Weight LLMs
By
–
Excited to feature Tamper-Resistant Safeguards for Open-Weight LLMs from @lapisrocks
! Introducing the first safeguards for LLMs that resist fine-tuning attacks, showing the power of tamper-resistance to make open-weight LLMs safer. @rishub_t is here to answer your questions! -
MergeKit and PruneMe: Essential Tools for Model Optimization
By
–
No, I would recommend libraries like MergeKit or PruneMe (
https://
github.com/arcee-ai/Prune
Me
…) from @arcee_ai for pruning. -
Modular Speech-to-Speech Pipeline Achieves Sub-500ms Latency
By
–
this modular speech-to-speech pipeline repo with <500 ms second latency (on a local GPU) is going crazy
— Thomas Wolf (@Thom_Wolf) 16 août 2024
Impressive what a well tuned pipeline of stt-llm-tts can do
cool work by @eustachelb with @reach_vb and @andi_marafioti
find the code here: https://t.co/HrbqSWQ3sj pic.twitter.com/HDkEnVntKNthis modular speech-to-speech pipeline repo with <500 ms second latency (on a local GPU) is going crazy Impressive what a well tuned pipeline of stt-llm-tts can do cool work by @eustachelb with @reach_vb and @andi_marafioti find the code here: https://
github.com/eustlb/speech-
to-speech
… -
Open-Source OCR Development for Asian Languages
By
–
Who’s working on (open-source ai for) OCR for languages spoken in Asia? Thinking in particular Hindi, Nepali but also wider