You can't merge the weights of different architectures with mergekit. I quite like this solution but I don't expect it to be competitive
LLMS
-

AI’s Superior Verbal Skills Compared to Mathematical Abilities
By
–
Interesting, considering AI's verbal skills are currently much better than its math ones.
-

Appreciation for Educational Series on Building and Reproducing GPT Models
By
–
I very much love those "let's series": let's build GPT{model, tokenizer}, let's reproduce GPT-2… Thanks for the efforts and relentless will to educate the world, Andrej
-
LLM Tips and Tutorials for Machine Learning Practitioners
By
–
If you find this useful, RT to share it with your friends. Don't forget to follow me @Saboo_Shubham_ for more such LLMs tips and tutorials.
-
Awesome LLM Apps with RAG GitHub Repository Showcase
By
–
Find all the awesome LLM Apps demo with RAG in the following Github Repo. P.S: Don't forget to star the repo to show your support
-
Local ChatGPT Memory Application Demo Using Streamlit
By
–
Working Application demo using Streamlit
— Shubham Saboo (@Saboo_Shubham_) 10 juin 2024
Paste the above code in vscode or pycharm and run the following command: 'streamlit run local_chatgpt_memory.py' pic.twitter.com/V8qsEyo3H1Working Application demo using Streamlit Paste the above code in vscode or pycharm and run the following command: 'streamlit run local_chatgpt_memory.py'
-

Full Application Code for Local ChatGPT with Memory
By
–
Full Application code for Local ChatGPT with memory
-
Building Chat App with Llama-3 Model API Integration
By
–
7. Generate Response and Display • Generate response using the Llama-3 model with '
http://
client.chat.completions.create()'
• Add the assistant response to the chat history and display it in a chat message container -
Deploy Llama-3 Locally with OpenAI Compatible API
By
–
3. Deploy Llama-3 locally and Create OpenAI like API
— Shubham Saboo (@Saboo_Shubham_) 10 juin 2024
• Download & Install the @LMStudioAI desktop app
• Download llama-3 instruct model
• Expose the model as OpenAI API by simply starting the server.
Here's the video walkthrough: pic.twitter.com/iUiDeV7Z9z3. Deploy Llama-3 locally and Create OpenAI like API • Download & Install the @LMStudioAI desktop app
• Download llama-3 instruct model
• Expose the model as OpenAI API by simply starting the server. Here's the video walkthrough: -

Building Web App with Llama-3 and Streamlit Integration
By
–
2. Import necessary libraries • Streamlit for building the web app
• OpenAI for accessing the Llama-3 model from a local server using the @LMStudioAI