Adaptive compute could be an interesting/possibly necessary way to solve this.
@mattshumer_
-
GPT-5 Predictions: Extended Context and Enhanced Multimodal Capabilities
By
–
My predictions for GPT-5 capabilities: From least to most interesting: – significantly longer context length + far greater ability to use it effectively (i.e. ability to reason across needles within haystack tests) – much more multimodal (both in terms of # of modalities and
-
AI Models Can Use Links in Prompts for Context
By
–
If the context is online, you can actually paste links to it in the prompt, and the model can decide to use it if it wants! So it’s very likely possible.
-
Value Creation Lies in the Application Layer
By
–
the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer the value is in the app layer
-
Mixtral Training Challenges: Memory Issues and Model Recovery
By
–
Training Bixtral, which is expensive + slow so mistakes are costly. The run finally finished, but then we got a sigkill -9 error (I believe it's a memory issue). I thought I lost the model, but I went into the output directory anyway, and luckily, it was there.
-
Bixtral Fine-Tuned Model Approaches Claude Opus Performance
By
–
Bixtral is a beast. A well-done fine-tune doesn’t feel far off from Opus.
-
Python Interpreter Prompt Format for Mixtral 8x22B
By
–
This system uses the Python interpreter-style prompt format I describe in the article. It's flexible, and works well for most tasks. If you're building w/ Mixtral 8x22B, you NEED to try this.
-
Instruct Prompt to Base Model Converter Notebook
By
–
If you'd like to try it or contribute, check out the Github repo. Use the `Instruct_Prompt_>_Base_Model_Prompt_Converter.ipynb` notebook.
-
Open-source tool converts chat prompts for Mixtral base model
By
–
Introducing `instruct-to-base-prompt-converter` ✍️
— Matt Shumer (@mattshumer_) 12 avril 2024
Prompting base models like Mixtral 8x22B is insanely hard.
Now, AI can do it for you!
Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model!
And it's open-source! pic.twitter.com/rKAgkXxidnIntroducing `instruct-to-base-prompt-converter` Prompting base models like Mixtral 8x22B is insanely hard. Now, AI can do it for you! Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model! And it's open-source!