Has anyone tried fine-tuning half of the layers in one run, and then the other half in another? cc @teknium @winglian @erhartford
OPEN SOURCE
-
Snowflake Arctic Embed Open Source Models Launch
By
–
Snowflake Arctic Embed Yesterday @SnowflakeDB shipped their open source Arctic family of embedding models. You can use them with our @huggingface Embeddings connector to use these exceptionally performant models locally. Python docs: https://
python.langchain.com/docs/integrati
ons/providers/snowflake/#embedding-models
… Snowflake -
Community Builds Amazing Datasets with distilabel 1.0
By
–
Very excited to see all the amazing datasets the community builds and shares on the Hub using distilabel 1.0!
-
Creating a PCA Class Constructor with NumPy for Dimensionality Reduction
By
–
First Import numpy and define a class named "PCA" to encapsulate the operations. In the __init__ constructor let's initialize the number of components to reduce to, which is n_components, and similarly create placeholders for mean and eigenvectors.
-
Congratulations to Mistral AI team on their amazing release
By
–
Congratulations to all the @MistralAI team for their amazing work on this release!
n/n -
Mixtral 8x22B Instruct Model Released on Mistral Platform
By
–
Mixtral 8x22B Instruct is available on our platform, along with all our models: https://
console.mistral.ai The base and the instruct models are also both available for download on Hugging Face ! https://
huggingface.co/mistralai/Mixt
ral-8x22B-v0.1
… https://
huggingface.co/mistralai/Mixt
ral-8x22B-Instruct-v0.1
… 3/n -
Mixtral excels in science, code, and multilingual tasks
By
–
Mixtral particularly shines in science, code, and multilingual (below are performance results for the base model). 2/n
-
Mixtral 8x22B Instruct Released with Superior Performance
By
–
Mixtral 8x22B Instruct is out. It significantly outperforms existing open models, and only uses 39B active parameters (making it significantly faster than 70B models during inference). 1/n
-
Apache 2.0 Open Source AI Model Released Today
By
–
Official now, very proud of the team! Apache 2.0 and instructed versions for your pleasure, available today on la Plateforme
-
Microsoft invests in UAE AI as industry expands
By
–
Top stories in AI today: -Microsoft invests $1.5B in UAE AI firm
-AMD and Nvidia unveil new processors
-Access the best open-source LLM for free
-InstantMesh enables 3D generation in seconds
-6 new AI tools & 4 new AI jobs Read more: http://
therundown.ai/p/microsofts-u
ae-power-play
…