Very cool to see HuggingChat and as a result dozens of open-source models (example below with Command R+ by @CohereForAI
) make their way into @firefox
! This is not in-browser (yet) but would be super exciting to make sure no data is sent to servers: https://
blog.nightly.mozilla.org/2024/06/24/exp
erimenting-with-ai-services-in-nightly/
…
OPEN SOURCE
-
Open-source AI models integrated into Firefox browser
By
–
-
Run Stable Diffusion 3 on Your MacBook: Complete Guide
By
–
Did you know you can run Stable Diffusion 3 on your own Macbook? Models expert @zsakib_ gives the full walkthrough on the Replicate blog
-
PyTorch Documentary Live Stream with Hugging Face
By
–
PyTorch Documentary live stream!! https://
youtube.com/live/EjgTv6aSe
qk
… Much better than Euro soccer IMO with some @huggingface @PyTorch inside -
Install Clarifai Python SDK and Llama-index Setup Guide
By
–
Step 1: Install the Clarifai Python SDK, Llama-index, and set your Clarifai Personal Access Token as an environment variable. Sign up for the platform, and you can access the PAT here: https://
clarifai.com/settings/secur
ity
… -
Build RAG System in 4 Lines Using Clarifai SDK
By
–
You can build a RAG system with just 4 lines of code using @clarifai Python SDK. Below is the entire code. Let's look at it step by step:
-
Open Source Definitions and AI: Critical Issues for UK Future
By
–
Important piece from @AmandaBrockUK on the issues around open source, the importance of definitions, history, emerging issues around AI. Vital for the future of the UK that we get this right. Thank you Amanda and @openuk_uk for leading on this.
-
Choosing Open Source LLMs: Ollama and LM Studio Integration
By
–
Which LLM/model? Can I choose from any opensource models? Does this use Ollama or LM Studio for OpenAI compatible API at the backend?
-
llm.c Memory Efficiency Advantages Over PyTorch
By
–
If you match the parameters you're actually under-estimating the improvement, because llm.c takes up a lot less space so you can crank up the batch size. I haven't fully dug into why PyTorch takes up that much space, slightly worried I'm doing something wrong but not sure what
-
MLX Framework as Optimized Alternative to PyTorch MPS
By
–
I'd have a look at MLX, cc @awnihannun , from some recent chatter I understand it is a lot more optimized that PyTorch mps atm. This would need a re-write of the build-nanogpt code into mlx, but possibly it's not that involved. I'd be happy to accept a PR for mlx clone.