Salesforce AI Releases CodeGen2.5 Model: https://
huggingface.co/Salesforce/cod
egen25-7B-multi
… The key contributions towards productization of these models are: Releasing CodeGen2.5 LLM with state-of-the-art on HumanEval for 7B parameters. CodeGen2.5 with 7B is on par with >15B code-generation models
OPEN SOURCE
-
Salesforce Releases CodeGen2.5 7B Model for Code Generation
By
–
-
Open Source Algorithm vs Trade Secrets Claims
By
–
Not sure what they include in "trade secrets", but last time I checked "the algorithm" was open source
-
nanoT5: Fast T5 Model Pretraining and Finetuning on Single GPU
By
–
nanoT5 – Fast & Simple repository for pretraining and finetuning T5-style models A code repository for pretraining and finetuning T5 LLMs(one of the earliest encoder-decoder models) under a limited budget. – Achieves 40.7 RougeL in 16 hrs on a single GPU(original T5 on Hugging
-
LangChain Updates Anthropic Client Wrapper for Latest Version
By
–
Updated Anthropic Client In the newest @langchain release (0.0.225) we've updated our @AnthropicAI wrapper to deal with their new 0.3.* client Should be seamless upgrade experience – just `pip install -U anthropic` and you'll be set! No more changes than that
-
Building Slack Bots with LangChain and Jina AI
By
–
awesome stuff showing how to build slack bots using langchain and @JinaAI_ !
-
Memory-Lowering Techniques for PyTorch Hardware Optimization
By
–
Depending on the hardware, and next to parameter-efficient finetuning, there are a bunch of memory-lowering techniques you can try. Summarized them here: https://
github.com/rasbt/pytorch-
memory-optim
… -
LLM Guidelines for Training, Finetuning, and Inference
By
–
I am not aware of a guideline, but it usually also depends on what you are after: (pre)training, finetuning, inference. We have a unified codebase for several LLMs you can try here: https://
github.com/Lightning-AI/l
it-gpt
… -
SDXL: Advanced Latent Diffusion Model for High-Resolution Image Synthesis
By
–
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis paper page: https://
huggingface.co/papers/2307.01
952
… present SDXL, a latent diffusion model for text-to-image synthesis. Compared to previous versions of Stable Diffusion, SDXL leverages a three times larger UNet -
Open-Source LLMs Match ChatGPT Performance in Text Annotation Tasks
By
–
Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text-Annotation Tasks paper page: https://
huggingface.co/papers/2307.02
179
… study examines the performance of open-source Large Language Models (LLMs) in text annotation tasks and compares it with proprietary -
Flacuna: Enhancing Vicuna Problem-Solving with FLAN Fine-Tuning
By
–
Flacuna: Unleashing the Problem Solving Power of Vicuna using FLAN Fine-Tuning paper page: https://
huggingface.co/papers/2307.02
053
… Recently, the release of INSTRUCTEVAL has provided valuable insights into the performance of large language models (LLMs) that utilize encoder-decoder or