CODE

→ View original post on X — @jeande_d

Vision-Language Pre-training: Comprehensive Overview of Methods and Architectures

By

@jeande_d

–

07 August 2023 19h44

Vision-Language Pre-training(VLP): Basics, Recent Advances, and Future Trends This is one of the best and comprehensive resources that provides an overview of approaches(basic techniques, model architectures, tasks, benchmarks) used in vision-language pre-training. Just as

→ View original post on X — @predibase

Deploy and Fine-tune Open-Source LLMs with Ludwig AI

By

@predibase

–

07 August 2023 19h00

Want to learn how to deploy and #finetune open-source #LLMs on your own data the easy way? Join our hands-on webinar to learn about the latest release of open-source @ludwig_ai and how to build custom LLMs in just a few commands. Save your spot: https://
pbase.ai/3s1KiLy

Curriculum Learning Boosts Model Training From 2K to 8K Tokens

By

–

07 August 2023 18h16

To train this model, we use Curriculum Learning by gradually increasing the token lengths trained on from 2K to 8K. We additionally train on an instruction tune dataset sampled from various popular sources and curated in-house. (4/10)

Dataset Curation for Long Sequence Instruction Following

By

–

07 August 2023 18h16

To curate a dataset that encourages long sequence instruction following, we use two techniques. First we find tasks that truly benefit from longer sequences and add them to our instruction tuning datasets. (5/10)

Instruction List Technique Enhances Long Sequence Attention

By

–

07 August 2023 18h16

Second, we use a technique that we developed called instruction list that synthetically creates tasks that encourage more long sequence attention and instruction following. (6/10)

Sambanova SN-13B-8k-Instruct Model Now Available for Download

By

–

07 August 2023 18h16

This model is available for download on @huggingface for people to try: https://
huggingface.co/sambanovasyste
ms/SN-13B-8k-Instruct
… (2/10)

→ View original post on X — @rasbt

Installation and requirements setup for deep learning workshop

By

@rasbt

–

07 August 2023 18h15

Maybe this installation + requirements.txt from my recent DL workshop is useful here: https://
github.com/rasbt/scipy202
3-deeplearning/tree/main/00-2_python-libraries-for-workshop
…