BiPhone: Modeling Inter Language Phonetic Influences in Text paper page: https://
huggingface.co/papers/2307.03
322
… A large number of people are forced to use the Web in a language they have low literacy in due to technology asymmetries. Written text in the second language (L2) from such users
LLMS
-
BiPhone: Modeling Inter Language Phonetic Influences in Text
By
–
-
Teaching Arithmetic to Small Transformers
By
–
Teaching Arithmetic to Small Transformers paper page: https://
huggingface.co/papers/2307.03
381
… Large language models like GPT-4 exhibit emergent capabilities across general-purpose tasks, such as basic arithmetic, when trained on extensive text data, even though these tasks are not explicitly -
Computer Vision Newsletter #33: Artificial Intelligence and Deep Learning
By
–
Computer Vision Newsletter #33
https://bit.ly/3BImZrO #AI #MachineLearning #DeepLearning #LLMs #DataScience -
CS25: Transformers United – Stanford Machine Learning Course
By
–
CS25: Tranformers United! https://
stanford.io/466ZfLT #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Position Interpolation Extends RoPE Context Windows to 32K Tokens
By
–
Rotary positional embeddings (aka RoPE) have been a recent cornerstone of modern LLM implementations since it supports flexible sequence lengths. In this paper, researchers propose Position Interpolation to increase RoPE-based context window sizes to 32,768 tokens 2/3
-
Humble approach to long context lengths with minimal finetuning
By
–
This sounds a bit more humble than the recent 1M or 1B context lengths claims. But this requires only minimal (1000 steps) finetuning. And it allows long document summarization using LLaMA 7B and 65B models, for example. Link to the paper here: https://
arxiv.org/abs/2306.15595 3/3 -
Extending Transformer LLMs Context Window via Positional Interpolation
By
–
In the last couple of days, we talked a lot about extending the context window of transformer LLMs. Here's one more: "Extending Context Window of Large Language Models via Positional Interpolation" 1/3
-
Upload Model Weights to Hugging Face Community Hub
By
–
Please consider uploading the weights to http://
hf.co -
Open Source LLM App Ideas Community Showcase
By
–
We can't wait to see what you build with it. "Give me some ideas for apps that can be built with an open source LLM."
-
Impressive Open Source LLM Performance with Creative Poetry Generation
By
–
The results are very impressive. You can quickly see why it's the best performing open source LLM. "Write a poem about open source machine learning in the style of Byron."