That's true, but you still have positional embeddings, and Q and K weights that are learned
CODE
-
Fine-tuning RoBERTa for Sentiment Classification to 95% Accuracy
By
–
Then, you can boost that performance (on the same movie review sentiment classification dataset) to ~95% finetuning model = AutoModelForSequenceClassification.from_pretrained( "siebert/sentiment-roberta-large-english", num_labels=2)
-

Ditching Word2Vec for Superior LLM Embeddings in Classification
By
–
I would ditch Word2Vec; the embeddings learned by LLMs are much better. For sentiment classification, you can start with DistilBERT as a base model and tune a few layers (see https://
magazine.sebastianraschka.com/p/finetuning-l
arge-language-models
…) 1/2 -

Probabilistic Machine Learning: Comprehensive Guide to Generative AI
By
–
Probabilistic #MachineLearning #GenerativeAI #AI @Khulood_Almani @Analytics_699 @GlenGilmore @MargaretSiegien @sallyeaves @baski_LA @ChuckDBrooks @HakomTimeSeries @labordeolivier @BetaMoroney @SabineVdL @KanezaDiane @MaiaGabunia @amalmerzouk https://
probml.github.io/pml-book/book2
.html?s=09
… -

Engineering Guide to Data Quality from Data Contract Perspective
By
–
An Engineering Guide to Data Quality – A Data Contract Perspective – Part 2 https://
bit.ly/45fL1YE -
OpenAI Chat Interpreter Impact on Coding and Conversation
By
–
EMERGENCY LATENT SPACE SATURDAY 12PM PT https://
x.com/i/spaces/1yoKM
ZWaRAdGQ
… @simonw
, @altryne
, @FanaHOVA
, @swyx Join us to talk how @OpenAI chat interpreter changes coding -and- chat, forever. -
Azure CLI Combines AI with Interactive Mode for Better User Experience
By
–
The Azure CLI team combined AI with CLI interactive mode (az interactive) to provide users with an intelligent interactive experience.
— Mark Tabladillo (@MarkTabNet) 7 juillet 2023
AI-based CLI interactive mode https://t.co/KlshbWZfNt pic.twitter.com/uLudzsucyfThe Azure CLI team combined AI with CLI interactive mode (az interactive) to provide users with an intelligent interactive experience. AI-based CLI interactive mode https://
bit.ly/3JKAMSO -

Safetensors Audited as Safe, Becoming Default Format
By
–
Safetensors audited as really safe and becoming the default https://
bit.ly/466YaDP #AI #MachineLearning #DeepLearning #LLMs #DataScience -
CodeVQA: Python Code Framework for Visual Question Answering
By
–
Introducing CodeVQA, a framework that generates Python code, paired with simple visual functions, to enable image processing for few-shot visual question answering. Learn how CodeVQA performs multi-step visual reasoning and outperforms prior work → https://t.co/LQaZikRShe pic.twitter.com/1qcPWmkq1V
— Google AI (@GoogleAI) 7 juillet 2023Introducing CodeVQA, a framework that generates Python code, paired with simple visual functions, to enable image processing for few-shot visual question answering. Learn how CodeVQA performs multi-step visual reasoning and outperforms prior work → https://
goo.gle/46w6Zam