Why we built SlimPajama – it's all about training efficiency. Without de-duplication, a model would have to go through 1.2T tokens before seeing ~600B unique tokens. SlimPajama sees 600B tokens in half the time. That saves you 50% on compute costs! https://
cerebras.net/blog/slimpajam
a-a-627b-token-cleaned-and-deduplicated-version-of-redpajama
…
RESEARCH
-
SlimPajama Reduces AI Training Compute Costs by 50 Percent
By
–
-
I-JEPA Delivers Strong Computer Vision Performance with Efficiency
By
–
The approach taken with I-JEPA delivers strong performance across a number of computer vision tasks and does so with greater computational efficiency compared to other widely used computer vision models.
-
Open-Sourcing Research Work for CVPR 2023 Conference
By
–
In support of open science and the research community, we're open-sourcing this work — and we'll be presenting it at #CVPR2023 next week. Training code and model checkpoints
-
I-JEPA: Self-Supervised Computer Vision Learning Through Prediction
By
–
Today we're releasing our work on I-JEPA — self-supervised computer vision that learns to understand the world by predicting it. It's the first model based on a component of @ylecun
's vision to make AI systems learn and reason like animals and humans. Details -
FastChat-T5 Encoder-Decoder Model Performs Well on Chatbot Arena
By
–
Yeah but fastchat-t5 ranking decently for it's size on chatbot arena is a pretty good evidence of encoder decoder models being able to actually chat well.
-
Five Amazing Ways Meta Uses Generative AI Technology
By
–
5 Amazing Ways Meta (Facebook) Is Using Generative AI
#AI #AIio #BigData #ML #NLU #Futureofwork @TunstallAsc @StrategyFintech @TamaraMcCleary @TerenceLeungSF @psb_dc @thomaspower @vinod1975 @ylecun http://
ow.ly/RUN730svHSY -
IoU Loss Functions for Object Detection: GIoU, DIoU, CIoU
By
–
🚀Blog-tastic Tuesdays🚀
— Satya Mallick (@LearnOpenCV) 13 juin 2023
Dive into the world of object detection with #DeepLearning!https://t.co/egztROZxfW
Check out our latest read as we break down the IoU Loss Functions (GIoU, DIoU, CIoU)#AI #MachineLearning pic.twitter.com/AcwvIf33QwBlog-tastic Tuesdays Dive into the world of object detection with #DeepLearning! https://
learnopencv.com/iou-loss-funct
ions-object-detection/
… Check out our latest read as we break down the IoU Loss Functions (GIoU, DIoU, CIoU) #AI #MachineLearning -
Hugging Face Papers Platform Revamped with Upvote Feature
By
–
revamped https://t.co/4n2b8GGk0k is live!
— AK (@_akhaliq) 13 juin 2023
check out the daily papers feed on @huggingface
now with a upvote feature
each paper has a dedicated paper page linking cited models, datasets and spaces pic.twitter.com/zQr9CVI8tjrevamped https://
huggingface.co/papers is live! check out the daily papers feed on @huggingface now with a upvote feature each paper has a dedicated paper page linking cited models, datasets and spaces -
Generative Adversarial Neural Networks in Deep Learning
By
–
#DeepLearning Generative Adversarial Neural Networks #AILabPage #VinsLens @KirkDBorne @SwissCognitive @alvinfoo @mclynd @SpirosMargaris @ipfconline1 @Fabriziobustama @FrRonconi @enricomolinari @ingliguori @schmarzo @asokan_telecom @SBUCloud @terence_mills
-
ChatGPT Impact on Research Integrity and Academic Culture
By
–
Very true! #chatgpt Sir Bashir M. Al-Hashimi بشير CBE FREng FRS (@hashimi_bashir) A lot is being written about ChatGPT and like impact on education, less so on the impact of such technology on research integrity/culture. Such technology accelerates the production of literature reviews, what about the production of unfounded research results? Views pls? — https://nitter.net/hashimi_bashir/status/1667974283878969347#m
→ View original post on X — @lailafaridoon, 2023-06-13 13:54 UTC