No that I am aware (but I also haven't looked too deeply). I would probably use the original ViT in Torchvision as a baseline: https://
pytorch.org/vision/main/_m
odules/torchvision/models/vision_transformer.html#vit_b_16
… I have a companion article here showing how to accelerate the training on that model:
MACHINE LEARNING
-
Using PyTorch Vision ViT as Baseline for Model Training
By
–
-
Open-Source Model Fine-tuning Methods and Training Flexibility
By
–
Yes, any finetuning method is allowed, afaik. Technically, you could also just further (pre)train the model. Anything that runs <24 h on open source code and openly available data.
-
GPT-4 Details Leaked: Mixture of Experts Architecture Rumored
By
–
r/LocalLLaMA – GPT-4 details leaked https://
bit.ly/3pYYJzj
GPT4 rumored to be a mixture of experts!
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Robot Motions as Language: Transformer Architecture for Action Understanding
By
–
Interesting idea: treat sequences of robot motions as sequences of words with a similar transformer architecture to link language, vision, and action.
-
Publishing ML Research: JMLR Review Process for Top Conferences
By
–
You first need to publish the work at JMLR, by following their review process. Once the paper is officially published by JMLR, then you can request to present your JMLR paper at either NeurIPS, ICLR or ICML
-
Three Key Takeaways for Developing Your AI Strategy
By
–
3 Takeaways to Guide Your AI Strategy
#AI #AIio #BigData #ML #NLU #Futureofwork @gp_pulipaka @stratorob @PetiotEric @EvanKirstel @Fgraillot @HaroldSinnott @HeinzVHoenen @helene_wpli http://
ow.ly/cAMZ30swnpQ -
RT-2 Robotics Transformer: Vision and Language to Action Model
By
–
RT-2 relevant links: Project page: https://
robotics-transformer2.github.io
Paper: https://
robotics-transformer2.github.io/assets/rt2.pdf
Blog: https://
deepmind.com/blog/rt-2-new-
model-translates-vision-and-language-into-action
… Other links:
RT-1: https://
robotics-transformer1.github.io
PaLI-X(direct scale up of PaLI): https://
arxiv.org/abs/2305.18565
PaLM-E: https://
arxiv.org/abs/2303.03378 Work from Google -
Using AI Models for Comparative Analysis: Tools and Platforms
By
–
Anyone know of a way to use an AI model to compare apples and oranges?(Metaphorically.) I’ve got a few idea for comparing/contrasting some stuff, but not sure which platforms/tools/etc might be helpful or even feasible.
-
RT-2: Vision-Language-Action Models for Robotic Control
By
–
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control RT-2(Robotic Transformer 2) is a new model in family of vision-language action models(VLAs). RT-2 builds up on RT-1 and vision-language models(VLMs). RT-2 makes use of pre-trained VLMs and is
-
Generative AI Improves Personalized Healthcare With Wearable Devices
By
–
How Generative AI Can Improve Personalized Healthcare With Wearable Devices
#AI #AIio #BigData #ML #NLU #Futureofwork @TopCyberNews @SpirosMargaris @MarshaCollier @MHiesboeck
@MHcommunicate @Fisher85M @MikeQuindazzi @NealSchaffer
http://
ow.ly/AyJ930swnpP