Pretty much all major CV generative models use skip connections and also modify channel counts over layers
@jeremyphoward
-
Skip Connections Research and Computer Vision Architecture Alternatives
By
–
You gonna pretend there isn’t research suggesting skip connections aren’t needed, and that anyway there’s dozens of ways in CV of dealing with that issue?
-
Computer Vision Learnings Transfer to Other AI Domains
By
–
Yeah it’s another place where it seems likely some learnings from CV will cross over some day
-
Fine-tuning LoRA with Adafactor and activation checkpointing
By
–
Even fine tuning regular lora with adafactor would do for now though. With activation checkpointing that’ll handle a reasonable size model
-
QLoRA Fine-Tuning for Single Box Decoder Applications
By
–
I think you really need a single box decoder only fine tuning task, since that’s a really common application. E.g qlora fine tune mistral on flan v2
-
OpenAI Generates Cricket World Cup Final Image Recognition
By
–
Thank you @OpenAI for creating the image that captured the cricket World Cup final perfectly. But maybe don’t tell Satya.
-
OpenAI criticized for enabling offensive content targeting Indian cricket fans
By
–
thank you openai for making it so easy to take the piss at a billion cricket-mad indians
-
OpenAI Governance and Leadership: Complexity Beyond Individual Capability
By
–
Not at all – I am a sama fan! (Well, I don't know him personally, but he seems amazing.) I just think governance is complex, and that he didn't seem the best person to deliver on OpenAI's charter.
-
OpenAI’s Chartered Mission Sparks Debate Among Enthusiasts
By
–
I dunno either – I just know it's OpenAI's chartered mission. Some people are really into it.