Here's @MosaicML showcasing their results with @PyTorch 2.0 + AMD for LLM Training.
They made "Zero Code Changes" to run on AMD.
MI250 is already trending well, and IMO MI300X will be very competitive.

→ View original post on X — @soumithchintala,