`accelerate test` works with the default config… But the script above hangs for 10 minutes likely due to the NCCL timeout. Somewhere between these two log lines: INFO [core(.)py:74] Initializing a V1 LLM engine (v0.10.1.1) with config: model='unsloth/Qwen3-4B-Base'
INFO
NCCL Timeout Issue with Qwen3 LLM Engine Initialization
By
–