Yeah I agree. When you replicate entire blocks of several layers, the input/output difference dramatically changes, which might degrade the quality of the final output. Replicating individual layers in a distributed way tries to address this issue.
Distributed Layer Replication Improves Neural Network Output Quality
By
–