Thanks for sharing. Points a 1 and 2 are actually what motivated the work on TRM as mentioned in the paper. I think point 3 makes sense as this is a small, specialized model, not a large generalist model.
Point number 4 also makes sense, this has always been true for ML and DL.
TRM motivation and specialized model design considerations
By
–