There is no direct control at the moment, it's luck of the generation. However I expect the community to build on this model, loras for camera movements are already a thing for AnimateDiff.
AnimateDiff Community Develops Camera Movement Control LoRAs
By
–