UIPanGestureRecognizer doesn't work if UIImageView scales too much on iOS

I have a UIImageView which has various gestures added like UIPanGestureRecognizer, UIPinchGestureRecognizer, UIRotationGestureRecognizer, etc.

It usually works fine, but when the view is scaled with CGAffineTransformScale, the UIImageView stops responding to the pan gesture beyond the limit. However, pinch and rotation will work. If the reduced size UIImageView is smaller, the UIPanGesture will start working again.

Help if anyone noticed this behavior in iOS.