If you touch the zoomed in image with 5 fingers at once, there is chance that the image slips out of bounds.
I fixed this by checking the number of touches more explicit in onTouchStart() and onTouchMove().