Investigate why moving view transformations broke rendering on Chrome

[alice-i-cecile]

I mean I guess we can revert it. But uhh, why does this occur? Can we send some shaders to the dawn team?

Originally posted by @JMS55 in #21202 (review)

This was added in #20313 and was generally a good change. I have no idea why this broke.