Consider the following example:
#import "@preview/mitex:0.2.6": *
#mitex(`$\frac{|S_{xy}(\omega)|^2}{S_{xx}(\omega) S_{yy}(\omega)} $`)
#mitex(`$\frac{\left|S_{xy}(\omega)\right|^2}{S_{xx}(\omega) S_{yy}(\omega)} $`)
$ (|S_(x y)(omega)|^2) / (S_(x x)(omega) S_(y y)(omega)) $
which gives:

Is that possible for mitex to fix this without adding \left\right to be a must?