Add a "memory" of the interpolated UnevenlySignal (whole signal) when to which refer when segmenting