Tempo changes affect vibrato frequency

I’ve run into this problem lately, where every time I add a tempo change, the speed of the vibrato changes to match the new tempo. So if I set the vibrato of a note to a specific frequency, and then add a tempo change in the middle of the note, it will make the vibrato frequency increase or decrease, depending on what the new bpm is. Does anyone know if there’s a way to fix this?

I expect you could work around this by splitting the note at the point of the tempo change, then adjusting phoneme and vibrato timings to match up properly.