The curious case of the inverted oscillator: On the dynamics and symmetries of quadratic potentials in the lowest Landau level