Raising audio level with mouse moves clip

When I want to raise the audio level on a clip, I put my mouse over it, see the little audio level indicator signifying that I'm over the audio VU level - click to raise it and OOPS, I moved my clip instead. This happens about half the time, resulting in repeated keystrokes, undoing, etc.

Is there a science to changing the volume level with a mouse that I'm missing?

Thanks!