Preferences - Audio - Uncheck Enable Time-Stretching audio

I did need to restart VLC for that to take effect. This is VLC 1.x (whatever the latest in the Ubuntu repos is). I suspect the option is still available in VLC 2.