About the accuracy of Endless Encoders

I am using an Autaria Beatstep and in the process of building a Sampler / DrumComputer of sorts.

So my plan is to switch / choose Samples with an Endless Encoder which I manage to do.

Unfortunately if I have 128 Samples ready in Ableton and turn the Endles Encoder by one “click” I donst get just one digit but several.

So if I want to switch from Sample 3 to Sample 4 it will jump from 3 to 5 or 6
This is frustrating because I can not accurately select sounds I pre chose.

I get that I could use buttons / pads to try and do this (not knowing if that is any better) but what I wanted to discuss here is:

What is your experience here?
Is it a hardware / Firmware problem a.k.a is the Beast Step shite, others more accurate?
Is my Beatstep broken (yes I did try it with other Endless Encoders on the Beat Step – same result)
Am I expecting too much or is my approach unrealistic / wrong?

Let me know what u think and use!

Thanks!