For me, stuff on the internet is assumed false to start with, lol.^This. Every time i see someone on the internet claim they found single digit ES easy with their load my internal BS meter starts screaming. Getting single digit ES on a single 3 or 5 shot group doesn't make it a single digit ES load but that doesn't stop the internet claims. Single digit SD's is relatively uncommon too.
In the OP's case, at 500 yards i'm guessing a roughly 4" difference in elevation between the fastest and slowest speed clocked. If average is roughly in the middle you're talking 2" high or low from POA (less than a half MOA). That's a hit as long as other factors dont pull the bullet significantly further off course. I would be more worried about the Leupold CDS functioning correctly or the solution being accurate for the shot than I would that velocity spread inside 500 yards.