Hi uba74
Sweeping helps the stone travel farther and straighter. 
Yes, it does make a difference how fast or slow you sweep.
Faster sweeping has a greater effect than slow sweeping.

Best regards,
John