because the extra 'jerky' motion is the transfer. and another downside to that is that you'd have to do the 'sleight' with your other, non dominant hand.
See the third vanish in SD is a retention, therefore there is a justification for your hand to wave over your left hand, because from...