I used to have a few problems with it until I came across a suggestion by Derren Brown I found in his "Three Card Routine".
Basically, you perform the rub-a-dub vanish, then just as you go to lift your hand you fidle about a little (and I mean a LITTLE), make it look like your palming the card...