If you watch how Dan and Dave and others do it, you could learn how to ditch the card secretly. Usually, they rotate the deck end for end while ditching the card. This way is flourishy and serves as a distraction. Remember, the trick is over in the spectator's eyes, so you should let it sink in before you ditch the card.
Hope this helps.