Try and concentrate on a light touch, as Ace has said. Once you get that sort of touch into muscle memory, I think you'll be fine. If you're not doing it very slowly already, try doing it slower, that might help as well. But overall it sounds like you just need to get used to the sleight...