The best way to perform the pass is under some misdirection. If the audience is burning your hand, they will catch you 9 times out of 10. But if you misdirect them simply by meeting their eyes with yours, you can perform the pass and no one's the wiser. The position of your right hand might be the problem if you're still struggling. Pay attention to your right thumb; it should be right near the bottom left corner of the deck. And the pinky break is not a little flesh break, really get it into the break. Practice at every opportunity, and eventually you'll be doing it for the sheer fun of it.
I don't know if any of this will be useful to you but I just wanted to offer my advice anyway. Hope your pass has improved!