Hey!
Almost everyone goes through a similar phase at one point or another. It's a natural human reaction specially since no one likes to fail and everyone likes to impress. So here are a few things I can think of that you might find helpful.
First of all it's important to understand that you are going to make mistakes at some point eventually. Even the best performers sometimes mess up and that is no the end of the world. I once messed a trick up on stage and I just jokingly shook it off. It's not a good feeling, but it happens.
Another thing to keep in mind is that the laypeople do not know anything about what you are about to do. They do not know what you know and don't even know those moves or sleights even exist. So psychologically, in order to recreate a sense of being control, they pay attention to what they know, which is directly controlled by what you pay attention to or appear to pay attention to. If you look in their eyes they look back into yours. If you nervously keep looking at your hands, they will look at your hands.
When it comes to doing the pass or other similar control moves, those moves rely on misdirection and cover. A pass is not invisible despite the fact it's called that sometimes. It's up to you to make it appear as though it is invisible.
And finally, the best way to overcome your fear is by performing for strangers. Go to a bar with your mates for a couple of pints and then approach people and offer to show them some tricks. With strangers you are immune from their judgment because even you fail, they do not know you and their judgment is not gonna affect you in anyway whatsoever. Whether they end up thinking you are the best magician or the worst, it does not matter either way. It's also a good way of practicing your presentation and stage presence.
Anyways, keep up the good work mate and just magic away!