Personally, I put more polish on the magic when I'm performing to anybody who aren't my sounding boards, so to speak. In most cases, women react better to magic, and aren't watching you as closely as the men are. However, that doesn't mean you should relax any on doing your absolute best to perform your sleights and effects flawlessly. A male audience tends to be more rowdy, rude, and reacts quieter. Female audiences tend to have the biggest reactions, are calmer, and much more polite to perform to. There are exceptions in each case of course, but when performing I don't separate the two genders, except in effects specifically orientated towards a female if you are a male magician or vice versa. Just look at men and women the same, and only worry about their mood. If the spectator is in a bad mood, they are less likely to be open to your magic, and will probably watch you very closely. If the spectator is in a good mood, they will be more easy going, and open to the effects. In short, as long as you perform the effects as best as you can, there is nothing to worry about. As long as the spectator enjoys seeing magic, or is open to it, everything will go well. As far as confidence when performing, as long as you can do the effects without messing up, and have tested the effect(s) before and they work every time, it doesn't matter what gender a person happens to be.