If you are really bummed about the situation, then you need to play it better. I perform for different people every weekend at the restaurant where I work, so I can't remember everyone, but I'm known as "the balloon guy" or the "magic guy." Which is fine, because that way they know who I am, and they call me over and I get some business going. If it's at school or something though, your friends should know you first as who you are, rather than what you do. If all your friends care about is you doing magic, they aren't really your friends. My friends rarely see me do magic, because it's not all that I am. If "girl" in your situation is someone you have a crush on, then you need to get to know her more, then introduce magic. Better yet, find someone else, and don't perform for them until after a while, and even then make it something quick and not a huge deal.
It depends on the situation, if you should be happy about it or not.