Well, it depends on how you say it. If you just kind of mumble it or say it in a way that makes you feel ashamed of it, then that's how people are gonna respond. But if you own it and say it like your proud of it, people are going to take that as an interesting fact about you or better yet, ask you to do something.
I used to have this problem. I was afraid to tell people that I was a magician, since when someone thinks of a magician, some stereotype of a loser in a tuxedo pulling bunnies out of a hat comes up. But the more experienced and confident in my abilities I got, the less ashamed I was to say it. Now, usually when I'm meeting someone new, and I want to break the ice, I just tell them I'm a magician and I blow their mind right there. So in short: It's all about your attitude and having the ability to back it up.
Also, I can tell you're new to the forums, but we don't respect the bashing of any magicians. So please don't hate on Criss, he's just a man trying to make a living doing what he loves. Many people actually love Criss Angel and find him to be one of the best magicians out there today. Some magicians need to realize that not everyone on the face of the earth hates him as much as they do. So let's cool it with the Criss hating.
To the part about people not wanting to see a trick, it might be you if 90% of people reject you. Which I'm not really going to get into right now but there's tons of forums where you can get advice, like
THIS one. One tip is to not say that you're going to do magic. Ask them for a minute of their time and ask if they want to see something cool. (But
PLEASE don't take the "David Blaine Approach" in which you act like a creeper, that might get you arrested)