Kenneth already mentioned this but I'm going to say it again, because I feel it's really important:
Everyone learns at different speeds. Don't compare your progress with other people's progress. When I started out I tended to do that a lot and it can be discouraging.
When it comes to fine motor skills like sleight of hand there is some programming of the brain that has to happen. You are literally creating new connections and synapses in the brain tissue. The more you use those skills, the fatter the pathways in the brain become. That can't happen over night.
Also - you're starting later in life than many of the people you'll talk to on the forums and such. Don't worry about it. I started when I was in my late 20s. 28 maybe? I forget now. I think it actually helps - when someone gets into magic as a kid, they often use magic as a replacement for a personality. So every conversation is "Want to see a magic trick?" Whereas if you start later in life you tend to already have a developed personality, and a variety of life experiences you can use to build presentations around. Wayne Houchin (who was a consultant for Criss Angel) says in his lecture that his magic didn't get really good until he stopped obsessing over magic and did other things.
And it's always good to have inspiration, so here's someone you may be interested in checking out:
http://www.smokeandmagic.com/