I feel like this is kind of a big concept but I'll try to keep it concise.
Something I feel worth considering is where is YOUR attention focused? A basic of direction is where you look, they look.
In performance you are, for a time, basically taking the lead in a social interaction. Among other things, it's up to you to establish where 'home base' is for the eyes. Ever notice in conversation with others we tend to talk 'at' a point in space? This applies to magic as well.
Don't want to establish your hands as home base? Whatever prop you are working with, take it out, then immediately drop the hand with it to your side and start talking to them, making eye contact and the like. Tell a story, talk with your hands and direct their attention to points in space with your hands, working predominately in the level that you want their eyes to be. Things like this will start to establish subconsciously that the home base isn't down at your hand level but instead wherever it was you wanted it to be. On top of that, you are training them to follow where you direct your attention. You've established that you do most of they talking, they do most of the listening, you do the directing, they do the looking. All before you've done any magic so this pattern is established before any major suspicions could hope to arise.
That's not to say having your hands burned is always a bad thing. Watch
Tommy Wonder's Ambitious Card for a perfect example. You can see how he controls the attention. At one point you can see him basically coach them into burning the deck and being skeptical and he answers it perfectly. He performs it one way dispelling the possibility of him achieving the effect by a different method, only to use that exact method moments later.
If you can get your hands on Books of Wonder there is a ton of theory on audience management and performance to be had. You could tear every effect out of that book and it would still be worth it for the theory honestly.