I agree with you on not raising suspicion. For me the issue is that in my area a magician once performed magic for a large number of people exactly as you're describing (presenting it as a challenge) and hoped for social status. Unfortunately, he used a marked deck, made it obvious, got caught...