I'm going to go out on a limb here and disagree. Magic doesn't need patter. Teller is a renowned magician, yet he doesn't speak. To make it more personal, I'm currently living in a with about 8 students, none of whom speak english as a first language and most of them only speak broken english. I've done magic for them, and rather than try and simplify my patter, I performed without. Reactions were still excellent.
In fact, if your patter sucks, it can detract substantially from your magic. It can add complexity where it shouldn't exist.
Granted, I realize patter is important and can contribute an enormous amount to magic. I just wouldn't go so far to say it is completely necessary.