First off, don't watch the movies, read the books. Anything you take from the movies is susceptible to being mere fabrication and entirely false.
That being said, there are still muggles, and wizards are the "elite" compared to them, but your point is still a good one. Wizards largely shut themselves off from muggles while Jedi's interact with non-Jedi's all the time.
Dumbledore wanted to be killed by Snape...that was the plan and supposed to happen.
Jedi's are indeed different, but all you really get out of that is a constant power trip over the non-Jedi's. Wizards are, for all intents and purposes, more powerful than Jedi's. There is nothing a Jedi can do, besides perhaps having superior reflexes, that a wizard can't.
That said, I don't know which I'd choose. Jedi's are more badass, but wizards are more powerful.