The wizards represent all that the true 'muggle' most fears: They are plainly outcasts and comfortable with being so. Nothing is more unnerving to the truly conventional than the unashamed misfit!
You will always be a monster - there is no turning back from it. But what kind of monster you become is entirely up to you.