Why shouldn't I verify someone's key by email?

If someone slipped a fake public key into your email, they can send a fake key verification the same way.

You could think that you're communicating privately with a friend or associate while all of your messages are being intercepted, read, and then forwarded to the destination.