Uranium: Is It Really As Dangerous As They Say It Is?

I regularly hear people talking about Uranium, and how dangerous it is. About how harmful it can be if it isn't handled correctly, and without the strictest of precautions being taken.

But, I think to myself, "it's only Uranium; just how dangerous...