Jeffro2pt0 has put together a great article on how to install WordPress on your own PC. Since WordPress is PHP / SQL driven, you either need to have your blog on the wordpress.com servers, limiting your total control over the blog or detailed editing - or - have your own server.
With the software Jeff will guide you through, you no longer need either. Just have a PC on 24/7 with some nice firewall action.