How to Defeat Bad Web Robots With Apache is a very thorough explanation of how to block bots that do not honour your robots.txt file. I like thi s quote:
Several people have tried accessing /robots.txt on this server after reading this page. If you do, you will be automatically and instantly blocked from reading any pages on this site. Don't risk it!!! Try these methods on your own server, if you need convincing.