[quote=@Host] It's probably C++. I could have written a similar crawler, but this is much more refined with better and more advanced options. It's HTTracker, which has already logged 1500 pages after 35 minutes. It seems like telling it to ignore robots.txt fixed all the issues I was having. If it doesn't work, it's just a matter of fine-tuning the settings. However, the pages it has already saved tell me that it is working correctly. I kept unofficial track. [/quote] Nice. Yeah but we go by account there's no way. It's mostly because you had 7/8 of the accounts. :/