Crawler (253627)

I need a fast search engine crawler to crawl the web and find websites that fit the simple algorithym (I will assit the programmer with details) and store the --> web addresses <-- NOT CONTENT that fit the simple algorithym in a database or text file. The web crawler should have many threads and should be able to crawl many websites everyday. (When submitting your bid please specify the number of pages the crawler will do per day) I should also be able to specify if I want a specific page to be crawled. I need this ASAP so be specific in your bid times. Also, I will not pay until I am completely satisfied, every time I have prepaid I got ripped off. Be detailed in your bid or I will ignore it. --- DO NOT BID IF YOU CANNOT CREATE WHAT WE NEED --- ------ DO NOT BID IF WE HAVE PREVIOUSLY FIRED YOU ------ If you are good and can complete this project we will give you first chance on future projects. ## Deliverables Rent A Coder requirements notice: As originally posted, this bid request does not have complete details. Should a dispute arise and this project go into arbitration "as is", the contract's vagueness might cause it to be interpreted against you, even though you were acting in good-faith. So for your protection, if you are interested in this project, please work-out and document the requirements onsite. 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables): a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform What ever is best, can be webbased or a windows program.