PHP Script to Crawl Websites and Collect Information
Budget £20-250 GBP
I need a PHP expert developer to write a PHP script that crawls ".uk" websites and records the following information in a MySQL DB:
- the domain name
- all WHOIS records for this domain
- email addresses found on website
- phone numbers found on the website
- top 50 most common keywords used on the site
- timestamp of the crawl
The script must follow URLs to other ".UK" websites and consequently add them to the database for future crawling. The script needs to re-crawl domains which have not been crawled in the past 3 months (based on timestamp of the crawl). The script needs to have a seperate table where certain domains can be blacklisted from crawling.
*** With your bid please tell me which PHP libraries are you planning to use, and also show me an example of your recent PHP web-scrape/web-spider work. Bids without this information will be ignored.
Awarded to:
Hi friend,\r\n\r\nI already worked on very similar project, just for CA websites, project requirement was to be made in C#.\r\nFeel free to check my reviews for reference of my previous work, I did many similar tasks i More
50 freelancers are bidding on average £310 for this job
Hi, we have read all the requirements and we are very confident to do the project from start till end. can work as a developer for you please let me know when it is good time to discuss this and get started. We would More
Hello, and thanks for the opportunity to bid on your project. https://www.freelancer.com/u/TenStar718.html I am an expert in many different area’s of web and mobile applications based on the following languages: W More
Hi, We will develop the web crawling script for the collecting the information for the websites and we will handle all the feature development and develop all the crawling feature. Please PM me for private chat a More
I am really interested to do this job and get started right away. Can we discuss the project details? Payment after you're completely satisfied nothing advance .
This kind of project is our forte. Our team can definitely complete this for you. This project is pretty straight forward. I just have a few questions for you for discussion
Bid Summary Dear Client Good Day Wishes, Osiz Technologies We are solid Experience based on your Requirements I am Proudly said that we have a Web-based Development Platform. Project Requirements You are seeking fo More
Hello Sir, First of all, we would like to tell you how we will initialize the project with you. We insist to follow these steps before you award the project to us: - We (technical team) will review the job and More
Dear Sir I can do this job for you , I have expereince in web crawling and scraping using php I will use php simple html dom library and custom code to scrap the website Kindly contact me and we can discuss m More
Bid Summary You can also check my portfolio: https://www.freelancer.com/u/micheal4299.html I also have experience in working on similar projects. Let me know if you are interested in working with me. Thanks! Project R More
Hi, My Notion : "No Satisfaction, No Payment" We have expertise in Web Design & Development. Please check our client reviews to determine the quality of our work.: Lets discuss in detail and start now? i More
Dear Client , We gone through project description We are Really intrested to do work with you , We are Web & Software development company having more than 8 year experience in Software development we totally commit More
I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably More
