I have a database of approx 40 million books. I need an app to run on my server that will scrape multiple sites weekly to keep the database updated.
26 freelancers are bidding on average $485 for this job
Dear client. I am very well experienced in scraping books from websites with PYTHON. Please share more details about your job, I am sure I will provide the best result for you. Regards.
Hi, Can you ping me the website from which you need to scrape the book titles and other information? I can then create a sample/ demo scraper for you quickly using PHP Curl and MySQL database on your server. Thanks!
Hi I can create a webservice scraping several websites and keep your DB updated. Scrapers are written in python, using cURL& LXML. Using 10k+ socks proxy All the best Ihsan
Could you share more details about the sites from where you want the information scraped? Do you have API access to any of these book sellers since there are so many books that need to be looked up? Thanks.
Hello, I have an extensive experience in python and webscraping. The project requirement can be met using Python flask, database you prefer, webscraping using Beautiful Soup. Looking forward to hear it from you.