Build Webscraper/Crawler for multiple Websites

Closed Posted 7 years ago Paid on delivery
Closed

I am looking for a smart developer who can develop a simple webscraper. Websites are mostly simple HTML Websites without JS Frameworks.

Websites are construction equipment websites like [login to view URL] , [login to view URL] . The aim is to get all machinery data including name, category, technical specifications, images, texts and the like and save them in a structured file in CSV & JSON. The data might need some processing before saving it.

We will go through a prepared list of websites, discuss them, define the expected time and crawl each of them step by step.

I expect full cooperation, flexibility, good english and experience in crawling websites.

Knowledge of German is a plus.

Engineering HTML5 Software Architecture Web Scraping

Project ID: #10900524

About the project

43 proposals Remote project Active 7 years ago

43 freelancers are bidding on average €10/hour for this job

webbookstudio

Hello, my name is Olya. I got acquainted with Your description of the task, ready to build Your webscraper for the multiple websites as soon as You need. However, I shall discuss about the requirements and functionali More

€10 EUR / hour
(21 Reviews)
7.2
phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

€10 EUR / hour
(79 Reviews)
7.3
vpnsolution

I will definitely help you in this project because my main objective is to provide excellent service with timely, accurate, and professional results. I look forward to know more about this project. Thank you.

€11 EUR / hour
(44 Reviews)
7.2
nekhbet

Hi, I have a vast experience in building scrapers and in PHP. I know that you wrote the budget of 6-12e/h but you must consider that what a junior does in 4-5h a senior developer can do in much less time. If you More

€20 EUR / hour
(218 Reviews)
6.8
nextolive

Hello, My name is Aftab Anwar I have read description of your project and am ready to work with you. We can discuss price and I will give you more accurate estimates once I have more info about wha More

€10 EUR / hour
(10 Reviews)
6.5
rofreelance

Hello, I am a software and database developer and I specialize in web scraping. I have 5 years experience win web scraping of various stores, car dealers, companies etc. My proposal is this: A windows application wr More

€11 EUR / hour
(33 Reviews)
5.8
mobileappdevin

We have a good amount of experience in web scraping using Python,Django and nodejs. This is our latest project on web scraping using python: Scraping using Python: Electronics Parts Intelligence Processing ePr More

€10 EUR / hour
(11 Reviews)
6.0
Shopify

I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably More

€9 EUR / hour
(6 Reviews)
5.8
ruipimentel

Hello, My name is Rui Pimentel, more recently known for developing crawlers for netflix, nike, supremenewyork and so many other trendy websites. With more than 8years of experience in development of web crawling and a More

€9 EUR / hour
(43 Reviews)
6.1
contactvidura

Hi, Ready for the task. Please see my reviews and previous projects. Can we discuss the details further? Waiting for your reply!

€10 EUR / hour
(142 Reviews)
5.5
xaerozero

Hello, i can offer application(s) written in Java, that runs on any platform (win, linux, osx). Application may feature classic console output for preview parsed data or web based platform. Application may integrate mu More

€10 EUR / hour
(16 Reviews)
5.4
sharmin283

Hello, i am very interested to do your project. i can Build that Webscraper/Crawler for multiple Websites properly. I am a hard working, motivated worker, who have great custom web applicaiton making skills. I k More

€10 EUR / hour
(16 Reviews)
5.1
pks11

hi i have expertize in writing scripts for any type of scrapping -----_-------------

€6 EUR / hour
(27 Reviews)
5.1
kunashe

Hi! I would be happy to extract the data for you. May you please let me know if you would like sample output. Regards, Regards, Ku

€10 EUR / hour
(20 Reviews)
4.6
lexcode

can i have few websites sample URL and which block of HTML you want to scrape? Do we need to save images within the HTML block? what processing is needed for data before saving?

€15 EUR / hour
(7 Reviews)
4.7
DevoirTechsoft

Hello, We are best for this job requirement because we have done similar project before. If needed we can show you a small demo which is ready with us. We will provide you dynamic real time scrapper that will ex More

€6 EUR / hour
(12 Reviews)
4.0
weaker87

Hi! I have 9 years expirience in web development and scraping. Contact me on private message for more info!

€13 EUR / hour
(3 Reviews)
3.7
bestgr

Hello, my name is Nick. I am a professional software developer for over 6 years. I can do this job quickly and efficiently. I have done lots of similar jobs in the past. I have done scraping jobs for more than 50 w More

€11 EUR / hour
(5 Reviews)
3.7
dimuthufr

Dear Sir I have experienced in web application development using ajax, php And mysql . and also have a experience with android application development With java and standalone app development in java. I take grea More

€10 EUR / hour
(12 Reviews)
3.5
milanmartinjuk

Hi, Your project sounds very interesting and simple enough and I believe that I'll be able to perform the task perfectly. I have over 15 years of experience as Physics and Math teacher; but, I've also done some V More

€8 EUR / hour
(4 Reviews)
3.3