Web scraping crawler

$50-100 CAD

Closed

Posted

over 3 years ago

$50-100 CAD

Paid on delivery

Build an aggregator which will periodically(e.g. once a day) aggregate the latest feeds/articles/posts from a few websites: Front end requirements 1. A simple form where we can input/edit/remove these sources. 2. See a list of all the aggregated content and edit/remove/flag as important any from the list Export requirements 1. Export a JSON with the fields mentioned below. This JSON should also be accessible directly through a URL. 2. Save/maintain any flags in the point 2 above 3. Sort them by date - newest articles first 4. Write the file to a google drive location text file (without replacing/ deleting the existing file as we need to maintain the unique document ID for this file). You can replace the entire contents while retaining the file. Fields Needed: • Source Name • Source Image • Title Text • Short Desc Text • Thumbnail (Hi-Res) • URL of original post • Flagged as important field (as mentioned above) • Date of Publishing • Any Copyright Information • Name of Author

Project ID: 27368682

About the project

20 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

20 freelancers are bidding on average $84 CAD for this job

@ZhangDa

Nice to meet you on freelancer. My name is Da Zhang. I am an experienced data scraper from China. Let's talk about your project. * You need a web based app, that will need a server to deploy the website. If you can accept a Windows or command line app, then you can run it on yourself computer. Could I know what operating system do you use? * If you use windows: we can use Python and C# language * If you use Mac or Linux, we can use Python. Could I know the websites you want to scrape? * How many websites in total to scrape? We can start with one website for trial. I can start immediately, let's talk! Thank you very much.

$100 CAD in 5 days

5.0

(52 reviews)

6.9

@schoudhary1553

Hi, Greetings! ✅checked your project details: Web scraping crawler ✅Completed Time: In project deadline We have worked on 600 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion.. Thank you Sandeep Digital screencast

$150 CAD in 4 days

5.0

(32 reviews)

6.5

@Stephenrajs

Hi there, I Have Scraped Amazon, Ali express, Yellow Pages, Yelp, Yellow Pages, Grainger, Boohoo, Etc. I am a python writer with 5 years of experience. I have worked on several similar projects. You can see an example of one of those projects in my portfolio here Please Check my mastery work at:- https://www.freelancer.in/u/Stephenrajs *Why you are choose me 1. 24/7 hours support 2. Quick response 3. Deliver on time 4. Smooth communication. I assure that I can satisfy you completely and want to have a long term relationship with you. Best Regards Stephenrajs

$100 CAD in 3 days

4.9

(126 reviews)

5.8

@shivansh121

Hi, I am ready here to start the work .I can scrap the data for you as you wrote in job post . I'll provide you best quality of work within required timeframe & budget . Let's start the work !!!

$97 CAD in 3 days

4.9

(25 reviews)

5.9

@smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related tasks

$50 CAD in 7 days

4.9

(103 reviews)

5.9

@kimhuo99

Hello I'm a good web scraping. I can do this. Thanks Best

$100 CAD in 2 days

5.0

(18 reviews)

5.1

@punitbajaj80

Hi, I am UIPath and Automation Anywhere Certified RPA Developer having experience of more than 2 years working with clients in development and consulting. I have also experience on PHP, JavaScript, Python, Machine Learning and many other technologies. I have worked on Orchestrator, PDF/Excel Data Extraction, Web Scrapping, Web/Desktop Automation, Mainframe Automation, Abby Flexicapture Inegration, OCR Engines Integrations, Salesforce Automation, Oracle Automation, Outlook Automation, Product Listing and many other project from Designing to Deployment. We can discuss further about your project.

$99 CAD in 3 days

5.0

(5 reviews)

4.2

@ayoubbouz

Hi sir, I will make you a scraper app with a form that graps all those information for you. I already did that so many times. Please turn your attention to my reviews. My deadline is your mind. I'm sure nobody knows more than me in web scraping I have 5 years' experience in python. Just checked your job requirement and I can convert your ideas into digital form. Ready to discuss details of the project (sites of feeds/articles/posts....) and budget in the chat.

$80 CAD in 2 days

4.7

(9 reviews)

4.1

@PKonstiantyn

Hello! Sir Very interesting in your project”Web scraping crawler” My name is konstiatyn who is professional in webscrapping. I have read your description and understand your idea I am specialized in webscrapping. I did so many scrapping with python selenium, beautiful soap and panda. I can get scrapping result as u want. I am sure I can offer good result and fast delivery because I have good experience in this field. I can show u my previous works if u want. Pls ping me to discuss in detail over chat. I wish u the best luck of in your business. Best regards

$100 CAD in 1 day

4.5

(5 reviews)

3.7

@kholmogorovadev

hello, I am web scrapping expert. I can do it very well. please let me know regards. Alexandra Kholmogorova

$90 CAD in 7 days

4.8

(2 reviews)

3.2

@arunramani

Hey Hi. Am expert in python scrapy framework. Am going to do this work because i need reviews. You can check out the portfolio for your reference. We will deliver hign quality work. Share me the website details. Hope you contact me soon. Thanks in advance.

$50 CAD in 1 day

5.0

(9 reviews)

3.1

@maks52andr

>>>>>>>>> There will be MIRACLE when you BELIEVE <<<<<<<<< Hello, My name is Maksim and Web Developer. I have read your details interestingly and I can do your project in short time. As you can see on my review, I am honest senior developer. I have many skills with React.js, React-Native, Next, Angular.js Vue.js, Nuxt and PHP frameworks like Laravel, CI and so on. Also Node/Express, Adonis, 3rd Party API integration.. I can start just now and work full time with good communication. Trust a MIRACLE. Thanks.

$100 CAD in 7 days

0.0

(0 reviews)

0.0

@milandjokic

Hello I have good experience with scraping. So i can do it you hope in short time Hope to see you!

$75 CAD in 7 days

0.0

(0 reviews)

0.0

@aliciit123

Hey i am professional back end and front end developer. I have a full team of full stack developers with experience of more than 5 years. I assure you that your work will be done without any complaints. Pay me when your work is done and you are happy with me.

$70 CAD in 7 days

0.0

(0 reviews)

0.0

@terdaleyogesh201

I will provide you excellent service with complete assurance and satisfaction. My motive is to make my employer happy with quality of service.I am expert in data scrapping, email marketing with great web search as well as having great research skills and tools. I am an expert in data processing. I will be providing full satisfactory results. I am ready to start now. I can provide sample to ensure you I have completely understand the project. Thank you.

$50 CAD in 3 days

0.0

(0 reviews)

0.0

@makolle

I have experience developing web scraping applications and desktop applications in Python. The skills I have from this fit the bill for the project description you have supplied and I am confident that after further discussion that I can start immediately and produce a deliverable to your specifications within 2-3 days.

$75 CAD in 2 days

0.0

(0 reviews)

0.0

@JasonRob

Hello! I can provide you full support for this project. I can provide you data up to 3 days. Feel free to contact me to provide me more information. thanks

$75 CAD in 7 days