Build Scraper with API calls and reporting

Completed Posted Jul 29, 2014 Paid on delivery
Completed Paid on delivery

I need to create a basic interface with this functionality:

1. I submit a list of keywords I want to target.

2. The program will do the following:

a) Scrape list of domains from:

[url removed, login to view] and three other sources of domains.

b) Remove dupes.

c) Check domains with this API. [url removed, login to view] and save data such as # of unique C-class IP backlinks and TrustFlow if the Trustflow is over X or if the unique C-class IP backlinks are over X.

d ) Send a daily report by email with the following criteria:

1. Domains that match a certain keyword selection (and the above qualifiers). For example, "domain contains the work 'fat'" and has a trustflow over X or more than X unique c-class backlinks.

OR

2. Domains have have more than X+50 unique c-class IP backlinks and a Trust Flow greater than X+15. (not necessarily a keyword match)

e) Provide a log of all the domains that meet the criteria selected.

Perl Python Ruby Web Scraping

Project ID: #6250629

About the project

21 proposals Remote project Active Aug 7, 2014

Awarded to:

e3d

Hello, I'm an expert in web scraping & have alot of experience working with domains metainfo from various sources like whois, etc. Please tell me what will be "three other sources of domains", as this will affect my More

$750 USD in 20 days
(190 Reviews)
8.5

21 freelancers are bidding on average $982 for this job

freelance4hire80

hi, I can develop the custom scraper for you, with basic interface supported. I'll use Perl, and Tk for the interface ## revived bid after receiving more detail info from client #

$833 USD in 7 days
(68 Reviews)
6.8
chvictor05

Dear, potential employer. Perl/Web professionals here. Pl;ease, accept this bid to assure that your task will be done reasonably fast with the best professional quality. Looking forward for update from you;

$777 USD in 5 days
(34 Reviews)
5.9
rinsadsl

Hi Good Day I am quite interested on this project. I have worked with scrapping, API integration etc. Spend a minute to have a glance on my profile. Looking forward to work on this project. Thanks Rinsad

$789 USD in 10 days
(37 Reviews)
5.7
anuyadav1

I can write this program. More

$888 USD in 10 days
(62 Reviews)
6.0
exansoft

Hello I am interested in your project. Please kindly provide more details related to project requirements. I have expirience with Majestic SEO API. I prefer Python 2.7 Thank you. Regards.

$1600 USD in 25 days
(7 Reviews)
4.5
sashamd

Hi, I would like to build this scraper using Ruby or PHP. Please contact me if you have any questions. Best wishes, Sasha

$750 USD in 10 days
(3 Reviews)
3.6
aakbar81

A proposal has not yet been provided

$1250 USD in 20 days
(5 Reviews)
3.2
fabiomenza

Hi, I can build the script you need. I've seen you have many bids for this project but if you are interested in me we can talk more about the work need to be done. Kindly regards, Fabio

$750 USD in 20 days
(1 Review)
2.0
phzonta

hello, I'm a web dev with years of experience in python, php and node. I have made many web scrapers in the last year (10+), please check my profile for more info. Let me know if you're interested! Filippo

$833 USD in 10 days
(1 Review)
1.4
dennis1989

This should be easy for me. I will use ruby as the scripting language and the solution will be delivered on time. I hope to hear from you soon.

$1052 USD in 15 days
(0 Reviews)
0.0
arunaanu19

I am working on genomics data in a genomics lab from the last 6 years. I am expertise in data extraction and parse it in any storage media like databases, excel file, word file or any other format.I have a good experie More

$1000 USD in 15 days
(0 Reviews)
0.0
grundande

Hi! I'm a software developer from the cold parts of Sweden. I've been programming for the past 5 years, mainly in python and C++. I love challenges and never back away from problems, everything can be solved! I always More

$777 USD in 10 days
(0 Reviews)
0.0
mmacnair

Dear sir/madam, This project is an excellent match for my skill set, combining as it does high volume data collation and processing alongside mid-high level internet protocol operations. I am an honours graduate More

$1200 USD in 28 days
(0 Reviews)
1.2