data mining using scrapy framework

Completed Posted Jul 10, 2013 Paid on delivery
Completed Paid on delivery

We need a custom bot for scraping a site and insert the information directly to a mysql database.

one of the requirements is that you must avoid inserting duplicate content, because the bot will be running every 3 days.

another critical point is that when inserting the information must relate a value of the database to another table, and use the related value from the other table to finish inserting the entire article.

scrapear web site is w**.[login to view URL]

Data Entry Data Processing MySQL Python Web Scraping

Project ID: #4712730

About the project

18 proposals Remote project Active Jul 11, 2013

Awarded to:

chirgeo

Scrapy expert here. Did lots of projects using scrapy, we can do this one also.

$154 USD in 2 days
(163 Reviews)
8.1

18 freelancers are bidding on average $169 for this job

e3d

Hello, please give me more details via PM

$194 USD in 5 days
(293 Reviews)
8.8
uumairkhalid

Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. Ready to start. have a look at PM. Regards

$147 USD in 3 days
(188 Reviews)
7.1
M5L2764K

Please see PMB

$144 USD in 3 days
(19 Reviews)
5.3
ddhnyh1

Hi. Please check my pm.

$221 USD in 5 days
(9 Reviews)
4.6
cloudvn

Expert in here

$111 USD in 1 day
(18 Reviews)
4.5
prowebsolutionz

Hi sir, ready to start , I am php expert. have done lot pf scrapper bot. You can view my Exam result also. thanks

$100 USD in 3 days
(16 Reviews)
3.8
reliers

Hi, I can do this job. I have more experience with python scrapy framework, and for more please check your private message box. Thanks and regards

$66 USD in 3 days
(12 Reviews)
3.6
jkumarsanson

Hello sir, I am kindly interested in this type of project works I will perfectly finish the work within the stipulated time kindly give me an offer to work for you I expect your cordial relationship in the due course More

$63 USD in 2 days
(13 Reviews)
3.5
thorapps

Hola, somos una empresa española con 6 años de experiencia en desarrollo web y aplicaciones para facebook y mobiles. Podemos realizar este proyecto.

$277 USD in 3 days
(2 Reviews)
3.3
pyexpert

Have written over 50 bots in scrapy by now. I am willing to send you samples or make you a customized sample. Please pm me any questions or test you may have. The price can be negotiated to your comfort level. I look f More

$100 USD in 7 days
(8 Reviews)
3.6
khurramgujjar8

I have developed many minning algorithms and can provide you this work . Looking forward to work with you.

$300 USD in 5 days
(0 Reviews)
0.0
levanilashvili

Hello I have experience in scraping websites, I had a look to century21libra's webpage and I'm sure that I can parse data from it. Looking forward to work on this job :)

$200 USD in 4 days
(0 Reviews)
0.0
walterjansen2013

i can colabroare

$277 USD in 30 days
(0 Reviews)
0.0
felipemunoz

estoy interesado

$222 USD in 3 days
(0 Reviews)
0.0
noorkaslina

I am professional data entry, dedicated and hard work

$155 USD in 3 days
(0 Reviews)
0.0
jasait

♥♥♥ JasaIT ♥♥♥ - A leading IT farm in BD with ◘◘◘ 30s professional ◘◘◘ Please take a look of skills in my ►►► PM ◄◄◄ And •••Contact with me••• to run your project quite smoothly. THANKS

$155 USD in 1 day
(0 Reviews)
0.0
washuh

I've used scrapy before, maybe integrate it with a QT C++ app to ease the development or even a GUI for the project.

$155 USD in 3 days
(0 Reviews)
0.0