Find Jobs
Hire Freelancers

Custom WordPress web-crawler needed

$30-250 USD

Closed
Posted almost 12 years ago

$30-250 USD

Paid on delivery
I need a custom web crawler/scraper for a WordPress information site. How I want it to work is thus: - It needs to be a WordPress plugin. - There will be about 60 different topics. Each topic will have 10 or so webpages which need to be scraped and made into WordPress posts. E.g. one topic may be â??universityâ?? and have a list of ten pages under the university category. - The data on these pages will change every few days so it will need to scrape to check for any new updates regularly and make posts of these. - Each webpage that needs to be scraped is literally that â?? a URL to a single webpage. No RSS feeds. - Each webpage will have URLs on them which will link to more detail. It is these URLs which need to be converted into WordPress posts. One post for each URL link. The post created will contain the information in the URL link and also a copy of the link too so people can follow it for more information. - The new post will then need to be tagged according to which topic it came under. E.g. if this website was under the â??universityâ?? topic list, the posts will be tagged with â??universityâ??. - The plugin should have a way of alerting a site administrator to any new posts that have been created so that they can be checked. - It should be possible and straightforward for the site admin to add new websites to scrape and new topics relatively easily. - It should allow another WordPress plugin to work where posts will expire and be taken offline after a certain date. All the crawled data is freely available to the public and there are no copyright concerns. The posts created from the scraped data will link back to the site the data came from. It needs to abide by the usual Wordpress guidelines for plugins such as being API based with a core plugin, extensions as needed and use hooks, filters etc. The usual setup.
Project ID: 1714738

About the project

9 proposals
Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $222 USD for this job
User Avatar
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
$250 USD in 7 days
4.8 (235 reviews)
7.8
7.8
User Avatar
Expert here check pm thank nitya
$230 USD in 3 days
4.8 (139 reviews)
6.7
6.7
User Avatar
I can do it. Please discuss with me
$200 USD in 5 days
4.8 (95 reviews)
6.5
6.5
User Avatar
Thanks for your post, kindly have a look on our PMB
$250 USD in 5 days
4.6 (13 reviews)
5.5
5.5
User Avatar
Expert data scraper here and have great WordPress experience too. Detailed proposal in the PMB. Thanks, Irfan - The Administrator removed this message for containing contact details which breaches our Terms of Service
$250 USD in 7 days
5.0 (17 reviews)
5.0
5.0
User Avatar
Willing to start work right away. Please send me details in PMB. Thanks
$250 USD in 30 days
4.8 (2 reviews)
2.6
2.6
User Avatar
Hi, Chk PM
$200 USD in 7 days
0.0 (1 review)
0.0
0.0
User Avatar
Hi, I have experience in web crawling in java as well as php to scrap the site and maintain the updates.
$300 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Custom software development - <b><i>Removed by Admin</i></b>
$250 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello It is our pleasure to work with you on your project. We are willing to provide you quality services,please look further for the expertise on our work. Kind Regards
$200 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
United Kingdom
0.0
0
Member since Jun 23, 2012

Client Verification

Other jobs from this client

Guideline Summary
$30-250 USD
Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.