Find Jobs
Hire Freelancers

Debug and enhance a custom web crawler

$250-750 USD

Completed
Posted over 12 years ago

$250-750 USD

Paid on delivery
Need a skilled Java developer to debug, fix code of and enhance an existing image web crawler. Successful completion of the following tasks is requested: Debug: 1) debug and fix a memory leak (java heap error) in the code of the crawler. 2) ever once in a while the app hangs, while memory is still available. Need to understand if this is related to the memory leak. Enhance: 1) when user stops the app, subsequent restart should continue from the last scanned URL and not from the starting project URL. For example, if starting URL is [login to view URL] and the crawler was stopped when it was scanning http://www.amazon.com/Kindle-eReader-eBook-Reader-e-Reader-Special-Offers/dp/B0051QVESA/ref=amb_link_356991982_1?pf_rd_m=ATVPDKIKX0DER&pf_rd_s=browse&pf_rd_r=10CQ1DAT4KJ1GZASSBYJ&pf_rd_t=101&pf_rd_p=1330783002&pf_rd_i=283155, the restart should begin from the last URL and not fresh from [login to view URL] 2) Should be able to capture and scan through relative URLs 3) When given a sub-directory as a starting point, the scan should begin from that directory inwards, and not from the main domain. For example, if [login to view URL] is the starting URL, then the scan starts from there, stays/scans deeper within that directory (i.e. does not go up to [login to view URL] or [login to view URL]) and neither starts from [login to view URL]
Project ID: 1357138

About the project

13 proposals
Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, I am an expert Java scraping/crawling , can surely satisfy you. Please check your inbox,
$250 USD in 2 days
5.0 (84 reviews)
6.1
6.1
13 freelancers are bidding on average $365 USD for this job
User Avatar
Hello, I am Java expert, please check your PM Thanks
$550 USD in 7 days
4.9 (70 reviews)
6.8
6.8
User Avatar
Hi, I am interested, Please share code. Thanks
$250 USD in 3 days
4.9 (181 reviews)
6.5
6.5
User Avatar
I have 4+ years experience in JAVA, J2EE and interested in your project. Please provide code to start.
$250 USD in 5 days
5.0 (27 reviews)
5.2
5.2
User Avatar
I am an experienced JAVA J2EE programmer and I can complete this work for you. Please check PM for more details.
$500 USD in 14 days
5.0 (5 reviews)
4.0
4.0
User Avatar
Hi, experienced web software developer. Have done many crawlers and scrapers.
$250 USD in 4 days
5.0 (4 reviews)
3.1
3.1
User Avatar
Hello. I am ready to debug it.
$250 USD in 4 days
4.9 (4 reviews)
3.1
3.1
User Avatar
Believing in giving best services.
$400 USD in 9 days
0.0 (0 reviews)
0.0
0.0
User Avatar
hi I have 3 years of exp in java technologies i am interesting to work on this
$650 USD in 90 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Let me do this.
$350 USD in 8 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello! I'm interested. Please send me source code. Thanks
$250 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Woburn, United States
5.0
3
Payment method verified
Member since Nov 2, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.