In Progress

Write some Software

I'm looking for someone to write a web crawler that can allow us to make a list of every URL on our website domain, which is www.basketballmegastore.com.

We are about to rename our business and move over to a new domain, so I need all of the URL's from our current site so that I can set up forwarding for every page to the new domain.

I've tried using some off the shelf crawlers that are available on the internet, but they only ever pull back maybe 700 - 1000 page URLs which is too few, and the lists were definitely incomplete.

I would need the data supplied in an Excel sheet, with a URL on each line.

Any questions, please just ask.

Skills: Script Install, Software Architecture

See more: software write websites idea, software write book images, software write books, software write protection, free software write book, post software project internet, software write book, paid write internet, write internet marketing proposal, software write technical manual

About the Employer:
( 1 review ) Newcastle upon Tyne, United Kingdom

Project ID: #11747961

Awarded to:

mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the URL Crawling program you require. To do so, I will use the libra More

£111 GBP in 3 days
(24 Reviews)
5.7

10 freelancers are bidding on average £131 for this job

srinichal

Looking forward to discuss more details about the project and deliver the same to your specifications.

£111 GBP in 3 days
(73 Reviews)
7.0
harshal13

I am expert in all your required SKILLS.I can give you best [url removed, login to view] for your reply. I can start working right now. Thanks,PS-M

£200 GBP in 3 days
(12 Reviews)
4.2
vkalach

HEY . Now all the links from your site [url removed, login to view] I have experience scrape some data from a website into Excel. I write a parser in Excel VBA. very comfortably. You p More

£150 GBP in 3 days
(7 Reviews)
3.6
£222 GBP in 3 days
(1 Review)
3.0
gcsekhar002

hi The previous web crawler works on this website are from secure websites ctrac, tripadvisor and expedia I'm a freelance developer from 4 years and as a freelancer I develop automation works like filling forms, fetc More

£100 GBP in 3 days
(5 Reviews)
4.2
ksinghrajeev

Hello There, I have this kind of work and certainly confident to do this. I will provide a screen shortly as sample and if ok then I can proceed with full list. I have extracted each and every link. Snapshot is at More

£150 GBP in 3 days
(1 Review)
1.5
yuanri1234

hi I experienced with web scrape 5+ years. I know your incomplete reason.I can do your project. Lets interview. Thanks

£55 GBP in 3 days
(0 Reviews)
0.0
aadityadamani

I can finish this job by today. I can comply to all your requirements. lets start chatting to discuss on how to start the project?

£75 GBP in 1 day
(0 Reviews)
0.0
cheapgetcode

A proposal has not yet been provided

£136 GBP in 4 days
(0 Reviews)
0.0