Write some Software
£20-250 GBP
Paid on delivery
I'm looking for someone to write a web crawler that can allow us to make a list of every URL on our website domain, which is www.basketballmegastore.com.
We are about to rename our business and move over to a new domain, so I need all of the URL's from our current site so that I can set up forwarding for every page to the new domain.
I've tried using some off the shelf crawlers that are available on the internet, but they only ever pull back maybe 700 - 1000 page URLs which is too few, and the lists were definitely incomplete.
I would need the data supplied in an Excel sheet, with a URL on each line.
Any questions, please just ask.
Project ID: #11747961
About the project
Awarded to:
Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the URL Crawling program you require. To do so, I will use the libra More
10 freelancers are bidding on average £131 for this job
Looking forward to discuss more details about the project and deliver the same to your specifications.
hi The previous web crawler works on this website are from secure websites ctrac, tripadvisor and expedia I'm a freelance developer from 4 years and as a freelancer I develop automation works like filling forms, fetc More
hi I experienced with web scrape 5+ years. I know your incomplete reason.I can do your project. Lets interview. Thanks
I can finish this job by today. I can comply to all your requirements. lets start chatting to discuss on how to start the project?
