Closed

International xml sitemap generator project

I would like to build an XML sitemap generator in either Python or other language that is preferred by the developer for this type of project.

Here are the features I would like to have for the generator:

- Pattern-matching to check for parallel pages in other languages/locale

- Configurable patterns based on the site URLs

- Ability to configure to crawl only specific directories

- Ability to disallow from crawling parameters

- Cloud-based GUI to add URL and start crawl (I can host on my VPS)

- Menu to export crawl results, configure crawl URLs, disallow parameters, etc. (See Screaming Frog)

- Crawl large sites up to 1,000,000 pages

- Check http status codes and ensure all 200 status

- Only add https URLs to sitemap and if http, check https for a page to add

- Check box for adding video, images, etc. to sitemap either combined or separate sitemaps

- Build sitemap index for large sites and then link off to each associated locale sitemap

- Option to divide sitemap based on URL patterns (Have a certain directory or part of the site in each sitemap)

- No more than 50,000 URLs per sitemap

Skills: Python, Google App Engine, Software Architecture, Web Scraping, PHP

See more: url list generator, download sitemap, ecommerce sitemap generator, sitemap generator for blogger, xml generator online, unlimited sitemap generator, sitemap tool, html sitemap generator, xml odds feed project, xml flash player project, xml feed generator phpnuke, xml file generator, word search generator project, spanish word search generator project, generate xml sitemap script, build script asp will give xml sitemap, project 2003 adding extra day problem, xml mysql database project sample, sitemapclassphp google xml sitemap, buy sitemap generator php script

About the Employer:
( 36 reviews ) Chisinau, Moldova, Republic of

Project ID: #20220551

30 freelancers are bidding on average $501 for this job

Yknox

Dear!, employer. I am Jin.S. I have a good experience in webscraping. I was also good at python. I'm a certificated freelancer with over 1300 good reviews from clients. I never disappoint my clients and I'm able to lea More

$600 USD in 7 days
(855 Reviews)
9.3
darshring

Hi, How are you? I am really interested in your project. I have enough experience on python, XML. I am 100% sure i can satisfy your requirements perfectly. I want a long term relationship with you. Thanks.

$500 USD in 7 days
(38 Reviews)
7.3
xiqian88

Hello. I've read your project description and understood what you need. I have rich experience in web scrapping. I can get all the information of any websites with my highly skill in few hours. I look forward for worki More

$500 USD in 7 days
(59 Reviews)
7.3
chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do More

$500 USD in 5 days
(123 Reviews)
7.4
mascotindia123

Hello there I have read you project detail, you need PHP development with cakephp for your on going ERP system, I am a professional website developer and good designer. I have rich experiences for Website Design, Cake More

$500 USD in 7 days
(260 Reviews)
7.5
wang109

Hello ⭐⭐⭐⭐⭐ 100% completion, 5 stars honest developer HERE. Thanks for your project. I see you are looking for a good web developer who can build a website. I have extensive experiences in building a website. I under More

$500 USD in 7 days
(52 Reviews)
7.0
alexwmsoft

100% Completion Rate and 5 Stars Dear, employer. My name is Lee, I am an experienced web developer, and web scraping expert. I have good experiences in web scraping using PHP, Python, Java and so on. I read your job More

$500 USD in 7 days
(42 Reviews)
6.6
adampohp79

Dear client, I have lots of experiences in the skills for your project. I hope work for you because my skill set is very suitable to your project. I am confident to handle this project according to your expectations pe More

$500 USD in 7 days
(78 Reviews)
6.3
SecureForYou

hello how are you I have checked your requirement in detail and I am pretty sure that I am a right candidate for your job. Because I have rich experience in sitemap generation. And I am highly skilled with PHP , Python More

$500 USD in 7 days
(7 Reviews)
5.3
BlackEagle86

Hi, How are you? I did read carefully your post. I can build an XML sitemap generator! I have the full experience and expert knowledge about web scraping, web bot using python. Your project is fit for me. You will be More

$500 USD in 7 days
(15 Reviews)
5.3
fivestar10

Dear sir. I have read your description with great interest. I have experiences with lots of project. Also I am able to finish your task in time. If you send me a message, we can discuss more. I am waiting for your More

$500 USD in 7 days
(25 Reviews)
5.5
ankitbagre2000

Hey, employer. I already have read your description carefully. I have 5+ years enough experience in website development. My major skill are HTML5, CSS3, JavaScript, JQuery, Bootstrap, MySQL etc. I am reliable freela More

$500 USD in 7 days
(35 Reviews)
5.0
phantom1222

Hello.. I have read your post very carefully and I have understood what you want. I am a 100% completion Developer. I have experience of development like this. As an experienced web developer, I am sure I can handle yo More

$500 USD in 7 days
(23 Reviews)
5.2
makelegend17

hello , sir how are you Nice to meet you I have seen your project description. I think I am the best candidate for your project. I have a rich experience in sitemap generating like this site for 10 years http://scarlet More

$500 USD in 7 days
(5 Reviews)
4.6
rexcelit

Hello, A satisfied client is like a billion dollar smile to us!!! I have gone through the post and yes; I will help you for sure to complete your project successfully on time and with quality. We are rated amongst top More

$500 USD in 7 days
(6 Reviews)
4.1
hayat38402

----Interested Project. Professional Math & Python & Matlab & Machine Learning expert. Best result in time----- Hello sir, I read your description very carefully. I am very interesting for your project because I have More

$500 USD in 7 days
(2 Reviews)
3.9
MichealSMoreno

Dear client, how have you been? I've read your project description carefully. Presenting this proposal with 100% confident. How about discuss in chat? Waiting for your reply. Best regards.

$750 USD in 15 days
(26 Reviews)
4.6
Ioitsolutions

I did such a job crawling popular e-commerce shops sites for getting web pages and parsing their content into word, excel, access and text files. I have a set of great tools, which can automatically scan pages, parse a More

$399 USD in 7 days
(7 Reviews)
3.8
Skypotential

Greetings, I have completely read your details and I can help you to get this job done. Seems like, you are looking for a skilful and polished Website Developer. I am just a click away to provide you a good turn. I am More

$500 USD in 7 days
(2 Reviews)
3.4
ShyamFutureTech

Hi, Thank You for posting your Requirement! I am confident that we would be able to work together on this Project and create something worthwhile. We have team of experienced Python developers who would be glad to h More

$660 USD in 14 days
(3 Reviews)
3.3