Program a web crawler (script)

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan

Hi, I can write easily scalable script that you won't have any problem running in any number of threads that you want (and that your server can support ofcource). send me some sample list of domains so I can play with it

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some automation and scraping, scientific scripts. So I think I can help you in your project. Just let me know if you want start job. Regards. Lian

hi, I have gone through your project description in detail and can develop this script in PYTHON. I have web scraping experience in PYTHON with good reviews for my past projects. I'm interested in discussing further details with you.

Hello How are you i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting

Hi, I'm currently working on a crawler which checks certain posts for input keywords and based on the results, it decided whether to like that post or not. And from what I see according to your description, the basic outline of this project is almost similar. So, I can quickly and efficiently finish this project. Also, for percentages of keywords, since we're searching based on input strings, we can easily calculate what percentage of keywords are in the output url. Since we want multiple crawls to run at the same time, we can use multiprocessing library of Python. Hence, I'll be using Python for this project. Please contact me if you're interested in working with me.

Dear, Sir.⭐ I am an Experienced Web Developer whom you are looking for your project. I'm not new to the industry. With 5 years’ experience and training, I can deliver a professional read in multiple tones or styles.I have hands-on experience of 5 years, in designing and development of the websites and mobile apps. I am a developer and designer who well skilled for this project. I have that much experience to complete your project. If you give me an opportunity I assure you that I will give you my best. Thanks. :)

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. ,

Dear As I am a senior software developer, have rich experience with various application development using C#, VC, VB.Net, NodeJS, Matlab, java, and python If you are interested with my proposal, please let me know it. I hope to work with you on this project. Thanks.

Hi, I am a python developer and I can write a web crawler script using python+beautifulsoup+requests. It will be using multiprocessing to handle a large number of operations at a time.

Hello, I am scraping expert and have completed similar projects in the past. I can help you with this project easily. I can provide more details on PM. Any questions are welcome. Thanks!

G'day my antipodean friend, Firstly, thank you for taking the time to write descriptive project details - they are very helpful. How does this sound: you have a self-contained file sitting on your desktop. You double click it and it opens up a page in your web browser. From there you click a 'choose file' button then an 'upload' button and the file you've selected is parsed for domain name(s) and keyword(s) plus allowed and disallowed string(s). You press a 'crawl' button and the page outputs progress while it whirs away in the background (executing a bespoke script written purely for your task). Once the task is complete you are presented with graphical and textual representations of your results, namely concerning URLs, keywords, percentages and ranking calculations, etc. All this will be performed efficiently, asynchronously and anonymously - details to be disclosed privately. Of course we will fully discuss your requirements prior to commencement, but rest assured I have the ability and resources to make this work. Hope to hear from you soon. Kind regards, Joseph

Greetings Sir, i am Muhammad Faisal and we are professional Software Engineer and also i have experties in Web crawling having almost 5 years of experience and we provide you quality work within your budget and time duration so, lets get started

Good day! I'm a licensed full stack programming developer and designer. I have many experiences in laravel, wordpress, CI, python as backend. And I had several experiences in angular.js, react.js, node.js, Vue.js, material ,bootstrap as frontend. I have many experiences in c#,c++,c,java programming. I'm interested in your project, please feel free to check my clients reviews, my profile and if you are interested too, we can discuss more details. Thank you very much.

Hello, Greetings for the day! I have more than 3 years of experienced in Web scraping and Selenium. I implemented this way of logic for other websites and done it successfully. So can we discuss on chat to fullfill your idea. Thank you.

I have worked on similar projects to what you are looking for, and I am confident I can complete your project on time and within your budget

Hello As a data engineer, I am have worked on data scraping, wrangling and presentation. I am well versed in Python and its scraping libraries such as Beautiful Soup. With my experience I can finish the work satisfactorily.

I am a software engineer by profession, who has over 8 years of web app development experience and has been writing crawlers for scrapping websites for over 4 years. I made all the scrappers (crawlers) in PHP. I used simple HTML DOM, PHP Dom Document, DOM parsers, xpath etc. for parsing and getting HTML data. Data processing included outputs in the form of json, xml, excel sheets. I also used php libraries for like curl to get page contents. Writing scrappers is based on the structure of the websites to be crawled. I'll be reviewing the structure of the site. I understand your problem statement. Please talk to me now so that I can start working on it immediately. Thank you.