Find Jobs
Hire Freelancers

Web scrapper/automation tool (READ DETAILS BEFORE BIDDING !!!) -- 2

€30-250 EUR

In Progress
Posted over 3 years ago

€30-250 EUR

Paid on delivery
The tool has to do the following tasks, using proxies and multithread on target website: 1. login 2. check if an item is present in cart (because it needs one) 3. if condition is met, goes to checkout page 4. will fill coupon field with imported bulk codes list from me in the tool 5. will fill pin code field and try from 000 to 999 until it returns valid/used/expired if it does, it stores it into the database Now the problem : after 10 pins failed successive in unknown given frame of time, coupon code gets banned for 30 minutes Workaround Idea #1: since i have coupons in bulk we can try 10 pins, if wrong pause and move to next coupon, and so on, until 30 minutes has elapsed then go back and resume 1st coupon coupon 1: 000,001,002,003,004,005,006,007,008,009 pause coupon 1 and move to coupon 2: do the same pause coupon 2 and move to coupon 3 etc after 30 minutes go back to coupon 1 to resume: 010-019 we can work multithreaded, 1 thread per pool, a pool being 30 coupons, 10 pin requests per minute, so 30 coupons to go back to first after 30 minutes using round robin algorithm maybe? Workaround Idea #2: find the limit of requests/tries that the server can handle within a given frame of time without triggering a ban the ban lasts 30 minutes, so my guess is that the limit is 10 tries per 30 minutes, maybe do more researches about it (30/10 = 3 minute, 1 try per 3 minutes so I assume this is the limit?) assign a thread to each coupon (from the imported list) so they can run parallelly without having to pause and resume and move to next coupon unlike idea #1 benefit of the idea #2 is that the project will be less complex 2 options: Fix the previous PHP script a previous Freelancer coded a year ago, before the target site implements the protection I explained above OR Start from scratch (NO Selenium allowed but PHP/ASP script that run on server is welcome) If you haven't read the project details before contacting me, or claiming you've read it, I will rate and ignore your bid. If you ask questions that have been answered in the project details, I will stop talking. If you feel like the task is too complex for you, PLEASE DON'T WASTE YOUR + MY TIME. If you have interesting questions don't hesitate to ask. Any suggestions are welcome.
Project ID: 28416210

About the project

7 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
7 freelancers are bidding on average €188 EUR for this job
User Avatar
Hi Hiring Manager I am Web Scraping - Data Mining, Java / Python Developer. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Thanks
€140 EUR in 1 day
4.8 (37 reviews)
5.8
5.8
User Avatar
Hello, Greetings! Indeed it's a complex and a challenging task with lot of R&D involved. I will wish to have a look at the PHP script which the last developer have dveloped. It's eveident from your project scope that there is already a system(website) running. Kindly share the link of the same. Kindly check my Testimonials which will help you to understand my level of expertise. Given the opportunity, I will love to discuss further and start work. Hoping to hear from you at your earliest convenience. Thanks and Regards Navojit
€250 EUR in 18 days
5.0 (14 reviews)
4.1
4.1
User Avatar
Hello there, From the description I understand that you are looking for a developer to help you create a script that automates the validation of coupon codes. I understand what you are trying to do. We can use threading to achieve this and proxies to speed up the work rate instead of waiting for 3 minutes so can make another request. I can do this in python, If you are okay with that we can discuss more over chat. Thanks in advance.
€111 EUR in 7 days
4.9 (11 reviews)
3.6
3.6
User Avatar
hi, this is Asif Ali, i ma professional in web scraping. i have dpne many task om web scraping. you will be satisfy from my work.
€278 EUR in 6 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, it's super easy for me to do it. Especially in python. Just contact me once. I will write it up and finish it up fast.
€200 EUR in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of FRANCE
Marseille, France
4.9
38
Payment method verified
Member since Jan 1, 2017

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.