Find Jobs
Hire Freelancers

Python, Amazon AWS, S3, Web Scraping expert wanted!

$250-750 USD

Closed
Posted almost 5 years ago

$250-750 USD

Paid on delivery
1) monitor a public or semi public Amazon S3 bucket 2) record the filename of every new file or modification of any files every x hours in that bucket 3) notify an a person as soon as file has been added or edited 4) download or sync the files to another S3 account or a digitalocean droplet or virtual machine 5) delete the access logs that were created when accessing/downloading the data. 6) explore and record any other s3 buckets that might have been discovered in the process of monitoring the existing bucket
Project ID: 20252103

About the project

21 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
21 freelancers are bidding on average $532 USD for this job
User Avatar
Hello sir I am a senior python developer with 9 years of experience. Also I am very familiar with AWS. I have got your idea from the job description and I am confident with the task. If you want, I can start the work right now. Best Regards, Yongtao
$750 USD in 10 days
4.9 (128 reviews)
7.6
7.6
User Avatar
Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here's what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention. Shuaixing.(call me Shuaixing L.)
$500 USD in 7 days
5.0 (24 reviews)
6.3
6.3
User Avatar
Hi, I am an ex-Microsoft employee, an experienced all-round Python/Django developer & an expert Web scraper, using Scrapy, Selenium & Requests for Library, as per the need of the project/s. I am working with a small but hard working & ambitious team of talented developers and am confident of successfully monitoring your Amazon S3 bucket as per your specifications. You can pay after the job is delivered to your utmost satisfaction. Thanks ! ADITYA
$745 USD in 7 days
5.0 (35 reviews)
5.9
5.9
User Avatar
Dear Employer, I have extensive experience in Python Linux Web Scraping Software Architecture and Amazon Web Services. I know knots and bolts of Python and Linux. Please let me know if you are interested and I would be more than happy to assist you.
$250 USD in 4 days
4.9 (69 reviews)
5.4
5.4
User Avatar
Hi I am certified aws solutions architect and data engineer with 4+ years of industry experience. I have been working on scalable, available and fault tolerant solutions using aws. Relevant Skills and Experience Expertise in 1. Microservices with lambda, dynamodb, s3, api gateway 2. Microservices with docker, kuberneetes, ecs, eks, farguet 3. Python, java, shell, scala Looking forward to hearing from you
$500 USD in 10 days
5.0 (22 reviews)
5.1
5.1
User Avatar
Hi, my name is Chris I am web developer specialized in python web scrapping, I have vast experience working with AWS...
$333 USD in 7 days
4.6 (21 reviews)
4.7
4.7
User Avatar
Hi, I read your job description and can assist you in this project. I am an experienced Python developer. I have great experience with AWS S3 buckets, AWS Transcribe, AWS Cognito integration in Django Rest Framework etc. I have completed many web/data scraping tasks. Please have a glance: --- Custom Python script to mirror all the data from the websites listed on Wayback machine. --- Mortgage choice is a web crawling script for marketing purpose. --- A custom module is build to fetch specific data from the target eCommerce site. I am confident about handling this job. Please initiate the PM so that we can discuss the project in detail. With Regards, Harshvir Singh
$600 USD in 14 days
4.5 (11 reviews)
4.8
4.8
User Avatar
Hello, I have experience in web scraping with Python. I've worked scraping Amazon before, I've used S3 buckets as well and implemented it on my Python code so you can trust that I have the real experience on the subject! I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!
$500 USD in 7 days
5.0 (5 reviews)
4.1
4.1
User Avatar
Hello I am a web developer and I can help you with this project, let's talk about this and I will give my best in this project hope you hire me. :)
$500 USD in 7 days
5.0 (1 review)
3.4
3.4
User Avatar
I have 7+ years of hands-on experiences with proficiency in technologies including Kubernetes, AWS, Python, Ansible [Global Certification], Terraform, Jenkins, Git, Docker, Cloud Computing and Redhat Linux [RHCSA - Global Certification]. My Daily task Includes: ☁️ Python Scripting ☁️ AWS [AWS Certified Solutions Architect] ☁️Creating and Deploying Helm Charts. ☁️Integration and Deployment of ElasticSearch-Fluentd-Kibana [EFK] & [ELK] on Kubernetes. ☁️Grafana and Prometheus Deployment on kubernetes Cluster for Monitoring and Creating DashBoards. ☁️Infrastructure Creation Using Terraform. ☁️Implemented Hashicorp vault to Secure Secrets in K8s. ☁️Automate Deployment of cloud computing & Virtualization with Kubernetes & Docker Integration. ☁️Design and Develop Continuous Deployment Pipeline, integrating Test-Kitchen, Git, Jenkins, and Ansible across geographically separated hosting zones in AWS, GKE. ☁️Wrote custom monitoring and integrated monitoring methods into deployment processes. Let's discuss more details over chat .Looking forward to having your message.
$250 USD in 14 days
5.0 (1 review)
1.8
1.8
User Avatar
Hi, I have very good experience in AWS technologies, I can automate monitoring on your s3 buckets and implemented your requirements. Let me know if you are interested in hiring me.
$250 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have a lot of experience in scraping techniques, I mainly use Python and Selenium or requests, but I can use many others, such as Puppeteer of Scrapy. If you are interested, contact me and we will discuss the details. Best regards
$250 USD in 3 days
5.0 (1 review)
0.0
0.0
User Avatar
as much as you are placing the amount, the work takes mere few dedicated hours itself for someone experienced. given the chance, I would not let you down. I am new but a strong python developer with specialization for this job
$277 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
AWS Certified Solution Architect Associate with 4 years of experience specialising in AWS Cloud Infrastructure Automation, DevOps Tools Configuration Management, CI/CD using Jenkins, Linux Shell Scripting, Docker, ECS, CloudFormation, Terraform, Packer
$555 USD in 15 days
0.0 (1 review)
0.0
0.0

About the client

Flag of RUSSIAN FEDERATION
Novosibirsk, Russian Federation
0.0
0
Payment method verified
Member since Jul 8, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.