Find Jobs
Hire Freelancers

Write Python email scraping script

$30-250 USD

Closed
Posted almost 2 years ago

$30-250 USD

Paid on delivery
I'm looking for an experienced data scraping / automation expert to write a Python script that finds a specific type of email address on a given URL. I want the script to specifically find the email address for a website / company's privacy team. You should implement Brightdata proxy to ensure the page(s) load correctly. Proposed functionality of script: 1. New request is created by submitting URL / domain to the script (should be called from Python function) 2. Script uses Google Search API ([login to view URL]) to find all relevant pages on the given domain. For example: "site:domain.com+privacy+policy" will help us to find the pages on the input URL/domain that are related to the privacy policy of the website. 3. For all links returned by RapidAPI, load URL and try to extract email address 4. If no email address is found on these topic-specific URLs, attempt to find general contact page using Google Search API. For example: "site:domain.com+contact+email" 5. Compile output of results and where multiple emails are found, prioritise order based on appearance of keywords in email address (e.g privacy@ / dataprotection@ ranks more highly than contact@ / support@) 5. Return a JSON response to the initial function, with list of email addresses and the URL they were found on It's important the script can detect modified email address formats, for example: email (at) [login to view URL] [login to view URL] email at [login to view URL] This Python library looks like it could be useful for this task: [login to view URL]
Project ID: 33822763

About the project

31 proposals
Remote project
Active 2 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
31 freelancers are bidding on average $159 USD for this job
User Avatar
hi I read the steps you listed and I can make you a PYTHON script to automate everything. I can implement the proxies as well as the library you listed at the end. Lets chat further details. Abdul H.
$130 USD in 1 day
5.0 (274 reviews)
7.0
7.0
User Avatar
* * * * * * * * * * * * * * * * * * * * * * Hello There, I’m a Professional and Expert Python Developer. I am interested in doing this job for you.I do have the necessary skill set & resources to complete this project. I have done this kind of project before and I am ready to start the project asap.I will provide you with a project covering all the requirements that you are asking for. For the rest of the details, how about connecting on a Chat Box? Awaiting your ping. Thank you Virang Patel The bid is a placeholder only. I will share the best timeline & cost once I am clear about your project details.
$140 USD in 7 days
4.9 (35 reviews)
6.6
6.6
User Avatar
Hi . I am a fully experienced Web Data Scraping expert. I’ve completed lots of similar projects using frameworks and packages such as python selenium, scrapy, requests, beautifulsoup, lxml and etc, I will provide high-quality results in time. I’d like to discuss more about the project. I can start your project asap. Thank you.
$200 USD in 1 day
4.7 (20 reviews)
5.9
5.9
User Avatar
Hey There, I'm a python programmer, expert in web scraping and automation. I have built a very similar to what you are talking about in your description. The difference is not using Search API and I captured phone numbers too. Please feel free to contact me for more details. Kind Regards.
$160 USD in 1 day
5.0 (45 reviews)
5.6
5.6
User Avatar
Thanks for reading my proposal! I have read your description carefully with interests and have grasped main idea of your project. I have developed a lot of PYTHON/Scraping tools for long time. Your project is just same as my job and experience. Hiring me you may get better result than what you want. My goal is your pleasure! Thanks again!
$120 USD in 2 days
5.0 (32 reviews)
5.7
5.7
User Avatar
Yo! I am an expert Python computer programmer with skills including Web Scraping, Python, Data Scraping and BeautifulSoup. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Please contact me to discuss more regarding this project. Thanks & regards
$250 USD in 3 days
4.6 (32 reviews)
5.9
5.9
User Avatar
Hello, There I am a talented python web scraper and automation specialist. I ensure I can handle this project as well perfectly, Please give me your chance. I will do my best and I will not disappoint you. Look forward to hearing from you. Regards
$201 USD in 7 days
5.0 (13 reviews)
5.4
5.4
User Avatar
I can do it
$140 USD in 7 days
5.0 (23 reviews)
5.2
5.2
User Avatar
Hi there. I have experiences with Web Scrapping. Le'ts discuss more in detail. Thanks.
$140 USD in 7 days
4.9 (21 reviews)
4.7
4.7
User Avatar
Hello. How are you? First, Thank you for you post this project. I know how to solve your problem. I read your project carefully and I think you find expert in web scraping and automation. I have good experience (6 years) in web scraping and then I think if you want build this project, you have to use bs4, scrapy, selenium requests,NLP, json, proxy, anticaptcha... I have powerful background in python and I can work very extremely fast. As you can see my review, I always give you good result and keep timeline. I will keep this review for you. I hope discuss about your project details and Finally I wish your business well done. Thank you for attention about my bid. Regards
$140 USD in 7 days
5.0 (4 reviews)
4.6
4.6
User Avatar
Hi there, I’m a Professional and Expert Python Developer. I am interested in doing this job for you. I do have the necessary skill set & resources to complete this project. I have done this kind of project before and I am ready to start the project asap. I will provide you project with that covers all the requirements that you are asking for. For the rest of the details, how about connecting on a Chat Box? Awaiting your ping. Thank you
$150 USD in 3 days
5.0 (4 reviews)
4.2
4.2
User Avatar
Hello. How are you? First, Thank you for you post this project. I know how to solve your problem. I read your project carefully and I think you find expert in web scraping and automation. I have good experience (6 years) in web scraping and then I think if you want build this project, you have to use bs4, scrapy, selenium requests,NLP, json, proxy, anticaptcha... I have powerful background in python and I can work very extremely fast. As you can see my review, I always give you good result and keep timeline. I will keep this review for you. I hope discuss about your project details and Finally I wish your business well done. Thank you for attention about my bid. Regards
$140 USD in 7 days
4.5 (4 reviews)
4.7
4.7
User Avatar
Ready to write a Python script that finds a specific type of email address on a given URL. please send me a message to discuss further details about this project in chat. thank you
$250 USD in 10 days
5.0 (7 reviews)
3.8
3.8
User Avatar
⭐⭐⭐PREFERABLE FREELANCER⭐⭐⭐ I just read your requirement carefully and get interested in your project. I have rich experience in Python, Web Scraping, Data Scraping I am sure I can do it. I'd like to talk to you about the project in the chatbox. Hope to work with you. Thanks. Velazquez
$250 USD in 7 days
4.9 (7 reviews)
4.0
4.0
User Avatar
Hi, I have read this job carefully and i am very interested in this job. I am full stack web developer and i am very experience with Python. I can start working right now and looking for a good long term relationship. Regards, Ionel.
$150 USD in 3 days
4.6 (4 reviews)
3.3
3.3
User Avatar
Hello, i am a professional programing with python, i have a great expérience in web scraping using python librairies (beautifulSoup, requests, sélénium). Can you Please contact me for more détails Thanks.
$100 USD in 2 days
5.0 (8 reviews)
3.1
3.1
User Avatar
Hi here, I have a ready made code for this. I used it to complete my task. It's able to collect email via website URL. Let's discuss more in chat. Thanks!
$30 USD in 1 day
5.0 (5 reviews)
2.2
2.2
User Avatar
Hi, I have been developing various API apps for more then 4 years now. My last two projects here were also related to API app development and scraping. I could provide a working app in two days after we agree all the specifics. I'm looking forward to hearing from you. Regards, Lukas
$200 USD in 2 days
5.0 (2 reviews)
2.0
2.0
User Avatar
Hi sir, This is Nguyen and I am scraping expert, I scraped 100+ websites, please check my reviews then you will know. I will create scraping tool with PHP & CURL that extracts all requested data, And provides data in the required format (JSON, CSV, EXCEL, SQL...). Can we discuss more details about this project? Then I can provide sample data/script, we can start project after you checked sample.
$140 USD in 7 days
0.0 (1 review)
0.0
0.0
User Avatar
Hello, I have 5 years of experience in the area of ​​technology and I will be able to complete this project.
$140 USD in 15 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
London, United Kingdom
5.0
24
Payment method verified
Member since Mar 19, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.