Data mining web scraping jobs

...and WebView for a web scraping project. The goal is to extract text and images from dynamic websites efficiently and accurately. **Key Requirements:** - **Expertise in Android Studio:** You should have a strong understanding and practical experience in developing applications with Android Studio. - **Proficiency in Kotlin:** Kotlin will be the main programming language used for this project, so you should have a substantial background working with it. - **Experience with WebView:** Since the project involves web scraping through WebView, familiarity with its nuances is necessary. - **Dynamic Content Scraping:** The ability to handle and scrape dynamic content from unspecified websites efficiently. While the specific websites are not listed, a versati...

...looking for a skilled developer to create a Chrome extension that simplifies my workflow by integrating a payment system into it. The core functionality I envision for this extension goes beyond basic features; it should support data scraping, notifications, and customizable settings to ensure a seamless user experience. Most notably, I require the extension to incorporate a robust payment gateway that can accommodate various platforms, which I will specify directly. **Core Requirements:** - Develop a Chrome extension with the following capabilities: - Data scraping - User notifications - Customizable user settings - Integrate a payment system within the extension: - Compatible with major payment gateways (specific platforms will be disclosed in one-...

I'm in urgent need of precise data entry services to update an existing Excel spreadsheet. The project needs to be completed within a week, and it entails gathering LinkedIn job titles and profile URLs based on specific geographic locations. Here's what I'm looking for in a freelancer: - Efficient in data mining and web research - Advanced skills in Excel management - Proven experience with LinkedIn data extraction - Excellent attention to detail - Ability to deliver work within a strict deadline The freelancer will be expected to: - Locate LinkedIn profiles by geographic location - Capture relevant job titles - Record corresponding profile URLs - Ensure the accuracy of all entries - Update the spreadsheet without disrupting existing ...

I NEED THIS DONE URGENTLY 24 HOURS DEADLINE MUST BE ABLE TO FOLLOW AND ...HOURS DEADLINE MUST BE ABLE TO FOLLOW AND I WILL PAY RIGHT I'm in need of a proficient developer experienced in web scraping, data processing, and mobile app platforms including both iOS and Android. The task involves creating a scraper to gather word suggestions from an undefined mobile app. The specific app will be defined as our agreement becomes clearer. Key Aspects: - Collect word suggestions from a mobile app - App runs on both iOS and Android - Output words to a txt file - Words in the file must be alphabetically arranged Ideal Skills: - Fluent in mobile app platform compatibility and navigation - Proficient in web scraping and data retrieval - Strong underst...

I'm in need of a specialist to extract text data from PDF files in a website. The primary goal is to extract and export this data into a csv file for delivery. Here's what you should possess for this project: - Proficiency in extracting text data accurately from PDFs - Excellent attention to detail for error-free results - Experience in data extraction and web scraping Please note that the extracted data must be as structured and clean as possible for seamless analysis. Only bid if you are confident in delivering high-quality work in this field. Please elaborate on prior similar project work experience as that will be of prime consideration. Also in your proposal please lay out your steps and tools that you would go about using t...

...sheet. This task is vital for my ongoing data analysis, entry, and organization efforts. 7 PDF files are there which needs to be converted to corresponding CRM excel sheet ( Excel sheet format will share and what data needs to be segregated ) **Key Requirements:** - **Data Extraction**: Ability to accurately mine the following information from each entry in the image PDF directory: - Name - Email Address - Phone Number - **Data Entry**: Efficiently input the extracted data into an Excel sheet that will be integrated into my CRM system for further data organization and analysis. **Ideal Skills and Experience:** - **PDF to Excel Conversion**: Demonstrated experience in converting complex image PDF files into Excel formats without losing ...

I'm in need of a freelancer with relevant experience in data scraping from websites, ideally e-commerce websites. The specific details to be scraped include product descriptions, product prices and product IDs. Experience in this sort of work will be a key consideration in my hiring decision. The scraped data needs to be delivered in CSV format. Ideal Skills: - Experience in data scraping - Familiarity with e-commerce websites - Ability to format scraped data into CSV files What I am looking for from the website is the product description, URL showing the category the product belongs to, product price and lastly product ID/ barcode. The site i need scraped is: Please include relevant experience in your application.

...databases, understanding of ACID properties, and experience with database performance analysis tools are musts. - **Compiler Design Guru**: You should have a good grasp of compiler theory, including lexical analysis, syntax analysis, and code generation and optimization. Experience with different programming languages and compiler construction tools will be invaluable. -**Data Mining** : You should have knowledge of data mining also Ideal Skills and Experience: - Strong foundational knowledge in computer science obtained from a reputable university. - Proven experience in the aforementioned areas, evidenced by a portfolio or past project work. - Ability to multitask and manage time effectively to work on assignments across different subjects concurrently. ...

...for data scraping and manipulation (such as Tweepy for Twitter API interaction and Pandas for data frame handling). - Experience with using the Twitter Developer API to extract tweet data. - Ability to apply filters based on keywords and locations to the data extraction process. - Competency in saving the collected data into a CSV file format while maintaining data integrity and structure. **Ideal Skills and Experience:** - Strong background in data scraping and web scraping projects. - Previous experience with Twitter data extraction and analysis. - Expertise in handling large datasets and performing data cleansing and formatting to ensure usability. This project is perfect for a freelancer who...

...am in search of a seasoned Java developer to bring to life a web-based application centered around automated data scraping. This project requires adept understanding and deployment of intricate database queries and proficiency with Java. **Core Requirements:** Add features to existing Java code / project. Pull data from external APIs and by scrapping to normalize and ingest into database. Build database querries for recommendation and relevance. React Native front end expertise is a plus. - Implement complex database queries for effective data management and analysis. - Ensure the application's compatibility and performance across various web browsers. **Skills and Experience:** - Proficient in Java with a strong grasp of web appl...

...skilled freelancer who can develop a robust web scraping tool. The tool will primarily be used to scrape text content from various websites. Requirements: - Web scraping expertise: The tool should be able to efficiently scrape text content only. - Data format: The scraped data should be delivered in JSON (JavaScript Object Notation) format. - Database integration: Please note that the tool needs to integrate with a MySQL database for seamless data storage and retrieval. The goal is to get pricing information, stock availability and lead times for electronic component from website like Digi key and mouser. Please submit your bid, and any similar work will be good to see. I'm looking for someone who brings comprehensive experience ...

I'm needing assistance in compiling personal information; specifically, email addresses from various online databases. The ide...personal information; specifically, email addresses from various online databases. The ideal freelancer for this project: - Expertise in web scraping and data mining. - In-depth familiarity with online databases and data extraction. - Devoted regard for ethical and legal considerations concerning personal data collection. - Demonstrable track record of successful similar projects. Your responsibility will entail searching and pulling email addresses from specified online databases, ensuring accuracy, and organizing the data coherently for further utilization. Please make your bid having in mind the comp...

...these mining sites. **Ideal Skills and Experience:** - Proficiency in research and data collection - Experience in the mining industry, particularly with Western Australian sites - Strong geographical and mapping skills - Ability to compile and present data in a clear, concise manner - Knowledge of GIS software could be advantageous **Key Deliverables:** - A detailed list of all mine sites in Western Australia - Precise locations and coordinates for each site - Comprehensive information on the accommodation and facilities at each mine site for employees. - Data presented in a user-friendly format (e.g., Excel, Google Sheets) This project is perfect for someone with a background in geography, mining, or research, who possesses a keen eye for...

...images and prices from a wholesaler website and present them with the margin added in real-time. The freelancer must have experience building something similar and proficiency in these areas: Data Parsing: Use web scraping tools or libraries (e.g., BeautifulSoup in Python) to extract product images and prices from the wholesaler's website. Write scripts to fetch the data in real-time. Data Storage: Store the extracted product data (images and prices) in a database or cache to facilitate real-time access. Use a database management system like MySQL or MongoDB to efficiently store and manage the data. Price Markup: Calculate the desired margin to be added to the wholesale prices. This could be a fixed amount or a percentage increa...

I am looking for a web developer who can help in creating a website to scrape online data for all credit cards available in India. The specific data that needs to be scraped from the respective credit card websites includes details on offers and brands such as rewards programs, cashback offers, and travel benefits. When it comes to the design of the website, it should have a minimalistic design. It should also have the capability of signing up the users and sending them reminders about reward programs as per their selected categories Ideal Skills: • Web Development • Web Scraping • Data Mining • UI/UX Design with a focus on minimalistic aesthetics Experience: • Previous experience in creating web s...

I am looking for a tech-savvy web scraper who can extract detailed information for the purpose of data analysis. Your mission, if you decide to accept it, will involve scraping slots data from a websites. Responsibilities: - Successfully bypass Cloudflare login captcha using Python - Extract and structure targeted data (slots information) Ideal candidate: - Proficiency in Python - Experience in bypassing CAPTCHA's, specifically Cloudflare - Proven track record of successful web scraping for data analysis purposes. - Attention to detail and accuracy in data extraction. This project demands technical expertise and comprehension; only bid if you are confident in your Python and web scraping skills, and parti...

I'm in need of a proficient Python developer to create a tool for me that can scrape LinkedIn pro...LinkedIn profiles. The specific information I'm targeting is: - Name and job title The tool should go a step further to imitate human behavior in its scraping process to bypass LinkedIn's anti-scraping measures and login requirements. In terms of output, I'll need the scraped data delivered in a CSV file format. Ideal Skills: - Python programming - Web scraping - Knowledge of LinkedIn's platform and anti-scraping measures - Experience working with CSV data formats This project would be perfect for someone who has previous experience developing similar tools or working on scraping projects, especially th...

I have scrape 100 Leads per gbp. There are total 5000 Leads from OpenTable website.

I need a professional in data scraping who can efficiently gather specific information from a sports club website. Particularly, I'm interested in extracting club names, addresses, and contact details. Ideal Skills/Experience: - Experience in data scraping specifically from sports websites - Attention to detail to ensure accurate and complete data extraction - Familiarity with websites containing robust databases Responsibilities: 1. Website Data Scraping: Collect comprehensive name, address, and contact information from a sports club site. 2. Data Accuracy: Ensuring all extracted data are accurate and complete. 3. Timely Delivery: I anticipate quick turnaround times and prompt communication. Your experience in this f...

...calculation formula for BTC Mining. The existing formula is producing incorrect results, which is significantly affecting my operations. Key tasks for this project include: - Thorough analysis of the existing BTC mining calculation issues - Development of a new, accurate, and reliable mining calculation formula for BTC. The ideal freelancer for this job needs to have: - In-depth understanding of Bitcoin and its mining processes - Extensive knowledge in mathematical modeling and algorithms - Proven experience in developing similar calculation formulas for cryptocurrency mining This is current result and formula I have for BTC (but its wrong): Certainly! Here is the information presented in regular text: Certainly, here is a general formula for ...

...efficiently scrape specific product data from Amazon and deliver it in a structured CSV format. This project requires precision and an in-depth understanding of data extraction techniques to ensure accuracy and completeness of the scraped information. **Requirements:** - **Primary Task:** Scrape product names and descriptions from Amazon. - **Data Formatting:** Compile the extracted data into a neatly organized CSV file. **Ideal Skills and Experience:** - **Proven Experience in Web Scraping:** You should have a robust portfolio showcasing your experience in web scraping, specifically with e-commerce platforms like Amazon. - **Familiarity with Programming Languages:** Proficiency in Python, JavaScript, or any other programming...

...a skilled freelancer to help automate a process on macOS, involving web scraping and data organization into a vector database. This workflow is crucial for enhancing the efficiency of report generation, file management, and data analysis within my project. **Key Requirements:** - **Data Extraction:** Ability to scrape relevant data efficiently from membership websites. The freelancer should have a robust methodology for identifying and extracting data from various sources. - **File Organization:** Implement an automated system that organizes the scraped data into a vector database with precision and consistency. - **Automation Skills:** Proficiency in creating macOS automation scripts that streamline the process from data e...

I'm looking to populate a database of investors and products they bought by extracting the information from websites, newsletters, news and PDF reports. Relevant skills: - Web scraping - Data extraction - Web crawling Spanish speaker is a plus, but not a requirement.

Looking for a skilled freelancer to assist with a web scraping project. Despite not having specific websites in mind, the perfect candidate would have a deep knowledge of legal and ethical web scraping tactics, across various complex websites. Your tasks would include: - Initiating a discussion of potential websites fitting project objectives - Web scraping for varying data types, potentially including text, images and links. - Guiding this personal project to success, with respect to legal and ethical web scraping practices. Ideal candidates should have: - Extensive experience in web scraping - Strong ethical understanding and practices - Strong communication skills Please include your experience, relevant...

I'm looking for an experienced freelancer to perform a one-time web scraping task aimed at collecting specific information from various domains. The successful completion of this project will require precision and attention to detail to ensure accuracy and efficiency. **Project Requirements:** - **Data to be Collected:** The primary focus will be on harvesting email addresses and website URLs. If possible, obtaining one contact email address from each domain is also a goal. - **Scope of Work:** This project is a one-off task, meaning the data needs to be collected just once. However, it is essential that the collected information is up-to-date and accurate at the time of scraping. - **Deliverable Format:** The final data should be organized...

I'm in need of an adept web scraper who can efficiently extract specific text data from the web. The ideal person for this project should have a strong background in web scraping, data extraction and entry, and the following tasks will be required: - Extracting and collating contact details from specified businesses - Also scraping and compiling comprehensive company profiles such like name, email, phone number and location Strong attention to detail and accuracy is crucial for this job, as is a proficient timestamped delivery of the tasks. Experience with similar projects is a plus.

Need a scraping expert to help in some work.

I am looking for qualified data mining and market research freelancers to conduct deep online research and data-gathering for my project. The particular focus would be on collecting the following details: - Information on potential customers, more specifically: - Contact Information - Available details about owned properties Ideal freelancers will have a proven track record of successful data mining and online research, showing their ability to source and neatly organize large volumes of relevant data. Familiarity with real estate markets and property details would be particularly beneficial. Efficiency and attention to detail are crucial. I'm looking for a freelancer to provide me with the following information for all Purpose Built Stu...

I urgently need an expert data scraper who can efficiently extract text content, tables and structure from multiple webpages. The content should be transferred into a Word document while adhering to the following formatting requirements: - Plain text - Tables - Sections An ideal candidate would have extensive experience in data scraping, proficiency in utilizing different relevant tools and a keen eye for detail to maintain the structure authenticity with an excellent turnaround time. I am not considering candidates without prior experience or a portfolio showcasing similar projects. Your proposals should demonstrate your understanding of my specific needs and explain how you would approach this project.

I'm in need of an Excel VBA program capable of web scraping data from the ZoomInfo website. The program should fetch specific information such as employee names, designations, email addresses and contact details. All this information will be gathered according to the list of company names I provide, which is presented in a single-column format in Excel. Having a proficient handling of errors and anomalies is imperative to me; with on-screen alerts being my preferred method for notification of a failed data retrieval. Ideal freelancer should have proficiency in Excel VBA, web scraping and error handling. Solid familiarity with ZoomInfo website or similar databases is a major plus. A meticulous attention to detail will be key to ensuring that al...

...Almaty) - Extensive data scraping from 2GIS - Business category : Cafe/pastry/bakery - Collection of business names, contact details, reviews, menu details specifics, and pricing of each items - Geolocation information for each listing Ideal Candidates should demonstrate: - Proven experience in data scraping and web automation - Ability to parse and extract varied information accurately - Proficiency in data management and organization Data Formatting: - Deliver all scraped data formatted in an Excel spreadsheet for easy analysis. Please include details of similar projects you've tackled and how your experience suits this task. I'm looking for efficiency, precision, and reliability. If you have the skills to perform ...

I need a detail-oriented freelancer to transfer both numeric and text data from multiple websites into an Excel spreadsheet. This will help organize and analyze the information more effectively. Key Responsibilities: - Navigate through specified websites to locate required data - Input text and numeric information into an Excel template - Ensure accuracy by cross-referencing the inputted data with original sources - Format the spreadsheet to improve readability and analysis Skills and Experience: - Proficiency in Excel with a strong understanding of its functions and formulas - Experience with data entry and web scraping tools - Keen attention to detail, especially with data accuracy and integrity - Ability to work methodically and meet ...

...Solana wallet address and output the data in real-time. Here's what I'm looking for: - Focus on **Incoming Transmissions**: Capture all incoming transactions without any outage or significant delay. - **Output Format**: The scraped data should be formatted in JSON, a format conducive for further data handling and integration. - **Data Points**: Along with the transaction information, each record must include the sender's address and timestamp. - **Quality and Speed**: Ensuring data accuracy and real-time performance is crucial. Once the data is received I want it to be sent to my telegram. Ideal Candidate: - Familiarity with blockchain concepts and Solana network. - Proficient in coding scripts or bots for scraping and A...

I'm seeking an artistic professional to craft the visual brand identity of Sonic Supply, my burgeoning technology solutions company specializing in mining equipment. The perfect logo should exemplify innovation and reliability. **Requirements:** - Conceptualize and design a unique logo - Integrate a blue color scheme - Reflect mining technology industry **Ideal Candidate:** - Proficient in graphic design software - Experience with tech-related branding - Exceptional creativity and originality - Efficient communicator and receptive to feedback Looking forward to translating my vision into an emblematic and memorable logo with your expertise!

...prevent a second round of authentication, presenting a unique challenge for the scraping process. Before downloading these Excel files(less than 10), this scraping program may need to have some clicks or other mouse activities on this specified page. To summay, write a sample program with organized source codes: 1. login with saved cookie, if any authentication, prompt the user to input and login to save the new cookie to file 2. click a specified URL which can be read from .xml/.json config file 3. click a button (we will provide the button's html/css) 4. save the downloaded Excel file How much for this spec? - Ideal candidate skills: - Expertise in Python - Experience with web scraping against anti-scraping techniques - Profici...

...better performance and stability. - **Adding New Functionality:** Implement additional modules that extend the project's functionality. - **Web Scraping:** Collect data from specific URLs which I will provide, ensuring accuracy and efficiency. - **Data Storage & Display:** Save the scraped data and present it with custom filters. - **Custom Filters Implementation:** Create filters for date range, category selection, and specific states and tables within the datasets. Ideal Skills: - Proficient in Python programming and web scraping techniques. - Experienced with AWS services, particularly in data storage and management. - Familiar with creating user-friendly data filters and interfaces. - Skilled in debugging and o...

I need skilled freelancers to develop web crawlers that will gather specific sets of data from various job search and stock market websites. These crawlers must be efficient, accurately collect data, and deliver the information in a structured Excel format. Canadian Job Seekers Indian Stock Market Brokers Requirements: - Extract job titles, company names, and job descriptions from job search websites. - Collect stock prices, company information, and related news articles from stock market websites. Ideal Skills: - Proficiency in web crawling tools and software. - Solid understanding of data mining and web scraping principles. - Experience with Excel and data organization. - Knowledge of Canadian job markets and Indian stock ...

I’m seeking an experienced data specialist to develop a comprehensive database focused on local mortgage brokers. The information will be preferably structured geographically. Key Requirements: 1. Contact Information: Broker's phone and email address required. 2. Company Details: I'm interested in obtaining the company's name and address. 3. Geographical Organization: Please organize information based on geographical location. 4. Focused Area: The database should cover local brokers only. Proficiency in data mining and sorting is highly essential. Experience in Real Estate or a similar sector is highly advantageous. Location to be Gold Coast, Northern NSW, Australia

I need a proficient data extractor for website text mining. Essential Skills: - Experience in web scraping - Proficiency with data extraction tools - Familiarity with Python or similar programming languages - Ability to handle different text formats on websites - Knowledge of HTML/CSS and web technologies - Strong understanding of data storage in spreadsheets Responsibilities: - Identify and extract text data from specified websites - Ensure accuracy and completeness of the extracted data - Organize extracted text into a usable spreadsheet format - Overcome scraping defenses and CAPTCHA challenges if present Ideal Freelancer Profile: - Proven track record in web scraping - Detail-oriented and reliable - ...

I'm in search of an experienced Selenium web-scraping professional who's competent in scraping table data from various websites. This is specifically focused on obtaining past historical data relevant to my operations. Key requirements for the project are: - Expertise in web scraping using Selenium - Experienced in data extraction from diverse tables available online - Should be capable of customizing date ranges for obtaining historical data If you have prior experience in this data scraping domain, your skills will indeed be valuable for this project. Let's get engaged and automate the process.

...enhance my educational journey. Ideally, the script would allow me to automate the download process, saving me precious time that I can then dedicate to studying and maximizing my learning potential. The ability to customize the script to choose specific lectures and categorize the files neatly based on subjects would be an added bonus. If you have the necessary expertise and are familiar with web scraping or similar techniques, I would be thrilled to discuss the details further. It would be greatly appreciated if you could provide me with an estimate of the time required to develop the script and your proposed budget for the project. Please feel free to ask any questions you may have or request additional information. I am open to suggestions and collaborative discussi...

I need an expert freelancer for a one-time project involving web data scraping. The objective is to collect specific text content from designated websites. Key Project Details: - Scrape text content accurately. - Ensure data is organized for database integration. - One-time extraction with a possibility of future projects. Ideal Candidate Skills: - Proficiency in web scraping tools and software. - Experience with data extraction and organization. - Understanding of database structures. - Ability to deliver clean, usable data outputs. This project is suitable for freelancers who are detail-oriented and have a proven track record in similar data scraping tasks.

I need a Python developer to assist with automating certain tasks on Telegram. Unfortunately, I’m not able to provide specifics on the tasks as this question was skipped during the initial project setup. However, potential tasks might include setting up automated message sending, group management features, and scraping data from Telegram channels. The frequency of these processes was not determined either. Ideal candidates for this job should have: - Excellent skills in Python, particularly with creating automation scripts - Knowledge of and experience with the Telegram API - Superior problem-solving abilities as the exact project requirements might need to be ironed out during development When applying, feel free to provide any relevant details such as past work, ex...

I'm looking to build a sleek, corporate-esque website tailored for selling professional web scraping services. Here's what I need: - A sleek, professional, and corporate-style design to appeal to business clients. - No integration with CRM systems is required at this stage. - Capability to process payments via Credit Card, PayPal, and cryptocurrency. Ideal Skills for the Job: - Proficiency in web design with a portfolio demonstrating corporate website work. - Experience with eCommerce platforms and secure payment gateway integration. - Knowledge of cryptocurrencies payment systems is a plus. - Good understanding of UX to ensure a smooth transactional process for clients. I'm excited to see your proposals and previous work that align with the vision f...

If you satisfy by my work, thn please give me review, so it will be helpful for me

Hi, We need 878 products scraped from a website with the fields attached in the excel file. You will need to reference 2 .jpg images in the excel sheet and save the images to a gdrive link that we will give you.

I need to know an intelligent website scraper to ask for hel...needed (Casual unless you make your own role). This is not crazy technical - it's basic, but I would like you to be able to think! It is infinitely more useful that you are smart, can manage data sets, and want to own solutions so I don't have to explain every tiny detail and can let you just do... I have a task now which involves scraping a post on my site, then doing 301/404 checks, then working to expand data by pulling from sits as you see need (Of course I have list already). The more logical and smart you are in understanding how to solve problems the more I can see ways to use you. If you can do data manipulation then there is more fun! NB: You genuinely will be treated as an ad...

I'm looking for an expert in data scraping to collect specific information about the followers of a LinkedIn company page. This data will directly support my market research. Requirements: - Scrape Names, Job Titles, Locations, and LinkedIn URLs of company followers. - Organize the data cleanly in a spreadsheet format. - Ensure the accuracy and reliability of the extracted data. Ideal Skills: - Experience with LinkedIn's API or similar data mining tools. - Proficient in data scraping and extraction techniques. - Capable of creating structured spreadsheets. - Knowledge of data privacy regulations. By applying, you're confirming that you have the skills to accurately gather and format this data rel...

I'm looking for a skilled data scientist to help me extract meaningful patterns from vast amounts of social media activity data. Here's what I need from you: - Proficiency in Python for data analysis and pattern identification. - Expertise in data mining techniques and algorithms. - Experience with social media data analytics. Your primary goal will be to analyze the data to uncover hidden insights within social media interactions that can inform business strategy. This will require: - Strong analytical skills to identify key patterns and trends. - Ability to preprocess, clean, and organize social media data for analysis. - Experience with libraries such as Pandas, NumPy, Scikit-learn, and possibly natural language proces...

I'm ready to hire a data collector to compile a thorough list of all B&B's in the UK. This list should be neatly organized according to location. For each B&B, the list should include the following info: - Name - Contact Information - Ratings - Website address - Location Only include B&B's that have a website. Having experience in data mining and web research will be advantageous for this job. Deep knowledge about UK's geography and touristic accommodations is also preferred. Your job will consist of obtaining accurate, up-to-date information and ensuring the list is easily readable and accessible through a typical data file format such as CSV or Excel. Your comprehensive work will help me to have a real-time snapshot of...