Find Jobs
Hire Freelancers

Big Data Python Developer/Engineer

$250-750 AUD

Closed
Posted over 6 years ago

$250-750 AUD

Paid on delivery
Looking for an Expert in: · Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources · Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search · Data Structures and Data Processing Algorithms and Frameworks · Data Migration, high throughput Data Pipelines · Massively Parallel Processing using Python Tools · Ability to analyze Performance Issues in Big Data Environment · Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques Well experienced with: · Large Scale Data Modelling from Big Data perspective · Big Data Structures in Python · PyData, Anaconda, numPy, PyTables, DataFrames, Jupyter Notebook · PyHive, PySpark · JSON/Parquet Data formats · Real time streaming with either Spark Streaming of Kafka Good to have: · Familiarity with PyPi · Workflow Management Tools such as Luigi, Apache Airflow, Snowflow or similar
Project ID: 14521242

About the project

29 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of INDIA
Faridabad, India
4.9
584
Member since Feb 21, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.