Hortonworks Hadoop, Big Data, AWS migration

$10000-20000 CAD

Closed

Posted

almost 6 years ago

$10000-20000 CAD

Paid on delivery

VENDOR will provide Services described above and create following deliverables: 1. Assessment and Implementation of Hadoop Data Lake (Work Package A) a. Working environment – fully operational and working Hadoop analytics platform on AWS testing environment b. Initial System Account set-up c. Acceptance Testing as outlined below: i. Working Hive SQL on Hadoop ii. ODBC access iii. Validate software installed thru Ambari portal iv. Verification of installation documentation v. Verification of alerting and monitoring service vi. User Security 1. Create new user logins, assign required security and change password 2. Disable users and/or remove access 3. Assign users different roles d. Customer on-boarding includes a full runbook about Hadoop installed cluster, along with Operational documented knowledge transfer 2. Validation of existing use cases (Work Package B) a. Validation of Active Archiving from Teradata b. Validation of data transfer from and into AWS S3 storage 3. Script to provision similar cluster on higher environment (Work Package C) a. A script along with a runbook regarding provisioning similar cluster with customizable configuration will be provided to the customer b. Knowledge transfer sessions will be setup to present the steps to be followed while executing the script 4. Hadoop Data Lake Operations (Work Package D) a. Provide services defined the in the table below, specifically related to the Service HA role:

Amazon Web Services

Big Data Sales

Database Administration

Hadoop

Scala

Project ID: 17231041

About the project

20 proposals

Remote project

Active 6 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

20 freelancers are bidding on average $16,111 CAD for this job

@dirisalagopal

Big data expert.

$10,000 CAD in 30 days

5.0

(33 reviews)

5.7

@Savstac

hello sir thanks for placing requirement in freelancer. i would like to work in your Aws project.I have 5+ years of experience in managing complex linux architectures and managing cloud infrastructures. I have worked on many complex projects ( Private cloud setup on AWS, Load balancing clusters, Replication systems and many more). I have versatile experience in setting up and managing server and also optimising them for best usage and fine tuning the security aspects. I have expertise in below fields :- 1 Linux Administration. 2 Windows Administration (Windows 2008 , 2012 & 2016) and Migration. 3 Cloud computing ( AWS, Azure and Google Cloud). 4 Automation ( Ansible,Puppet and Chef). 5 Application's & Web servers ( Apache, nginx, IIS and Tomcat ). 6 Databases ( Mysql, MsSql, MongoDB, postgresql and Apache CouchDB). 7 Security ( Web Security, Server hardening and IPS && IDS configuration) 8 Virtualization( KVM, Xen, OpenVZ & Parallels Virtuozzo). 9 Control Panels ( Cpanel, website panel, zpanel and parallel plesk panel). 10 Shell scripts, python & Perl etc. 11 Mail servers.

$10,000 CAD in 10 days

4.9

(20 reviews)

5.0

@GolpikInc

Hi, You might consider using Cloudbreak, it has the exact purpose to simplify the provisioning, management, and monitoring of HDP clusters in cloud environments, e.g. AWS. It has a CLI, with which to the whole process can be automated. Regards, Daniel Golpik

$20,000 CAD in 10 days

5.0

(1 review)

4.8

@codeguru786

Hi, Thanks a lot for the project posting. We are a company of 100+ devs and we are specialized in apps and web development. we have great experience in working similar systems. We working for major clients across the world and have delivered many successful enterprise and normal level solution. We have gone through your post and we are very confident to deliver this with perfection, We also provide life time free support and guarantee to our work. Lets talk more in detail to discuss the project. Regards

$19,176 CAD in 60 days

4.8

(1 review)

5.0

@Reflexlogic

Hi, We have gone through your requirement & understand you want to migrate your existing system (Hadoop Stack) to AWS Environment (Client AWS Playpen VPS). We understand that this process will include following tasklist: 1. Hadoop Ready - One master and rest slab which will be used password less secure shell connection from master to slab or vice versa 2. Hadoop installation - Transfer Hadoop files from present files and update files according to new nodes cluster 3. Hive SQL Installation - MySQL installation to store meta data and update files according to new nodes cluster 4. Setup and installation of Hortonworks and update files according to new nodes cluster 5. Spark Installation as scripting language and follow the same steps as Hadoop 6. Mongo DB Installation and IP Configuration and restore the backup from their premise Hadoop stack 7. Create directory structure as they have on their premise Hadoop stack 8. All the above detailed checklist will be tested and verified 9. Provide customer support on going daily basis This project involves migration process. After migration there will be ongoing support work on continue basis, that will be charged separately on hourly basis. $45 per hour. We have already done similar migration for other clients too. Lets discuss in detail. We are a reputed & registered IT company. Our team have experience level of up to 14 years.

$17,000 CAD in 60 days

5.0

(3 reviews)

4.4

@technofox

Hello, Thanks for the opportunity. My Name is Ratnesh Rai working as Sr. AWS certified engineer with technofox solution, Hold 10+ years of experience. My colleagues are well versed in Big Data and Hadoop so we as a team we post our candidatures to work on your project. Look forward to speak with you. Cheers, Ratnesh

$19,411 CAD in 30 days

5.0

(3 reviews)

4.1

@AmolZinjadeP

Hi, I have more than 4+ years of experience in big data technologies like hadoop, HDFS, Hive, spark, scala MapReduce etc. I can complete your project contact me....

$16,666 CAD in 30 days

4.8

(10 reviews)

4.2

@wuyong2020

HI, Hope you are doing well! I am professional full-stack developer and have over 8 years experiences. I am familiar with AWS. This project is very interesting to me. I have confidence to complete it. Hope to work with you. Best Regards

$17,647 CAD in 10 days

5.0

(1 review)

1.0

@abesoftak

Hi, Quality job from France. Able to do it. Contact me for more information Regards, Akli

$15,555 CAD in 75 days

0.0

(0 reviews)

0.0

@moeed10

HI, We have experience in Hadoop, aws and C# for big data analysis. Which include visual data as well. Sir i believe we can provide you an efficient time saving and generic input for the purpose. i have worked on terradata. These application's experience will help me in creating the software you need. Looking forward to hear from you soon. Regards

$15,000 CAD in 10 days

0.0

(0 reviews)

0.0

@sku5551ed6fd9643

I have read your job description in detail and I am very excited to apply on your job. I can assure you that, if given the opportunity, we will be successful and you will reap great satisfaction. I never apply to a job that doesn’t match my skills. I have done many projects similar to this over the years and I know the ins and outs of this field. If you want to be successful and get ranked by Google you need to hire someone who has done it before. This is why I believe that I am your best option.

$16,666 CAD in 10 days