S3-Splunk Automation

min $50 USD / hour

Completed

Posted

4 months ago

min $50 USD / hour

I’m seeking an experienced AWS developer to urgently create AWS Cloud Development Kit (AWS CDK) code in Python for an efficient, automated process: - Deploy resources programmatically. - Push S3 bucket logs to Splunk. - Code should have main stack, [login to view URL] and everything has to be parameterized in yaml file. Process: - Logs are stored in S3 bucket. - SNS notifies the lambda - Once lambda gets the notification, lambda should process it to Kinesis stream. - Kinesis stream should process it to kinesis data firehose. - From there it will go to Splunk via HEC Ideal candidate skills: - Proficiency in AWS services, particularly S3, Lambda, and CDK. - Experience with Splunk and integration methods. - Strong Python coding ability. - Understanding of log management & monitoring. - Ability to work quickly with precision. Responsibilities: - Write quality, maintainable Python code using AWS CDK. - Configure S3 bucket for log storage. - Automate transport of logs to Splunk (Note: Method not specified; propose your solution). - Ensure security best practices. - Test solution thoroughly to prevent disruptions. Priority goes to those who can deliver promptly without compromising quality. Please include previous work samples related to AWS and Splunk.

Amazon Web Services

Hadoop

Python

Software Architecture

Project ID: 37725509

About the project

3 proposals

Remote project

Active 4 mos ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@CaptCoonoor

Your project is about using Python and AWS CDK for automated deployment of resources, particularly for transferring S3 bucket logs to Splunk. Develop AWS CDK code: Create Python code to deploy resources, including a main stack, [login to view URL], and YAML parameter file. Configure S3 bucket: Optimize storage and integration with other services. Implement Lambda function: Process log data to Kinesis stream upon SNS notifications. Set up Kinesis stream and Firehose: Handle log transport to Splunk. Integrate with Splunk HEC: Securely transfer logs. Test and validate: Ensure reliability and prevent disruptions. Document and share knowledge: Guide future modifications and scaling. From a proven expeirence with AWS and IaC development for BigData, I think I am well fit for this prokject.

$50 USD in 40 days

5.0

(21 reviews)

4.2

3 freelancers are bidding on average $50 USD/hour for this job

@mallirao1983

As an established AWS expert and software developer, I am confident that I can bring immense value to your S3-Splunk automation project. My extensive experience with AWS services including S3, Lambda, and CDK aligns perfectly with your requirements. Additionally, my proficiency in Python and understanding of log management ensure that I can not only transfer logs to Splunk but also automate the entire process effectively and efficiently. Over 10 years, I have integrated various systems with Splunk including AWS services and handled large-scale log management projects. This hands-on experience makes me exceptionally suited for the task at hand. I understand the importance of a well-documented, parameterized codebase and rest assured, the deliverables will adhere to high quality standards and security best practices. Lastly, my approach is to work agilely without ever compromising on quality. Time is of the essence for you and I appreciate that. Consequently, not only can I deliver promptly but also test the solution extensively to prevent any disruptions in your current ecosystem. My track record in timely project completion is strong, as reflected in my tenure as a freelancer proposed_working_hours

$50 USD in 40 days