Find Jobs
Hire Freelancers

Write Spark Java to read JSON file modify field with UDF then write JSON file

$30-250 AUD

Completed
Posted almost 7 years ago

$30-250 AUD

Paid on delivery
This should be a very simple task for someone who knows Spark programming in Java. This is time-sensitive! This must be completed and delivered within 48 hours of accepting this project. Environment Requirements: - This must be fully written in Java (assume Java 8). - Must run on Windows 10 - Must deliver as a ZIP file containing one root folder (and however many subfolders you need below it) - Must use Ant, so that to run it all I need to do is open the (sub)folder and type "ant". Software Requirements: - Use the new SparkSession type of context - Spark to be in local mode - Open the supplied JSON file "[login to view URL]" (you can put the input file in a subfolder of your deliverable folder and hard code the path) - For every JSON record, call a UDF (that you also write) that will for every element in 'members' array whose 'cond' value is less than 100, assign 'str3' with the concatenated value of 'str1' and 'str2' fields, separated by a period. - Write all of the processed records to a file "output\[login to view URL]" under the deliverable folder.
Project ID: 14138612

About the project

12 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Good evening (or morning) ;) Here is a link to download working solution which is already programmed. I hope you will accept my bid and use it. [login to view URL] Given that you have tight deadline I decided to code it right away. It was not hard. I am developing on Mac. Program works on Mac. I also have Windowes virtual machine. It worked on Windows too but hadoop spit some warning (it did not prevent program to stop). Maybe on your environment it will run without a warning. Java 8 is required. Hope to chat soon.
$55 AUD in 0 day
5.0 (6 reviews)
3.6
3.6
12 freelancers are bidding on average $195 AUD for this job
User Avatar
I am an expert in delivering custom scripts and tools willing to discuss further details about the task.
$155 AUD in 3 days
4.9 (22 reviews)
5.5
5.5
User Avatar
Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of experience of 5 years. b) I work very hard (16+ hours a day and 7 days a week) and also very fast so... it will be done very soon than most of the other providers c) And most important part is my policy: "I will give you (to my client) life time support (as long as you keep relation with me). And fix any bugs/problem without any cost. So, don't ever worry about me” Please sir, leave a reply ASAP, as I am waiting for your kind reply
$250 AUD in 3 days
5.0 (19 reviews)
4.9
4.9
User Avatar
Hi , hope you are doing well i have experience 5 years in software Development using Java i can start from today and show you sample for your requirements Thanks OAtechnology
$50 AUD in 3 days
4.8 (36 reviews)
4.8
4.8
User Avatar
Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further on personal chat. Let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, I use to be online 24x7 on Freelancer so probably you will get a quick response from my end. Following are my Expertise Area: 1) Ruby on Rails 2)PHP with CodeIgniter and Laravel Framework. 3)Node JS 4)Angular JS 5)Mobile App Development 6) Shopify 7)Ruby Thanks :-)
$277 AUD in 3 days
5.0 (1 review)
3.4
3.4
User Avatar
Product Developer (Core JAVA, Hibernate, WebServices ( RESTFul ), AGILE) • 6 years 2 months experience in Product Development & test-suite automation. • Experience in WebService development Core JAVA, Hibernate, and Spring. • ChatBots, Docker, K8S • Involved in complete life cycle of software development. • Worked thoroughly in AGILE methodology. • Exposure to native installation technology (.msi, .rpm). • Knowledge of native UNIX based installers and debugging. • Creating and Publishing Product Hotfix and MR release. • Strong adherence to follow the various processes of software development lifecycle. Technical Skills • Programming Languages – Core JAVA, J2EE, Python Perl, Shell script, VB script, Debugging. • Domain Knowledge – Licensing, Product Development and Installation technology. • Tools & Technologies – Eclipse, IntelliJIdea JBoss AS, Operating Systems Native packaging, QTP. • Other Utilities - InstallAnywhere 6/2011/2012, MKS, Maven, Gradle, Ant, Version Control (SVN Tortoise), Quality Center, ALM, Jenkins/Hudson
$250 AUD in 10 days
5.0 (4 reviews)
2.5
2.5
User Avatar
Hello Sir We are providing services over REST web services based apps + E-commerce apps like Magento, Woocommerce based + Social Networking apps, Geo-Locations based apps, Classifieds apps, + Social Media APIs - FACEBOOK API, TWITTER API, GOOGLE+ API, FLICKR API, + Google Map API, Google Direction and places API + Paypal, Stripe and various payment gateway integration + Apple Push notifications, GCM, Airpush and various others 3rd party push api + SDKs like Admob, Chartboost , Mobclixs , iAds , Flurry, Google Analytics etc. + Magento, Woocommerce, Codeigniter, Core PHP, Wordpress We have large team of iOS developers, Android Developers, Web Developers and Designers who can make your idea to reality and be part of your success. thankx
$155 AUD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Coburg North, Australia
5.0
4
Payment method verified
Member since Aug 25, 2004

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.