Find Jobs
Hire Freelancers

Remove and encrypt keys and values on 15GB JSON file (from bz2) - 10/01/2020 16:45 EST

€30-250 EUR

Completed
Posted over 4 years ago

€30-250 EUR

Paid on delivery
I have a 15GB files in BZ2. I need them first converted into JSON format (they aren't yet marked as JSON), using the following linux/unix commands (my computer doesn't have enough space to do it) after the tar ball has been extracted just through double click: Move all export subfiles into one folder find . -name \*.bz2 -exec cp {} ../target \; Unzip them to (unmarked) JSON cd target find . -type f -exec bzip2 -d {} + (if too large) Bringing JSON into one file cat * > [login to view URL] This massive array of values follows a fairly standard structure - but isn't quite JSON yet. Giving export valid JSON commas: tr '\n' ‘,\n’ < [login to view URL] > [login to view URL] Add JSON array elements to start and end of file echo “[” >> [login to view URL] cat [login to view URL] >> [login to view URL] echo “]” >> [login to view URL] THE ABOVE WILL TAKE SOME COMPUTE POWER/TIME AS ITS A MASSIVE FILE. Then, you should be left with a format like the attached picture. From here, kindly scramble the names of all keys in a standard way (i.e. they're all the same) and give me the translations in a separate text file. For the "bettingType", "marketType", "name" and "eventName" elements, please scramble the VALUES in a standard way also. There are "name" elements at two different levels, please scramble both. As well as the translation file, please provide me with the code you used to do the above. As with the text transformations, it will take a while as its a large file. Then send it back to me via your preferred means - zip whatever, as long as the file within stays the same.
Project ID: 23322703

About the project

9 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello sir, I am a DevOps Engineer that uses json parsing tools regularly to transform json files. I will use the jq bash command tool to parse your files according to your requirements
€138 EUR in 2 days
4.9 (63 reviews)
5.5
5.5
9 freelancers are bidding on average €149 EUR for this job
User Avatar
I am interested in the task. Related experiences: Linux / bash. Awaiting of your kind reply in case of possible selection.
€60 EUR in 1 day
5.0 (13 reviews)
4.6
4.6
User Avatar
I am good in powershell, json along with automation and development Are you ok with windows powershell? if you are ok please provide some sample input file I will make a powershell script to convert normal text file to - json, and extract the data from json to separate file based on your needed Once demo version ready you can run the powershell script against 15GB source file and convert I will give the document and guide how to use Please let me know
€150 EUR in 7 days
5.0 (14 reviews)
4.4
4.4
User Avatar
I am a python expert and I am very familiar with data processing. I am so interested in your project. Please contact me and discuss more so that I can deliver this job.
€200 EUR in 2 days
3.5 (17 reviews)
5.4
5.4
User Avatar
i am expert in python i have almost about 2 year experience as Python Developer i did lots projects on python dill completed dead lines of projects on time i really serious about my responsibilities and work towards my projects i did work on ML and tensorflow and Django also i had learnt js and Html also since 5 month i am working in my company as a stack full Developer i am working with a broadcasting comapny so i also know about the OTT services work and Live Streaming Work and Transcoding also. i had work on many modules like Requests ,bjoern,Open Cv and tensorflow and Django,AWS, flask,rest Framework,mongodb,hadoop(Big Data) also
€140 EUR in 7 days
5.0 (3 reviews)
1.5
1.5
User Avatar
Hello there! I have carefully gone through your job post and understood your requirements. I am offering you my quality service. You can check my profile & portfolio for details about my experiences. If you give me the opportunity, I’ll provide you quality service according to your instructions within your expected budget & estimated time. We can discuss it more over chat and also can show you my plans as well as previous work samples. I am waiting for your positive response. Thanks! Best Regards, Md Zaidur R.
€140 EUR in 7 days
5.0 (2 reviews)
1.2
1.2
User Avatar
i read your project and understand your requirements. i can complete this task because i have big RAM memory in my system and big computation power. i have experience in script writing send me message so we i can start working on this
€166 EUR in 2 days
5.0 (1 review)
0.4
0.4
User Avatar
Dear I have read your description carefully to get a clear understanding of what you want and what I should achieve. Now I want to say that I am really interested in your task and I can do it successfully. I have been creating high quality and excellent web site, PWA and Single Page App(SPA) for 7+ years using Django, Flask, Laravel, React JS, Angular JS, Vue JS,… I have developed all kinds of the web application including a dating site, live casino site, e-commerce site, Admin site, Social site, Video Streaming site … I'm expert in Geo-location, GPS tracking, Payment gateway integration, Stripe, Block Chain combination, POS, and Social media integration such as Facebook, Twitter and so on. I have good experiences in Firebase, Twillio Api, QuickBox, AWS and so on. review my work on my profile. Let's have a talk for more detail Regards. :) The important thing is that I'll work in your time zone for good communication. If you choose me, you'll never be disappointed in me, and I'll do my best. I can provide daily updates for the project status.
€250 EUR in 7 days
0.0 (0 reviews)
1.4
1.4
User Avatar
Hello... i can help you with that. Can't give an accurate delivery date due to the nature of the task, but i'll be using a good hardware setup for it... please send a message and give some more details, and we can talk about a good way to "scramble" the data, to make it less cpu-intensive when you have to import it
€100 EUR in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of IRELAND
CASTLEBAR, Ireland
5.0
11
Payment method verified
Member since Sep 2, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.