Find Jobs
Hire Freelancers

Scality S3 project with MongoDB as a metadata database

$1500-3000 USD

Closed
Posted over 6 years ago

$1500-3000 USD

Paid on delivery
Scality S3 project with MongoDB as a metadata database Scality S3 is an open source Amazon S3 server written in Nodejs. It uses LevelDB for storing objects metadata, which would be useful for small projects however it is not reliable for large-scale projects and data might become inconsistent after a system crash or power failure. Also creating backup is not an easy task and is very tricky. The goal of this project is to replace LevelDB with MongoDB. Scality S3 provided different drivers for handling metadata like bucketfile, in_memory, etc and uses a wrapper to use proper driver according to user configuration. We have to add a MongoDB driver and then set backend metadata to MongoDB in application configuration in order to keep Scality S3 files untouched and add our features. There is another thing to keep in mind that In S3 API there is a function that lists all objects of a bucket with specified limit. Current implementation loads all objects and filters them with application. Although it uses stream, this would definitely makes problem as data grows and creates performance issues. We need to filter data in database layer by passing required filters and using MongoDB aggregate framework to avoid performance problems. Another important thing is that Scality S3 has implemented all amazon features like versioning and ACL, and using MongoDB should not lead to ignoring these features or making them work improperly. To do so, we need to use VersioningRequestProcessor which uses WriteCache and WGM classes and we have to re-implement these classes as well. Finally, the main project modification should be as least as possible in order to keep project updateable and receive latest features and bug fixes.
Project ID: 15343311

About the project

15 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average $2,658 USD for this job
User Avatar
Dear. I am a programmer in china - nodejs expert. I have enough experiences to complete your job. I could help you as well. Relevant Skills and Experience nodejs, mongo db Proposed Milestones $2268 USD - complete I want to chat with you for your details.
$2,268 USD in 30 days
5.0 (243 reviews)
8.4
8.4
User Avatar
Hi, I can write a mongodb driver for Scality S3 project, will create optimised queries for filtering data. Will do the versioning and ACL, whatever Scality has created will be ported to use MongoDB Relevant Skills and Experience 5 Years of experience with nodejs, worked for various backend systems. Will port any metadata to mongodb. Offering 1 year of guarantee on my code. P.S Have read your project description multiple times, found where i can store my wrapper for mongodb, and what methods should i implement. Proposed Milestones $3000 USD - Full task described
$3,000 USD in 20 days
4.8 (50 reviews)
6.8
6.8
User Avatar
yes i have worked on S3 and other amazon web services can we discuss more in details to understand your requirements in more details? Relevant Skills and Experience i have relevant skills and experience as per your project need...i can share some demo as well once i get proper scope. Proposed Milestones $2938 USD - once we discuss scope and based on that i can design all milestone.
$2,938 USD in 30 days
4.9 (3 reviews)
5.2
5.2
User Avatar
Hi, sir. Thanks for your job posting! I am a senior web developer with +6 years experience and your project is very interesting for me. I will do my best for your job. Relevant Skills and Experience PHP/Laravel/Codeigniter/Yii/Symfony Wordpress/Drupal/Joomla HTML5/CSS Angular JS/React JS/Vue JS Website UI/UX design Proposed Milestones $2500 USD - Total milestone Additional Services Offered $100 USD - Publish Do you want me to deploy website to server? If then, I will provide it free. Thanks, Lang
$2,500 USD in 30 days
5.0 (3 reviews)
4.4
4.4
User Avatar
Hi there, I have good experiences on Node.JS, MongoDB and AWS for 3 years up, so I can complete your project as well. Please inform me. Relevant Skills and Experience Node.JS, MongoDB, AWS Proposed Milestones $2500 USD - full
$2,500 USD in 30 days
4.9 (2 reviews)
3.5
3.5
User Avatar
We are a Team of Data Scientists having healthy experience into Big Data technologies like Hadoop,Scala and Spark etc. Relevant Skills and Experience The Team has qualified engineers having expertise in solving complex problems and has worked on many projects. Proposed Milestones $2388 USD - At the end
$2,388 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
We are happy to bid on this project. We provides dedicate developers and Development and design services as well. ***** We are having a great team of Mobile developers with 7-8 years of experience Relevant Skills and Experience node.js,NoSQL Couch & Mongo, Proposed Milestones $2916 USD - Complete project
$2,916 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey There, Thanks for posting this project. I just checked the details of the project and this is something which my company can help you with. Relevant Skills and Experience Square Pixel is a company with a team of 22 in house developers with 6 years of experience. we have a strong hand in Node.js, MongoDB, Angular, Javascript,Ionic apps, Android, IOS, jsand ajax. Proposed Milestones $3000 USD - lets discuss later
$3,000 USD in 45 days
0.0 (1 review)
0.0
0.0

About the client

Flag of GERMANY
Frankfurt, Germany
5.0
5
Member since Apr 19, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.