Need a module which import the csv to sqlalchemy table
1. the csv needs to be validated there are some validation checks that needs to be done
2. the error records needs to be separated and create a new csv file which mentions the error with respect to the record
3. The valid records needs to be inserted to the table
4. The code should be scalable upto 10,000 records
The validation checks
1. Asset ID should be category short name + random 8 digits - flag error
2. Asset ID should not be present in the table - flag error
3. asset ID is not part of CSV file a new ASSET ID is generated and new record is created, this assumes asset category exists - (SHORTNAME + RANDOM 8 DIGITS)
4. asset ID is not provided and asset category is also not provided - flag error
5. category does not exists(CATEGORY_MAPPING) - flag error
6. asset ID is provided and category is not provided - flag error
7. If the required field value is NULL - flag error
The assetId is derived from category 'CATEGORY SHORT NAME MAPPING' + random 8 digits
the 1st 2 characters in asset ID and 'CATEGORY SHORT NAME MAPPING' should match
CATEGORY SHORT NAME MAPPING -
{
“CABINET”:”CA”,
“ROW”:”RO”
“RACK”:AC”
}
Mapping the headers -
{
“Name”:”STD1”,
“Asset Id”:”STD2”,
“Description”:”STD3”,
“Tags”:”STD4”
}
Mapping fields to properties -
{
“STD1”: {
“fieldEnabled”:0,
“fieldMandatory”:1,
“fieldType”:”SELECT”,
“fieldValue”:”CATEGORY_MAPPING”
},
“STD2”: {
“fieldEnabled”:0,
“fieldType”:”ENUM”,
“fieldValue”:”statusEnum”
“fieldMandatory”:1,
“default”:”ACTIVE”
}
}
CATEGORY_MAPPING-
[
“CABINET”:1,
“ROW”:2
“RACK”:3
]
statusEnum -
[‘active’,’inactive’]
This should be blueprint and also should be able to integrate with existing project
Hi
I am a python developer and have previous experience with csv and SQLAlchemy. I am confident to complete the project in an optimized and scalable way InShaAllah.
I look forward and hope that you will message me and discuss more about the project.
Siyam Ahmed
₹5,500 INR in 7 days
5.0 (9 reviews)
4.2
4.2
7 freelancers are bidding on average ₹7,837 INR for this job
If you hire me, maybe your project will be my third project in freelancer.com.
As you can see, my account is like a baby who has just taken the first step.
So this project is very important to me.
Because of this, I am very serious about your project and will do my best.
of course I have many experience in bot development using python selenium.
so I can finish your project for shortly time without any fail.
I can start work as soon as we discuss what you want exactly and what I have to do.
Let's discuss more details about the job if you are interested in me.
Looking forward to hearing from you.
Best regards.
Hello there, I have already done similar work in the past and I can upload your data along with validation checks in a day or two. Actually I have been working as a Python Developer for 3 years and I've worked with Numpy, Pandas, Django and all sorts of data extraction, data cleaning and data visualization projects. I think I have the right skills to cater to your needs. Hope we can connect and discuss the intricate details of your project.
Regards
Ritesh
I have relative experience in numpy and CSVs data, can do this but as it is a lengthy task so 7 days may be required.
bid is of 10000. Hire first pay at end ...
HAMZA...
I am a professional oracle DBA with hands-on experience in MYSQL AND SQL Server 2012/2014/ 2016 extensive knowledge, oracle apps EBS R12.2 with RDBMS 12.1 and EXA - data X4 and X8 I am currently working in a bank in critical situations I have recently upgrade 12.1 to 19c I have also document I can share with you when we will start work on it I have very extensive knowledge please feel free to contact me
Designed and implemented disaster recovery plan using
standby databases with data-guard
Created scripts for database backup, recovery, monitoring
Performed data loads using Data Pump and export/import
utility
setting up a server machine with Linux OS and Oracle database
installation and cloning of Oracle EBS and maintaining.
Taking Backups and Cloning EBS 12,2.6
I'll support you other than this 24/7
I have experience in Data analysis / Data filtering in CSV, TSV, PDF and Word file. Also based on these data, generating JSON. I have experience in creating automation process for these analysis in a large number. Waiting for my turn to discuss the requirement.