Completed

provide script/tool to realtime monitoring linux logfile,extract/parse data from it, then write it to mariadb

freelancer should:

provide script/tool to realtime monitoring linux logfile,extract/parse data from it, then write it to mariadb

script runs on 5 independend linux systems at the same time, single destination mariadb-server

in case sql-server is not reachable, buffer data

resend if server is avail again / buffer data

freelancer must recommend database design

encrypted data transfer (strong encryption / at least TLS1.2 AES-256 or better)

store data in database with exact timestamp (include year)

Example log-lines (no spam):

Sep 6 09:10:19 mx1 postfix/qmgr[5360]: 16264202859: from=<sender@[login to view URL]>, size=148076, nrcpt=1 (queue active)

Sep 6 09:10:19 mx1 postfix/smtp[19044]: 16264202859: to=<info@[login to view URL]>, relay=[login to view URL][0.0.0.0]:25, delay=8.8, delays=8.3/0.02/0.29/0.16, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as AECF51423227)

Expected in database:

timestamp,id,from,to,action

Sep 6 09:10:19,16264202859,sender@[login to view URL],info@[login to view URL],sent

Example log-lines (virus):

Sep 6 09:15:33 mx1 postfix/cleanup[19268]: E4D1E202859: milter-reject: END-OF-MESSAGE from unknown[0.0.0.0]: 5.7.1 virus. (ERR501); from=<badsender@[login to view URL]> to=<sales@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:15:33,E4D1E202859,badsender@[login to view URL],sales@[login to view URL],virus

Example log-lines (spam):

Sep 6 09:06:26 mx1 postfix/cleanup[16855]: B5EDC202859: milter-reject: END-OF-MESSAGE from [login to view URL] [0.0.0.0]: 5.7.1 spam. (ERR123).; from=<spammer@[login to view URL]> to=<sales@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:06:26,B5EDC202859,spammer@[login to view URL],sales@[login to view URL],spam

Example log-lines (blocked attachment):

Sep 6 09:25:28 mx1 postfix/cleanup[19589]: 5F7CF202859: milter-reject: END-OF-MESSAGE from [login to view URL][0.0.0.0]: 5.7.1 attachment blocked. (ERR473); from=<sender@[login to view URL]> to=<recipient@[login to view URL]> proto=ESMTP helo=<[login to view URL]>

Expected in database:

timestamp,id,from,to,action

Sep 6 09:25:28,5F7CF202859,sender@[login to view URL],recipient@[login to view URL],attachment

Skills: Linux, MySQL, Shell Script, System Admin

See more: employee monitoring linux, script monitor services minutes linux, develop tool gui embedded linux, linux log files explained, logging in linux, log analyzer open source, how to analyse log files in linux, linux monitor log file real time, web based log viewer, apache log analyzer mac, json log viewer, perl script import csv mysql linux, perl script check disk space linux, script download email attachment linux, monitoring linux router xen, provide script program, write perl script move files form linux directory, test script tool free, script extract web data yellow page, script auto backup files linux mail report

About the Employer:
( 2 reviews ) Trostberg, Germany

Project ID: #21127320

Awarded to:

shobha1987

Hi, I checked the log format in the log file and also the expected format. I can write the script which extracts logs from the log files and saves to database. I will make it failure safe so in case some error occurs t More

€40 EUR in 3 days
(1 Review)
2.5

17 freelancers are bidding on average €181 for this job

ebonk

Hello, I can develop the log parsing program using Python or PHP. I am expert in Python, PHP. I used to develop config and log parsing programs using PHP and Python. Your requirement implicitly require a message queue More

€200 EUR in 3 days
(12 Reviews)
4.8
ludwig333

♛ Hello, Sir! ♛ Nice to meet you. I am a full web developer with over 5 years on freelancer.com. Very familiar with Website design, JavaScript, Bootstrap, WordPress, Html5, Smart and Creative frontend design, Responsiv More

€140 EUR in 7 days
(19 Reviews)
5.1
loftyara

Hi. Look at ELK - [login to view URL] This is not a traditional database, but in many ways a much more modern and powerful solution. To just write to the database, you can use rsyslog - https://www More

€250 EUR in 7 days
(5 Reviews)
2.9
antima5

Hi, I can do this using ELK stack , log will save in elasticsearch and that will good for analytics. Please get in touch to discuss it in chat. Thankyou

€250 EUR in 7 days
(3 Reviews)
2.6
smartweb4

Hello, I am a senior linux administrator with more than 10 years of experience and I have created hundreds of scripts to automate tasks. I can create a script for your but it will have to be in something else rather t More

€250 EUR in 7 days
(1 Review)
2.4
hengzhulu

Hello Sir. I'm very talented Web developer and I'm very happy to have a chance of bidding your project. I have read carefully the descriptions and understood clearly what you want. You can review my portfolio: https: More

€120 EUR in 4 days
(2 Reviews)
2.0
uzairnaseer920

JUST DO YOUR WORK IN CHEAP RATE. WILL DO LESS THAN BID I hold a degree in Computer Engineering. I minored in Programming with a focus in following skills: Java programming with GUI (JAVA, JAVAFX) Python Programming ( P More

€140 EUR in 7 days
(6 Reviews)
1.9
superdev1888

Hello I am a full-time freelancer with rich experience in PHP / MySQL / MariaDB / Crawling / HTML / Javascript / ... programming. I understood your project basically. I am sure i can complete your project successfully. More

€140 EUR in 7 days
(1 Review)
1.5
agulraze

Dear Employer Thanks for submitting project. Very Short Introduction We are Professional Private Limited Company having international joint ventures and managing offshore companies in UK,USA More

€140 EUR in 7 days
(0 Reviews)
0.0
vishaldhanwan

Hi, I have been working as a PHP/MySQL freelance programmer for 6 years now. I can help you with things like choosing the right framework or technology and guide you in the right direction so that you can have the mos More

€150 EUR in 10 days
(0 Reviews)
0.0
kourlos

hello. I would like to help you with this [login to view URL] cyber security student and Linux [login to view URL] wrote linux script many times

€222 EUR in 5 days
(0 Reviews)
0.0
prasantaghorui

This is Prasanta Ghorui, I.S.P. by CIPS, Canada having total work experience of 15 years into Java / J2ee related technologies and also in PL/SQL. I am holding an Master of Computer Application degree from a renowned u More

€240 EUR in 7 days
(1 Review)
0.0
bhanuxkiran

HI, ELK stack is best suited for log file analysis and visualization. Log files can be in any format. short demo at [login to view URL] Let's discuss more on chat. Thanks -Bhanu

€140 EUR in 7 days
(0 Reviews)
0.0
Gery6

Bitte um ein kleines Gespräch bei Interesse. Preis, sowie Ablieferung kann gerne noch verhandelt werden, je nach dem wie dringend dies benötigt wird.

€250 EUR in 3 days
(0 Reviews)
0.0
€155 EUR in 3 days
(0 Reviews)
0.0
himanshubhati98

We are  providing solutions regarding devops and IT Infrasructure and migration . In our organization all member are having  7+ years of collective experience in linux, Jenkins Aws Google cloud, bash/shell script, kube More

€250 EUR in 6 days
(0 Reviews)
0.0