Find Jobs
Hire Freelancers

Detect Facial Actions

$30-250 USD

Closed
Posted almost 6 years ago

$30-250 USD

Paid on delivery
I am a machine learning architect, but I do not have time to work on this project. Please read the entire post before applying for the job, and please provide feedback on particular points to increase the chance of being hired. Write a machine learning model, in Keras or Tensorflow, to the following based on one-second of selfie video recordings: 1) Eyebrow raises 2) Eyebrow furrows ( lowering ) 3) Jaw clenching 4) Eye-blinks 5) Looking normal 6) Scrunching face to the left 7) Scrunching face to the right 8) Lowering jaw Data set-up: You'll be given 900 to 1,000 5-second videos of people doing one of these tasks. Your first task is to remove the first and last second of each video, then to split the videos into one-second timeframes. Recommended approach: OpenFace is a library for recognizing facial actions, but it does not use Keras or Tensorflow, so please do not use it. However, there is a lot of open-source code that has already been made to do this. I suggest first using OpenCV to recognize the box-framed area of the face that you want to examine (e.g. eyebrows, jaw, or eyes). There are plenty of tutorials out there for recognizing eyebrows and eyes-blinks from a video. Determine if the eyebrows raise or lower relative to the rest of the structure of the face. You might not even need machine learning for this. For eyeblinks, you should be able to find open-source code that already exists for recognizing them. I would like a model that correctly classifies at least four of these movements versus no movement at all (#5). I will tip an extra $10 for each recognition above 90% accuracy. I am pretty sure detecting jaw clenches is very difficult, so I will tip an extra $60 if you can also get jaw clenches working. I will be keeping some of the dataset to run as a test dataset to ensure your model actually scales. Please write a testing script for me that will take in 5-second videos from my test set and evaluate the accuracy on your model. I would like the model to detect a movement at least 90% of the time (+10 tip per movement above this accuracy). For 80% accuracy, I will pay a $8 tip per movement. Less than 70% accuracy for more than half the movements, I will request a refund and not tip anything. I will also not tip anything if your model produces a false alarm (i.e. detects a movement when there is none) at a rate greater than 15%. The preferred language for this model is javascript, using [login to view URL] and either [login to view URL] or Tensorflow.js. For this, I will tip an extra $30. However, if you are not comfortable with that, then please do it in Python in these libraries: OpenCV, Keras/Tensorflow. I will port them to javascript when you are finished (or you can just do them for a $30 tip) Please message me if there is a different library you would like to use. Please contact me if you have been working on this experiment and believe that you need more data. I can provide you with a small amount of data to get started working today!
Project ID: 17164538

About the project

6 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
6 freelancers are bidding on average $200 USD for this job
User Avatar
Hello mate i am available for your project in least price i am research fellow of ML at my university ping me up if you want your work done
$66 USD in 5 days
0.0 (1 review)
0.0
0.0
User Avatar
hello there, I am doing my post graduation in Data Science. I have used openCv library for feature extraction from images and machine learning library for classification and regression. I am very much interested in this kind of project. could you please share some data so i can get more abstraction about this project. Thanks Jaydeep
$155 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
United States
0.0
0
Member since Jun 13, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.