Find Jobs
Hire Freelancers

Opportunity for MLOPS Engineer: Serve a wav2vec Speech Recognition Model through Triton Server

$250-750 USD

Closed
Posted about 1 year ago

$250-750 USD

Paid on delivery
We are looking for a talented MLOPS engineer to work on a challenging speech recognition project. The project has a tight deadline of 5 days. The tasks involved are: Based on the wav2vec2 model available in the repository lgris/wav2vec2-large-xlsr-open-brazilian-portuguese-v2, convert it to ONNX and TensorRT Evaluate the WER of the model in TensorRT compared to the original model in Hugginface Create a Dockerfile with the Triton server configured with an endpoint to consume the model in TensorRT Create a Dockerfile with a Python server using [login to view URL] to send audio to the Triton server for inference Create a Dockerfile with a JavaScript client sending audio from the microphone to the Python server, from Python to the Triton server through GRPC, and back to the browser with the transcription Create a Docker Compose file with the three services communicating with each other and ready for testing Compare the inference times of the PyTorch model served directly from Python, the TensorRT model served directly from Python, and the model served through the TensorRT server Evaluate the latency of the communication between the Python server and the TensorRT server The goal is to perform audio inference captured from the user's microphone in browser through [login to view URL] communication with the Python server and then from this to the Triton server to be able to receive multiple concurrent requests from different users Attention should be paid in the Python server to have a session for each user, so that the streaming audio can be returned to the user who sent the audio. If you have the skills and experience to tackle this project, we would love to hear from you. Please apply with your portfolio and relevant experience. Time is of the essence, so apply as soon as possible.
Project ID: 35917970

About the project

13 proposals
Remote project
Active 1 yr ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
13 freelancers are bidding on average $681 USD for this job
User Avatar
Hello Good evening , I just finished reading the job description . I see you are looking for someone experienced in developing products using NLP, Python, DevOps, Software Architecture and JavaScript. This is something I can do, Please review my profile to confirm that I have great experience working with these tech stacks. While I have few questions: 1. These are all the requirements? If not, Please share more detailed requirements. 2. Do you currently have anything done for the job or it has to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) My Portfolio: https://www.freelancer.com/u/AwaisChaudhry Please start the chat to discuss it further. Regards, Awais
$750 USD in 18 days
4.9 (117 reviews)
8.5
8.5
User Avatar
Nice to talk you felipeniren, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I am the lead engineer for DS Pro IT agency. I have worked for over 10 years in Backend and software development and have successfully done multiple jobs. It will be a pleasure to work together to make your project a reality. Please feel free to contact me. I´m looking forward to working with you. I really appreciate your time and remain attentive to any request or question. Greetings
$624 USD in 7 days
5.0 (6 reviews)
5.6
5.6
User Avatar
Hello, I read your project details and really interested in your mentioned job. I have 5+ years’ experience doing similar jobs related to these skills NLP, Python, DevOps, Software Architecture and JavaScript. I think its doable job, and really confident to do that. Please start the chart so we have detail discussion about task and finalize it as per your timeline. Regards Umair
$750 USD in 6 days
4.9 (22 reviews)
4.9
4.9
User Avatar
Hello. As a Professional NLP Engineer, I have strong knowledge and rich experience with Python, Pytorch, Tensorflow, NLP, ChatBot, OpenAI ChatGPT, Fine-tuning the OpenAI API model, ASR(Automatic Speech Recognition using Kaldi), TTS, STT, State-of-the-Art NLP models such as BERT, XLnet, PalM, HuggingFace, TalkNet, TalkNet2, ConVoiceNet. I also always make reusable clean codes. I can start working immediately and work full time on your timezone. I think I am a great fit for this project. Looking forward to working with you. Thanks.
$500 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of BRAZIL
Petrópolis, Brazil
0.0
0
Member since Feb 5, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.