Benefits:

401(k)

401(k) matching

Bonus based on performance

Job Title: AI Tools & Reliability Engineer Location: Remote

Key Responsibilities

Monitor the health, performance, and reliability of AI/ML applications.

Work with AI tools such as LangSmith, PromptFlow, OpenTelemetry, and similar platforms.

Set up and maintain monitoring, logging, and alerting for AI applications.

Track AI model performance, response time, errors, and availability.

Monitor token usage and AI/API costs.

Troubleshoot issues related to AI applications and cloud environments.

Create dashboards and reports for AI performance and reliability metrics.

Support AI evaluations (Evals) to check the quality and accuracy of AI responses.

Work with cloud monitoring tools such as AWS CloudWatch and Azure Monitor.

Collaborate with AI/ML engineers, DevOps, and cloud teams.

Thanks & Regards

Bhanu Prakash

DeltaSoft Solutions

bhanu.prakash@deltasoftgroup.com

This is a remote position.