Sr ML Engineer - Remote

We are looking for a senior-level AI/ML professional to lead the productionization, deployment, and continuous optimization of ML systems in mission-critical environments. This role requires strong technical leadership, deep hands-on experience shipping models to production, and the ability to drive reliability, scalability, and cost/performance trade-offs end-to-end. The ideal candidate combines strong ML depth with MLOps and production engineering excellence, and can operate autonomously while influencing architecture and best practices across teams.

• Master’s, PhD, or equivalent experience in Computer Science, Engineering, Data Science (or related), with strong foundations in mathematics, statistics, and ML.
• 6+ years (or equivalent) experience across ML engineering and MLOps /production ML, with a proven track record delivering high-impact systems in production.
• Demonstrated expertise deploying models to production: scalable serving patterns, model packaging, inference optimization, observability, and safe rollout strategies.
• Strong experience with model performance and efficiency optimization: latency/throughput tuning, batching, quantization, ONNX/TensorRT, GPU/CPU optimization, memory and cost tuning.

• Hands-on experience with ML frameworks such as PyTorch, scikit-learn, and optimization/runtime stacks like ONNX, TensorRT.
• Strong grasp of CI/CD for ML (e.g., GitLab CI), containerization (Docker), and reproducible workflows.
• Experience with monitoring and reliability: metrics/logging/tracing, model/data drift, alerting, SLOs, incident response practices.
• Kubernetes, AWS, FastAPI (and/or similar Python serving frameworks), SageMaker, service meshes, feature stores, model registries.

• Handle the production lifecycle of ML systems: training, packaging, deployment, monitoring and controlled rollouts.
• Design, build, and continuously improve training and retraining pipelines (data ingestion, labeling/QA loops, feature generation, experiment tracking,

• Build and improve high-performance inference services and deployment patterns.
• Drive inference optimization (ONNX/TensorRT, quantization, batching, GPU/CPU tuning) with measurable latency/cost improvements.
• Partner with DevOps/SRE to ensure operational excellence: scaling, reliability, incident readiness, observability, and alerting.
• Own model versioning, CI/CD, and release workflows ensuring reproducibility and safe delivery to production.
• Strengthen data & model monitoring (performance, drift, quality) and implement feedback loops for continuous improvement.
• Communicate results and trade-offs to stakeholders, turning technical outcomes into business value.
• Ensure model quality through rigorous evaluation and production-grade validation aligned with evolving data and business needs.

Originally posted on Himalayas