Senior Software Engineer – AI/ML Inference Platform

About the role

Dialpad is seeking a Senior Software Engineer to build and operate the shared AI/ML platform that moves model‑backed capabilities from training through production inference. The role focuses on end‑to‑end delivery of reliable, observable, and efficient inference services on GPU infrastructure in GCP.

Key responsibilities

• Design, build, and improve platform capabilities for model training, evaluation, artifact management, release, and production inference.
• Develop and operate shared GPU training infrastructure, improving scheduling, capacity management, storage, networking, and observability.
• Create low‑latency, high‑throughput serving pathways and integrate training frameworks with production requirements.
• Partner with ASR and NLP scientists to translate model advances into scalable production designs and ensure reproducibility, reliability, and cost‑effectiveness.
• Lead technical projects from design through production, mentor engineers, and contribute to architectural decisions.

Required profile

• 7+ years of professional software engineering experience with ownership of backend, infrastructure, distributed, or ML platform systems in production.
• Strong understanding of model‑training workflows, GPU workloads, and production ML lifecycle.
• Hands‑on experience with Linux, containers, Kubernetes, cloud infrastructure (GCP), CI/CD, and deployment automation.

Required skills

• Python, Go (or similar backend language)
• GPU computing (NVIDIA), performance tuning, scheduling, and resource management
• Kubernetes, Docker, Linux administration
• Cloud platforms (Google Cloud Platform)
• CI/CD pipelines and production observability tooling