Overview

We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities:
  • Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
  • Integrate models and providers into gateway solutions to support enterprise-scale operations
  • Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
  • Establish observability and resilience mechanisms to maintain production stability
  • Implement LLM routing and broker logic to optimize model performance and reliability
  • Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
  • Take ownership of gateway implementation projects and deliver functional solutions rapidly
  • Collaborate with cross-functional teams to align gateway operations with organizational security standards
  • Monitor and troubleshoot production systems to ensure continuous availability
Required Qualifications:
  • 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
  • Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
  • Proficiency in LiteLLM and other LLM gateway platforms
  • Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
  • Understanding of LLM routing, broker logic, and token/rate control mechanisms
  • Skills in observability, resilience engineering, and production system operations
  • Capability to take ownership and deliver functional gateway implementations rapidly
  • English proficiency at B2 level or higher
Benefits:
  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events
  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Four trust days per year for personal needs
  • Discounts for fitness clubs
  • Benefits package (hotels, restaurants, stores and services)
Skills:
  • DevOps
  • Azure AI Content Safety
  • Azure API Management
  • Azure DevOps
  • LLM security
  • Large Language Models (LLM)
  • LiteLLM
Note:

✨ Our intelligent job search engine discovered this job and republished it for your convenience.
Please be aware that the job information may be incorrect or incomplete. The job announcement remains the property of its original publisher. To view the original job and its full details, please visit the job's URL on the owner’s page.

Please clearly mention that you have heard of this job opportunity on https://ijob.am.