Site Reliability Engineer (SRE) - K8S/Slurm Job at GMI Cloud, United States

  • GMI Cloud
  • United States

Job Description

About the Company

GMI Cloud is a fast-growing, AI-native infrastructure company delivering high-performance GPU compute, inference services, and infrastructure for AI agents.

Following 8x ARR growth, GMI Cloud continues to scale rapidly across the U.S. and APAC. As a Reference Platform NVIDIA Cloud Partner (NCP) and a validated leading NCP across both markets, we power production AI for leading AI-native companies including Fireworks AI, Cartesia, Reflection, and OpenRouter.

From large-scale compute to optimized inference and agentic workloads, GMI Cloud gives AI teams the infrastructure they need to build, deploy, and scale on one unified cloud.

One cloud for compute, inference, and agents.

Role Overview

We are seeking a skilled Site Reliability Engineer to join the GMI Global Infrastructure team. This role is hands-on and critical to ensuring the stability, efficiency, and reliability of the large-scale high performance AI/ML clusters in our data center. The ideal candidate will bring expertise in system-level troubleshooting, AI cluster maintenance, and operational excellence to ensure maximum performance for our infrastructure. Experience with large-scale infrastructure automation is considered a strong plus.

Responsibilities

  1. Design, implement and maintain scalable AI/ML infrastructure solutions.
  2. Proactively monitor GPU cluster health, performance and troubleshoot issues across compute, accelerator, and storage systems.
  3. Automate deployment, configuration and management of infrastructure resources.
  4. Manage GPU node lifecycle workflows, including provisioning, scaling, maintenance, decommissioning and upgrades of GPU nodes.
  5. Implement CI/CD pipelines for infrastructure deployment and orchestration.
  6. Ensure security, compliance and best practices across infrastructure.
  7. Manage incident response related to Infrastructure resources (GPU, CPU, Storage, Network).
  8. Handle customer provisioning requests for GPU resources, including onboarding, configuration and troubleshooting; resolve customer service requests related to GPU infrastructure, ensuring high customer satisfaction.
  9. Stay current with emerging GPU hardware and software technologies, integrating improvements as appropriate.
  10. Regional/international travel to GMI data center locations.

Qualifications

  1. Bachelor’s degree in Computer Science or related field.
  2. Over 3+ years of experience in data center operations, infrastructure, or systems engineering.
  3. Proven experience in site reliability engineering and infrastructure automation (e.g. Ansible, Terraform)
  4. Familiarity with containers orchestration platform (e.g. Kubernetes, Nvidia GPU operator, Nvidia Network operator, CNI, CSI) and job scheduling systems (e.g. Slurm).
  5. Familiarity with Linux system administration and scripting (Python, Bash).
  6. Familiarity with logging and monitoring tools such as Prometheus, Grafana, Loki.
  7. Good knowledge of GPU architecture, Nvidia CUDA, NCCL, or related AI/ML frameworks - added advantage.
  8. Strong troubleshooting skills and ability to analyze system logs and performance metrics.
  9. Excellent communication and teamwork abilities.

Meeting every qualification is not required—if you’re excited about this role, we’d love to hear from you. We believe diverse perspectives and experiences strengthen our team.

Job Tags

Full time

Similar Jobs

Virtual Vocations Inc

Data Governance Manager Job at Virtual Vocations Inc

 ...Leading the development of enterprise data governance and master data management capabilities, the full-time remote Data Governance Manager will establish policies, manage implementation of a new MDM platform, and enhance data quality and usability across the organization... 

Mullen Law Firm

Litigation Paralegal Job at Mullen Law Firm

 ...Only candidates who reside in New Jersey or New York will be considered for this position. Experienced Personal Injury Paralegal with New Jersey or New York Experience. Remote position. Start at 20 hours, move to full-time if performance meets expectations. Amazing opportunity... 

Mercy

Physical Therapist Assistant Job at Mercy

Assist physical therapists by providing delegated physical therapy procedures, monitoring and documenting patient progress, and adapting procedures within the established treatment plan. Promote patient safety, comfort, and dignity, address age-specific needs, and help... 

Jamul Casino

Slot Supervisor Job at Jamul Casino

 ...Slot SupervisorAt Jamul Casino, we are committed to providing a genuinely fun experience for our valued guests, and our Slot Team...  ...pivotal role in exemplifying our Service Commitment. The Slot Supervisor is responsible for providing designated management of personnel... 

Davey Tree Expert Co.

Utility Tree Trimmer - Climb, Prune & Maintain Lines Job at Davey Tree Expert Co.

 ...Davey Tree Surgery Co. is seeking a utility tree trimmer for on-site outdoor work in the Tampa area. You will climb trees, prune and remove limbs for major electric utilities, and operate chainsaws, chippers and aerial lifts. Safety, teamwork, and adherence to pruning...