AI Infrastructure Operations Engineer - Compute & Storage
- Source: Greenhouse
- Highrise AI
- Hybrid
- United States
- Full-Time
- Mid level
Job Description
About Highrise AI
Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in performance-critical and security-sensitive environments, Highrise delivers scalable GPU compute across dedicated clusters, managed cloud, and confidential environments.
Highrise combines bare-metal performance with full-stack orchestration, API-driven access, and hardware-enforced isolation to support training, fine-tuning, and production-scale deployment of AI models. From reserved GPU capacity to enterprise-grade confidential compute, Highrise provides flexible infrastructure models tailored to the needs of builders operating at scale.
Beyond infrastructure, Highrise integrates disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance across deployments. These capabilities extend beyond Highrise-owned fleets: through managed services, Highrise also operates third-party GPU hardware on behalf of customers and partners, applying the same operational standards to infrastructure it does not own.
Highrise is a subsidiary of Hut 8 Corp., an energy infrastructure platform. Hut 8 integrates power, digital infrastructure, and compute at scale. Highrise serves as the compute and operations layer—designing, deploying, and operating next-generation GPU clusters from commissioning through production.
ROLE OVERVIEW
We are seeking a mid-level AI Infrastructure Operations Engineer to provide Tier 2 operational support for large-scale GPU compute and storage platforms. This hands-on role focuses on owning technical tickets, restoring service, investigating recurring issues, and maintaining reliable day-to-day operation of production AI clusters.
Working closely with the NOC, on-site data hall technicians, SRE teams, and senior infrastructure engineers, the engineer will troubleshoot Linux-based compute nodes, GPU systems, storage services, and their supporting software. Complex or systemic issues will be escalated to Tier 3 engineering with clear diagnostics and supporting evidence.
KEY RESPONSIBILITIES
Tier 2 Incident and Ticket Management
-
Own and manage escalated incidents, service requests, and problem tickets from initial technical triage through resolution, escalation, or documented handoff.
-
Diagnose compute and storage faults using system logs, monitoring dashboards, management interfaces, and approved diagnostic tools.
-
Assess severity and customer impact; coordinate with the NOC and site teams to restore service within operational and SLA targets.
-
Produce clear troubleshooting records, timely ticket updates, shift handovers, and actionable Tier 3 or OEM escalations.
Compute and GPU Platform Operations
-
Troubleshoot Linux servers, GPU health alerts, boot failures, firmware/driver issues, hardware faults, and resource availability problems.
-
Support node provisioning, reimaging, configuration changes, routine maintenance, and return-to-service validation using established automation and runbooks.
-
Investigate Kubernetes and Slurm node or workload failures, working with platform engineers when application or scheduler-level escalation is required.
-
Perform first-level analysis of connectivity or GPU communication symptoms and engage network or Tier 3 engineers for deeper fabric and performance investigation.
Storage Operations and Troubleshooting
-
Monitor and troubleshoot distributed and high-performance storage systems, including capacity, throughput, availability, and client connectivity.
-
Investigate filesystem mount failures, storage-node or disk alerts, degraded services, and access or performance complaints.
-
Execute approved recovery, maintenance, and component replacement workflows with storage vendors and data hall technicians.
-
Support operational tasks across file, object, and block storage platforms as deployed at Highrise sites.
Operational Readiness and Continuous Improvement
-
Assist with upgrades, planned maintenance, cluster expansions, and validation activities following established change controls.
-
Maintain accurate asset, configuration, and ticket records; improve runbooks, troubleshooting checklists, and knowledge articles.
-
Identify recurring incidents and automate repeatable operational work with scripts and existing infrastructure management tools.
-
Collaborate with remote engineering teams, on-site tech…
Skills
- highrise
- NodeJS
- Kubernetes
- object-storage
- Python
- nvidia
- nvidia-gpu
- scaleai
- greenhouse
