Senior Detection & Resilience Engineer | Private AI Infrastructure | Virginia – AIONIA
Detection · Resilience · Private AI Infrastructure · Ashburn, VA

Senior Detection & Resilience Engineer

Not an alerting role — a systems-building role. Design and implement the telemetry, detection, and recovery systems that monitor and protect a high-performance AI compute environment at the intersection of security engineering, infrastructure observability, and incident response automation.

$170K – $200K + Equity On-Site · Ashburn, VA Confidential Client Full-Time NDA May Be Required
Apply via AIONIA
The Opportunity

Detection, Containment, Recovery — At AI Scale

We are working with a confidential AI research organization building advanced machine learning systems on highly secure private infrastructure. They are hiring a Senior Detection & Resilience Engineer to design and implement systems that monitor, detect, and respond to threats within a high-performance AI compute environment.

“The goal is not simply alerting — it’s building systems that detect anomalies quickly and recover safely from compromise scenarios.”
Responsibilities

What You’ll Do

Build Security Telemetry Systems

Design and implement logging, monitoring, and signal collection across distributed infrastructure — compute clusters, orchestration layers, and networking systems.

Develop Detection Logic

Create detection mechanisms that identify suspicious activity using behavioral analysis and anomaly detection techniques.

Adversary Simulation & Testing

Partner with teams to simulate attack scenarios and validate detection systems against real-world attacker behavior.

Incident Response Engineering

Build tools and workflows that enable fast investigation and response with minimal disruption to production systems.

Resilience & Recovery Systems

Design systems for rapid containment, isolation, and recovery during compromise or failure scenarios.

Cross-Team Collaboration

Work closely with platform, security, and infrastructure teams to ensure full visibility across the environment.

Requirements

What They’re Looking For

Ideal Profile — Must-Have
Enjoys understanding how systems behave under stress and adversarial conditions
Thinks about attacker movement across infrastructure, not just perimeter defense
Cares deeply about detection, containment, and recovery — not just alerting
Prefers building systems rather than monitoring dashboards
Works effectively with infrastructure engineers in a collaborative, fast-moving environment
Technical Background

Strong candidates typically bring experience in several of the following:

  • Infrastructure monitoring and observability platforms
  • Security detection engineering
  • Incident response automation
  • Linux systems and distributed infrastructure
  • Kubernetes and container telemetry
  • Log pipelines and large-scale telemetry processing
  • Programming in Go, Python, Rust, or similar languages
  • Adversarial thinking or threat modeling (a plus)
Tech & Tools

Technical Domain

Linux Kubernetes Distributed Systems Log Pipelines Telemetry Go Python Rust Threat Modeling
The Organization

About the Opportunity

This role is with a confidential AI research organization building secure, high-performance infrastructure for next-generation machine learning systems. You will work alongside engineers in distributed systems, infrastructure security, and applied machine learning.

Confidential Search

Only shortlisted candidates will be contacted. Selected applicants may be asked to sign an NDA prior to the interview process. This search is conducted exclusively by AIONIA on behalf of the client.