Skip to content
All roles
AI Engineering

Senior AI/ML Engineer

Seniorfull-timeRemote (Global)$175k–$240k + equity
As a Senior AI/ML Engineer at Overnox, you'll be a core builder on our AI engineering team, turning client problems into production AI systems that deliver measurable outcomes. You'll work across the stack — data pipelines, retrieval, model integration, agent orchestration, evaluation, and deployment — shipping features that go straight into the hands of enterprise users. You'll partner closely with Staff engineers and directly with client teams, owning meaningful slices of architecture and making sound engineering decisions with real autonomy. The work spans the full modern GenAI toolkit: building RAG systems over proprietary corpora, designing agentic workflows and tool integrations, standing up evaluation pipelines, and, where it moves the needle, fine-tuning or distilling models. Because Overnox works with startups through regulated enterprises, you'll learn to build AI that isn't just clever but secure, cost-aware, and reliable in production. This role matters because founding engineers who can take an ambiguous requirement and ship a robust AI system — with evals, guardrails, and observability baked in — are how Overnox earns and keeps client trust. You'll grow fast here, with senior peers to learn from and a steady stream of hard, varied problems to solve.

What you'll do

  • Design, build, and ship production LLM features: RAG pipelines, agentic workflows, tool/function calling, and integrations against client data sources and APIs
  • Build and maintain evaluation suites and quality dashboards so changes ship with measurable evidence of improvement
  • Implement retrieval quality improvements — embedding models, chunking strategies, reranking, hybrid search — and tune systems for cost, latency, and accuracy
  • Fine-tune, distill, or adapt models (including open-weight models) when it delivers clear value over prompting alone
  • Instrument systems with tracing, token/cost tracking, and monitoring; participate in on-call and incident response for AI services
  • Collaborate with client engineers and Overnox delivery leads to scope work, review designs, and integrate AI systems into existing products
  • Write clean, well-tested Python/TypeScript and contribute to shared internal libraries, patterns, and playbooks

What we're looking for

  • 5+ years of software engineering experience, including 1.5+ years building LLM/ML systems in production
  • Strong Python (and ideally TypeScript) skills and solid CS fundamentals — data structures, APIs, testing, and data pipelines
  • Hands-on experience with LLM provider APIs (OpenAI/Anthropic) and at least one orchestration framework, plus practical work with vector databases and embeddings
  • Demonstrated experience building RAG or agent systems and reasoning about their failure modes
  • Experience writing evals or systematic tests for non-deterministic model behavior
  • Comfort deploying services on AWS, GCP, or Azure with containers (Docker) and CI/CD
  • Clear communicator who can work directly with clients and explain technical tradeoffs to mixed audiences

Nice to have

  • Experience with fine-tuning frameworks (LoRA/PEFT), Hugging Face, and self-hosted inference (vLLM, TGI)
  • Classical ML background (scikit-learn, PyTorch, MLflow) alongside GenAI work
  • Familiarity with prompt-injection defenses and AI security basics
  • Prior client-facing or startup experience shipping under real deadlines

About Overnox

Overnox is an AI engineering and infrastructure consultancy. We help startups and enterprises securely adopt AI, automate operations, and scale cloud infrastructure with enterprise-grade engineering — building, securing, and operating production AI systems as one accountable senior team. Security-first, product-minded, no outsourcing.

What we offer

  • Fully remote — work from anywhere, with a few hours of overlap for collaboration
  • Competitive base plus meaningful equity in the company you're helping build
  • Senior-only team — real peers, no juniors to babysit, no offshore handoffs
  • Top-tier hardware and a generous learning, certification, and conference budget
  • Direct ownership of outcomes and a genuine say in how we build and operate
  • Region-appropriate health, time-off, and wellbeing support

Compensation

The listed range ($175k–$240k + equity) is a good-faith estimate. Final compensation is based on your experience, level, and location, and includes meaningful equity. We benchmark pay against the market and review it regularly.

Equal opportunity & accommodations

Overnox is an equal opportunity employer. We celebrate diversity and are committed to an inclusive environment for everyone. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, veteran status, or any other characteristic protected by applicable law.

If you need a reasonable accommodation at any point in the application or interview process, email hello@overnox.com and we'll work with you.

Apply for this role

Attach your resume and tell us why you're a fit.