Menlo Security Inc. Logo

Menlo Security Inc.

AI Systems Engineer

Posted 18 Days Ago
Remote
Hiring Remotely in Greece
Senior level
Remote
Hiring Remotely in Greece
Senior level
Build and scale low-latency AI serving infrastructure for SLMs, prompt-injection engines, and classification services. Architect GPU-accelerated inference pipelines, backend microservices, Kubernetes clusters, rate limiting, tenant guardrails, monitoring, and autoscaling systems. Develop continuous evaluation, retraining, model CI/CD, regression gates, and MLOps/LLMOps pipelines while improving service reliability, latency, cost efficiency, and detection quality.
The summary above was generated by AI

Menlo Security is the leader in Browser Security for human and agentic workforces. Our mission is to enable humans and agents to connect, communicate, and collaborate securely, without compromise. The Menlo Browser Security Platform protects organizations from cyberattacks by stopping threats across the web, documents, and email before they reach the user. With Menlo Agent Runtime Security (MARS), that protection now extends to the AI agents working alongside every employee. Menlo Security is trusted by major global businesses, including Fortune 500 companies and government agencies, to protect their most valuable asset, their data, and is backed by top-tier investors.

We are seeking an AI Systems Infrastructure Engineer (IC4) to lead the platform and backend architecture powering our real-time security detection services. In this role, you will build and scale low-latency serving infrastructure for Small Language Models (SLM), Prompt Injection (PI) engines, and Content / Intent Classification platforms running across GPU and cloud clusters. We are looking for a strong systems engineer who understands production backend services, microservices, container management, and high-throughput inference optimization. While you will work closely with ML researchers, your primary focus will be engineering robust backend services, GPU replica scaling, guardrails, and automated evaluation infrastructure.

Outcomes & KPIs Key Outcome(s) Owned:

  • Sub-hundred-millisecond SLM and detection service execution speeds across high-volume tenant workloads.

  • Highly resilient, auto-scaling GPU inference cluster infrastructure with automated CI/CD and regression gating.

Success Metrics / KPIs:

  • P95 and P99 detection latency for prompt injection (PI) and classification services.

  • GPU pod readiness time and cluster auto-scaling efficiency under burst traffic.

  • Service availability and rate-limiting guardrail enforcement per tenant.

  • Automated MLOps/LLMops pipeline throughput and deployment turnaround time.

What You'll Do

  • Architect, build, and optimize production serving pipelines for Small Language Models (SLMs) and traditional ML models using model quantization, batching, and GPU acceleration.

  • Own and scale backend microservices (e.g., sds-service-prompt-injection, sds-service-ddr) delivering real-time threat detection.

  • Build consumption-based monitoring, tenant rate-limiting, and runtime guardrail infrastructure.

  • Manage and optimize GPU cluster replicas (Kubernetes / Pod infrastructure) to minimize cold-start times and manage infrastructure costs.

  • Build continuous evaluation, automated retraining pipelines, model CI/CD, and automated regression gates to test model detection quality against live benchmarks.

  • Refactor legacy service boundaries, service-to-service auth flows, and backend database configurations.

Requirements:

  • 5+ years of software engineering experience building distributed backend systems or high-throughput microservices.

  • Proven track record in model serving and inference optimization (e.g., TensorRT, vLLM, ONNX Runtime, Triton Inference Server).

  • Strong programming experience in Python, Go, or C++.

  • Hands-on expertise with Kubernetes, container orchestration, GPU scheduling, and infrastructure auto-scaling.

  • Solid understanding of CI/CD pipelines, MLOps/LLMops principles, and cloud infrastructure (AWS/GCP).

Preferred / Nice to Have:

  • Experience building consumption-based rate limiting or multi-tenant guardrail architectures.

  • Familiarity with database refactoring, auth protocols, and backend technical debt remediation.

  • Background in cybersecurity, threat detection engines, or DLP/PII filtering platforms.

  • Experience benchmarking runtime vs. accuracy trade-offs between local SLMs and cloud LLMs (e.g., Vertex AI).

  • Experience with AWS, GCP, Terraform, Kubernetes, and Linux.

Follow us on LinkedIn!

Why Menlo?

At Menlo, we don't settle for the status quo — in our technology or our culture. How we think and act is just as important as what we build. Our culture is defined by five core mindsets: Proactive Leadership, Straight Talk, United Impact, Elevated Talent, and Customer-Compelled. We take ownership and drive outcomes without waiting to be told. We communicate directly and seek hard truths. We break down silos and win together. We hold a high bar for ourselves and the people around us. And we treat every customer interaction as mission-critical. If you're someone who sees it, owns it, solves it, and does it — you'll thrive here.

All qualified applicants will receive consideration for employment without regard to race, sex, color, religion, sexual orientation, gender identity, national origin, protected veteran status, or on the basis of disability.

TO ALL AGENCIES: Please, no phone calls or emails to any employee of Menlo Security outside of the Talent organization. Menlo Security’s policy is to only accept resumes from agencies via Ashby (ATS). Agencies must have a valid services agreement executed and must have been assigned by the Talent team to a specific requisition. Any resume submitted outside of this process will be deemed the sole property of Menlo Security. In the event a candidate submitted outside of this policy is hired, no fee or payment will be paid.

Similar Jobs

An Hour Ago
Remote or Hybrid
Junior
Junior
Automotive • Fashion • Retail
Design and build end-to-end production AI systems spanning backend services, data pipelines, APIs, agentic workflows, knowledge architectures, and cloud infrastructure. Develop LLM and retrieval applications, integrate structured and scientific data, establish reliability and observability practices, and make architectural decisions across scalability, security, performance, and maintainability. Collaborate with data scientists, bioinformaticians, product managers, and engineers to move AI prototypes into dependable production systems.
Top Skills: Agentic WorkflowsAWSAzureClaude CodeCursorDjangoDockerEltEmbeddingsETLFastapiFlaskGCPGithub CopilotKnowledge GraphsKubernetesLlm ApisNoSQLPostgresPythonRetrieval-Augmented GenerationSearch SystemsSQLVector Databases
7 Days Ago
Remote or Hybrid
Mid level
Mid level
Fintech • Financial Services
Administer and integrate enterprise AI platforms (Microsoft Copilot, Copilot Studio, Azure OpenAI), design and manage AI agents and automations, implement secure API and SSO integrations, deploy MCP servers, monitor and optimize AI services, collaborate on governance, licensing, capacity planning, documentation, training, and platform roadmap activities.
Top Skills: Agent BuilderAzure Ai SearchAzure OpenaiAzure Openai ServiceClaudeConditional AccessCopilot StudioData Loss Prevention (Dlp)Entra IdGeminiIntuneJIRAMicrosoft 365 CopilotMicrosoft GraphModel Context Protocol (Mcp)OauthOpenaiPower AutomatePower PlatformPowershellPythonSensitivity LabelsServicenowSharepointSingle Sign-On (Sso)
2 Hours Ago
Remote or Hybrid
Expert/Leader
Expert/Leader
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads AI product development for Pfizer’s Office of the CEO, from evaluating ideas and defining ROI through specification, delivery, adoption, and measurement. Partners with engineering and senior stakeholders to prioritize use cases, reuse enterprise capabilities, establish acceptance criteria, govern decisions, and ensure products achieve measurable outcomes. The role also builds organizational capability by involving idea originators, documenting lessons, and promoting self-sufficiency across OCEO groups.
Top Skills: Ai AgentsAi AssistantsArtificial IntelligenceEnterprise Platforms

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account