Multiple employees collaborating on work
Atlassian Logo

Atlassian

Senior Machine Learning Engineer, AI-Native Evaluation & Search

Reposted 16 Days Ago
In-Office or Remote
Hiring Remotely in IN
Senior level
In-Office or Remote
Hiring Remotely in IN
Senior level
Develop and productionize machine learning systems for search, retrieval, ranking, recommendations, conversational experiences, and AI agents. Own projects across the ML lifecycle, build evaluation datasets and benchmarks, conduct offline and online evaluations, analyze model quality, and improve system performance. Design scalable architectures addressing reliability, latency, privacy, and cost. Collaborate across product and engineering teams, communicate technical decisions, mentor engineers, and contribute to ML best practices.
The summary above was generated by AI
Engineering | San Francisco, United States | Remote, Remote | Mountain View, United States or Remote | Seattle, United States
Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian's AI products.
Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.
Your role and impact
You will develop and productionize machine learning systems for search, retrieval, ranking, conversational experiences, and AI agents. You will own projects across the ML lifecycle, from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.
A key part of this role is making evaluation a first-class part of AI development. You will help define quality, build evaluation datasets and benchmarks, analyze model behavior, and use results to guide product and engineering decisions.
You will collaborate with product managers, software engineers, data scientists, research scientists, and platform teams. You will independently solve complex problems, contribute to technical direction, and mentor other engineers.
What you'll do
  • Build and productionize machine learning models and AI systems for Search & Intelligence products.
  • Own projects from concept through deployment, monitoring, evaluation, and iteration.
  • Develop AI-native experiences across search, retrieval, ranking, recommendations, conversational systems, and agentic workflows.
  • Design evaluation-driven development processes, including quality metrics, test cases, benchmarks, and acceptance criteria.
  • Build evaluation datasets, regression suites, and pipelines for search, RAG, chat, and agentic systems.
  • Conduct offline and online evaluations, human assessments, model-based evaluations, and error analysis.
  • Design scalable architectures that meet requirements for quality, reliability, latency, privacy, and cost.
  • Apply modern techniques in information retrieval, ranking, embeddings, NLP, deep learning, and large language models.
  • Communicate technical decisions and results clearly across technical and non-technical audiences.
  • Mentor engineers and contribute to engineering and ML best practices.

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range.
Please visit

Similar Jobs at Atlassian

2 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead technical pre-sales engagements for large LATAM enterprise customers. Partner with account teams and channel partners, conduct Spanish-language discovery sessions and demonstrations, advocate for Atlassian Rovo and Teamwork Graph, architect customized solutions, and translate complex business challenges into measurable customer value. Build executive relationships, influence cross-functional teams, provide market feedback to Product Management, and support complex, high-stakes enterprise deals.
Top Skills: Artificial IntelligenceAtlassian RovoCloud Software PlatformsTeamwork Graph
2 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and improve Confluence AI experiences across frontend, backend, and AI integrations. Own features from design through launch, apply generative AI, retrieval, agents, and evaluation techniques, create automated quality testing, monitor production performance, run adoption experiments, and collaborate cross-functionally. Mentor engineers and contribute to architecture, observability, testing, safeguards, and scalable software delivery.
Top Skills: Ai AgentsAutomated EvaluationBackend DevelopmentFrontend DevelopmentGenerative AiInformation RetrievalMachine LearningObservabilityProduction Monitoring
2 Hours Ago
In-Office or Remote
Entry level
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead strategy and execution for an open-weight LLM inference platform. Manage GPU capacity, inference optimization, model migrations, availability, benchmarking, governance, cost efficiency, and model selection. Translate business goals into technical priorities, develop roadmaps and cost models, and coordinate engineers, architects, security, legal, finance, product, and external cloud or GPU partners.
Top Skills: Cloud InfrastructureGpu Capacity PlanningInference OptimizationLlm Inference PlatformsModel BenchmarkingOpen-Weight ModelsOss Models

What you need to know about the Melbourne Tech Scene

Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account