Top Tech Jobs & Startup Jobs in Melbourne

Architect and build a multi-cloud ML training platform for decentralized large-model training and inference across consumer devices and cloud instances. Responsibilities include infrastructure orchestration, distributed compute, GPU workloads, checkpointing, data streaming, network-condition simulation, node-churn management, observability, reliability, and resilient job execution. The role requires strong Python, infrastructure-as-code, Kubernetes, distributed systems, decentralized networking, and SRE experience.

Develop end-to-end reinforcement learning post-training for large language models operating across decentralized, high-latency consumer hardware. Responsibilities include building rollout ingestion, reward computation, policy updates, weight synchronization, asynchronous and off-policy algorithms, evaluation systems, and public model releases. The role requires strong Python and PyTorch engineering, hands-on RLHF/RLVR experience, and research ability in distributed or asynchronous reinforcement learning.

Develop efficient algorithms and systems for verifying untrusted decentralized training and inference. Responsibilities include modeling threats such as poisoning, free-riding, data extraction, and reward manipulation; designing statistically calibrated tests with controlled error rates across heterogeneous hardware; and deploying verification services in production inference systems.

Build and optimize decentralized distributed pretraining systems for frontier-scale models across heterogeneous consumer GPUs and unreliable internet connections. Responsibilities include model, data, and pipeline parallelism; communication optimization; elasticity and fault tolerance; checkpointing and recovery; and monitoring throughput, bottlenecks, and model quality. The role requires hands-on PyTorch distributed training experience, strong production Python engineering, and demonstrated execution through shipped systems, research code, open-source work, or substantial projects.

Build and own a geo-distributed inference stack for reinforcement learning rollouts and future model serving. Responsibilities include pipeline-parallel execution, routing, transport, serving-engine development, failure handling, and designing algorithms for consumer hardware connected over unreliable public networks. The role requires hands-on experience shipping inference systems, research ability in distributed inference or adjacent fields, and expertise with low-bandwidth, high-latency networking.

Build and ship a production project for Agora, a decentralized distributed training system. Develop multiprocessing, asynchronous I/O, and threading components; work with large-scale training infrastructure across AWS and GCP; contribute daily to production code through reviews and mentorship; and present final project results to engineering and research teams.

Conduct novel research in Protocol Learning, focusing on decentralized large-model training and inference across consumer devices. Develop foundational methods addressing communication efficiency, fault tolerance, heterogeneous compute, and malicious participants, with the goal of publishing in tier-1 machine learning venues. Interns own a research problem, leverage significant compute, and receive mentorship from senior scientists during a six-month PhD internship.

Build an end-to-end decentralized RL post-training stack for large language models, including rollout ingestion, reward computation, policy updates, weight synchronization, and evaluation. Develop algorithms for asynchronous, high-latency, partially trusted environments and ship post-trained models as public artifacts. The role requires hands-on RLHF, RLVR, or reasoning-focused RL experience, strong Python and PyTorch engineering, and research capability. Experience with slow networks, decentralized systems, model serving, reward modeling, or P2P networking is advantageous.

Conduct foundational research on Protocol Learning, focusing on communication-efficient decentralized training, convergence under churn and staleness, heterogeneous systems, and malicious-participant robustness. Publish findings in top-tier conferences and collaborate with engineering teams to deploy methods in live frontier-model training runs. The role requires machine learning research excellence, distributed training experience, strong PyTorch skills, and alignment with decentralized AI.

Build and own a geo-distributed inference stack for decentralized reinforcement learning and future model serving. Responsibilities include pipeline-parallel execution, node placement and routing, network transport, serving-engine internals, algorithm development, and failure handling across consumer hardware and unreliable public-internet connections. The role requires hands-on experience shipping large-scale inference systems, research capability in distributed inference or related fields, and expertise in low-bandwidth, high-latency networking.