Optimize and compress large language and vision models for on-device inference. Develop distillation and hardware-specific compilation pipelines, deploy models to edge devices, and benchmark performance across NPU/GPU architectures to ensure efficient on-device operation.
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar Jobs
Agency • Artificial Intelligence • Blockchain • Web3
Perform adversarial testing and red-teaming on large language and multimodal models, implement runtime guardrails and filtering, and help develop constitutional AI principles and RLHF alignment pipelines to ensure safe AI deployment.
Top Skills:
Adversarial MlConstitutional AiJailbreak TaxonomiesLlmsMultimodal AgentsPrompt EngineeringRed-Teaming FrameworksRlhf
.png)
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Leads Square’s partnerships strategy across Australia and Japan, building and scaling relationships with financial institutions, technology platforms, distributors, and other strategic partners. Owns partner-driven seller acquisition, revenue growth, product adoption, ecosystem expansion, negotiations, and portfolio performance. Develops executive relationships, influences product and go-to-market strategy, and leads a distributed regional partnerships organization while collaborating across Sales, Product, Marketing, Engineering, Finance, Legal, and Operations.
Top Skills:
Payments TechnologyProduct IntegrationsSaaS
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Manage disposal of surplus inventory and quarantine defective, deficient, or damaged items supporting Australia’s F/A-18F Super Hornet and EA-18G Growler fleets. Responsibilities include assessing inventory impacts, preparing approval documentation, recommending compliant disposal methods, maintaining audit readiness, and coordinating with logistics, engineering, supply chain, and customer stakeholders. The role also provides status reporting and risk notifications while ensuring adherence to defence policies and Commonwealth requirements.
Top Skills:
DeflogmanEscmMilisSap S/4Hana
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
