The AI Prompt and Quality Engineer is responsible for monitoring AI Chatbot responses, resolving quality issues, tuning models, analyzing data, and improving processes.
Responsibilities
- Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness.
- Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.
- Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
- Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
- Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Requirements
1. Technical Skills
- Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.
- Basic data-analysis skills; proficient in SQL, Excel, and related tools.
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.
2. Experience
- 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.
- Experience with industry-leading AI Chatbot products is a strong plus.
3. Soft Skills
- Strong communication and collaboration abilities.
- Meticulous, patient, and adept at identifying and solving problems.
- Thrives in a fast-paced environment and demonstrates a strong learning aptitude.
Top Skills
Ai Chatbot
Excel
Machine Learning
Natural Language Processing
SQL
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a front-end engineer, you'll create user-centric interfaces, mentor team members, and shape the architecture for fraud detection platforms.
Top Skills:
JavaScriptJestReactReact NativeTypescriptWebpack
.jpg)
Marketing Tech • Mobile • Software
As a Senior Software Engineer on the Currents team, you'll build and maintain a Kafka-based event pipeline for data export, ensuring high system performance while collaborating with a skilled team and mentoring engineers.
Top Skills:
ConfluentJavaKafkaKotlinReact
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead innovation in metrics prediction, design end-to-end ML solutions, collaborate with stakeholders, and stay updated on ML research to enhance value prediction systems.
Top Skills:
Deep LearningMachine LearningPredictive ModelingXgboost
What you need to know about the Melbourne Tech Scene
Home to 650 biotech companies, 10 major research institutes and nine universities, Melbourne is among one of the top cities for biotech. In fact, some of the greatest medical advancements were conceptualized and developed here, including Symex Lab's "lab-on-a-chip" solution that monitors hormones to predict ovulation for conception, and Denteric's vaccine for periodontal gum disease. Yet, the thousands of people working in the city's healthtech sector are just getting started, to say nothing of the tech advancements across all other sectors.
