Remote
Remote
Senior
Full Time
💰$143,800 - $231,900
remoteseniorsoftware engineerqualityAILLMagent frameworks
Requirements
- •5+ years as a software engineer
- •Production experience building test infrastructure, developer tooling or internal platforms that other engineers depend on — designed and owned, not just extended
- •Hands-on work with LLMs or agent frameworks: prompt and context design, tool use, handling non-determinism, and evaluating output quality
- •Comfort with distributed systems and CI at scale
- •Ability to drive adoption in teams that don't report to you
What You'll Do
- •Build and operate agents across the testing lifecycle — test design, generation, maintenance, execution and failure triage
- •Own the infrastructure that makes agent-driven testing reliable: environments, test data, tool interfaces, guardrails, runtime and cost control
- •Define how we measure agent output quality, so teams can trust results instead of hand-reviewing them
- •Apply that evaluation practice to testing Camunda 8's own AI capabilities
- •Work hands-on with new features as teams build them, enough to keep the tooling honest
- •Raise the quality capability of teams — patterns, tooling, enablement
Nice to Have
- •Experience evaluating or benchmarking LLM systems
- •Open-source contribution experience
- •Java, TypeScript or Python; Kubernetes and Helm
- •Background in developer tooling or platform engineering
Benefits
- •Remote & Flexible work from anywhere with home office budget, co-working space support, and flexible time off
- •In Person Connection through Annual Kickoff, team offsites, and Camundi Connection Budgets
- •Health & Wellbeing with locally tailored healthcare, Modern Health for global mental wellbeing, and Live Well Lifestyle Spending Account
- •Financial Security with retirement and pension plans, life and disability insurance
- •Professional Growth up to $/€/£1,000 per year for self-driven learning
