MLOps Engineer (all genders), Linz

Responsibilities

Test Strategy & Design: Design, implement, and maintain comprehensive automated test suites specifically tailored for AI/ML systems, covering unit, integration, and end-to-end scenarios. CI/CD Integration: Integrate testing workflows into the Continuous Integration/Continuous Delivery (CI/CD) pipelines, managing regression runs and optimizing testing strategies for the unique characteristics of AI components (model performance, latency, and drift). Model Quality Assurance: Apply knowledge of machine learning and statistics to design meaningful validation tests, interpret model outputs, and continuously assess datasets for quality, completeness, and potential bias or drift. Collaboration & Alignment: Work closely with Product Owners, Technical Leads, Developers, and AI Engineers to ensure testability is baked into the model design from the start, driving continuous improvement in AI-related QA processes. Ethical AI Focus: Actively contribute to implementing and enforcing responsible AI and ethical principles within the QA framework.

Requirements

Testing Proficiency: Proven experience in test automation, quality assurance, or software development, with strong proficiency in Python or a similar programming language. QA & ML Fundamentals: Strong understanding of general QA principles, the Software Development Lifecycle (SDLC), and core machine learning concepts. Metrics Mastery: Knowledge of key ML evaluation metrics and basic statistical methods (e.g., precision, recall, F1 score, AUC) necessary for interpreting and validating model performance. Tool Familiarity: Practical experience with AI evaluation and tracking tools (e.g., MLflow, Weights & Biases) and familiarity with standard automation/CI/CD tools (e.g., Jenkins, GitLab, GitHub Actions). Cross-Functional Collaboration: You possess strong communication and collaboration skills to effectively bridge the gap between AI Engineers (model builders) and Software Engineers (system builders), driving a unified quality standard. Proactive Advocate for Quality: You are a proactive driver of process improvement, always looking for ways to automate testing, increase coverage, and ensure the reliability and ethical soundness of production models.

What we offer

28 days of well-deserved holidays  Onsite Onboarding in our HQ office for an optimal start Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews Public transport friendly office Special terms for local gyms Fresh organic fruits, muesli, soft drinks and snacks for free Access to Corporate Benefits platform with many discounts Regular Team events and company-wide celebrations Open door policy, no dress code rules and frequent all Hands Hybrid and Flexible work time with up to 50% home office Work From Abroad Program allowing up to 40 days of work outside your contracting country We celebrate diversity as one of core values, join and drive one of the c-a-r-e initiatives together with us!

For this position, the collectively agreed minimum salary (IT Collective Agreement) is €3,843 gross per month based on a 38.5-hour work week. Naturally, a market-competitive overpayment is possible depending on your qualifications, professional experience, and overall expertise.