Join the award-winning #1 AI-based Shared Inventory for circular supply chains in manufacturing for zero waste industries. ♻️🦾🚀
Full-Time Position
Mannheim / Berlin
YOUR ROLE
You will be tackling an exciting challenge in AI: how to systematically measure and validate LLM performance in industrial settings. As language models transform how manufacturers process and understand their data, you'll develop innovative approaches to ensure reliability and consistency. It's a novel space that combines rigorous testing with creative problem-solving.
We are looking for a Senior Data Scientist (m/f/d) specialized in ML quality assurance to join our award-winning team. You'll pioneer frameworks to validate LLM-based systems, developing novel metrics and methodologies that set new standards for quality in industrial AI applications.
YOUR MISSION
- Design and implement comprehensive validation frameworks for ML models and LLM applications
- Build automated validation suites and establish data quality standards and monitoring systems
- Lead project planning, execution and delivery with strong communication skills, entrepreneurial mindset, and the ability to be responsive and fast-paced in an ambitious environment.
- Architect model evaluation pipelines and create systematic approaches for edge case detection
- Partner with the backend team on ML system integration and data pipeline validation
- Support customer data integration and deliver product demonstrations and POCs
- Drive technical decision-making for ML infrastructure and quality processes
Our current stack:
- Backend: Python, FastAPI
- ML: LLM-based systems, RAG applications
- Infrastructure: ML monitoring and validation pipelines
YOUR PROFILE