Senior AI/ML Engineer

About the Role 

We are seeking a senior AI/ML Engineer with hands-on experience in agentic AI to join our team and lead the design, implementation, and evaluation of intelligent agent systems. The ideal candidate will have deep expertise in Large Language Models, RAG architectures, and cloud-based AI solutions with proven ability to deliver end-to-end implementations integrated into real business processes. Strong communication skills and a pragmatic, prototype-driven mindset are essential, while German would be a significant advantage. 

Responsibilities  

Agent Development & Orchestration

• Agent design considering the target architecture, framework, and compliance requirements. Clear delineation of agent vs. non-agent tasks (rule sets, workflows, HTL, etc.).
• Implementation of agents and orchestrators. Integration of the agents into existing process flows, including handover points between agents. Deployment of the agent components according to technical requirements (e.g., Docker). 
• Reference: l1z-QKoLtRi9DRA_3Z2dhs8SQaEg1Yd2SPd0DVoyhNcYU7X-bIiOmNLcMfPDGRDs

LLM Integration & Prompt Engineering

• Selection and integration of suitable LLM providers.
• Development and maintenance of prompts, guardrails, and system instructions.  
• Design of the required interfaces, tools, and user interfaces for the agents. 

RAG & Knowledge Connectivity

• Setup and integration of RAG (Retrieval-Augmented Generation) components for knowledge access.  
• Connection of relevant data sources and peripheral systems to the agents.  
• Ensuring data quality and timeliness in the retrieval process. 

Evaluation & Testing:  

• Testing and evaluation of the Agent systems based on customer requirements: Determining and measuring KPIs (accuracy, speed, cost, reliability).
• Creating sample data (input-output pairs) and describing the expected behavior in collaboration with the BA/customer.
• Documenting learnings and deriving improvement suggestions for the architecture and target state.

Requirements 

AI-specific experience & knowledge 

• AI/ML: Demonstrable experience in developing and implementing AI solutions using Large Language Models, as well as in general in the context of AI and machine learning models.
• Natural Language Processing (NLP): Specific knowledge of processing text data (e.g., for document analysis).
• Large Language Models (LLM): In-depth knowledge of current LLMs, their capabilities and limitations, and demonstrable experience in integrating and utilizing their capabilities within AI application scenarios.
• AIOps: Experience with the lifecycle management of AI/ML models (training, deployment, monitoring)
• Experience with fine-tuning models and self-hosted LLMs.
• Explainable AI: Ability to develop explainable models and present them to stakeholders in a comprehensible manner.
• Agentic AI experience in software selection and AI agent implementation .

Technical Experience & Skills  

• Cloud Platforms: Solid experience in building AI architectures on major cloud platforms – especially Microsoft Azure, including services for AI/ML (certification is a plus).
• Data Architecture: Knowledge of designing and implementing scalable data architectures as the foundation for AI use cases.
• DevOps and CI/CD: Experience with continuous integration/continuous deployment processes and automation tools (Bitbucket/Jenkins/ActifyCory).
• Knowledge of Python and/or Java as the primary development language.
• Experience with SAP is huge advantage.

Soft Skills & Work Style

• Senior-level: Independent, structured work style with minimal need for supervision.
• Ability to communicate complex AI concepts clearly to both business and IT.
• Pragmatic approach: Quickly get prototypes up and running, iteratively improve them.
• Willingness to actively participate in shaping architecture and target architecture decisions.
• Fluent German language or willingness to reach fluency with us in great supportive environment is huge advantage. 

What We Offer 

• Ownership: Genuine architectural responsibility on meaningful systems, opportunity to lead impactful international projects
• Work arrangement: Flexible remote or on-site; premium hardware provided
• Team Culture: Senior-led, high-trust environment with minimal overhead
• Technology: Access to modern technologies and best-in-class engineering practices
• Compensation: Competitive remuneration and a comprehensive benefits package including bonuses, health insurance, allowances

-only shortlisted applications will be contacted. -