Job description

Design and own end-to-end RAG pipelines — from document ingestion and chunking strategy to retrieval evaluation and answer quality

Evaluate, fine-tune, and deploy LLMs (OpenAI, Anthropic, open-source) for domain-specific German-language use cases

Architect robust, scalable AI systems that meet enterprise reliability and compliance requirements

Build evaluation frameworks — automated evals, human-in-the-loop testing, regression suites — to ensure production reliability

Collaborate with fullstack engineers to expose AI capabilities through clean APIs and intuitive product interfaces

Stay current with the GenAI field and translate relevant research into practical product improvements on a short cycle

Requirements & qualifications

What we’re looking for

Technical must-haves

5+ years of software engineering experience, with at least 2 years in applied AI/ML in production

Deep Python fluency — you write clean, testable, production-ready code (not just notebooks)

Hands-on experience with RAG architectures and vector databases (Pinecone, Weaviate, Qdrant, or similar)

Practical knowledge of at least one major LLM provider API (OpenAI, Anthropic, Cohere) and prompt engineering best practices

Strong understanding of MLOps: model versioning, deployment, monitoring, and graceful degradation in production

Experience with orchestration frameworks such as LangChain, LlamaIndex, or similar

You close the research-to-production gap faster than anyone else on the team
German language on B1 / B2 level and willingness to learn German and to reach a working proficiency level (C1) within 6 months
Comfortable with ambiguity — you define the problem and propose the solution, not just wait for a spec
Strong bonus points
Experience with multilingual NLP tasks, particularly German-language text processing
Fine-tuning or RLHF experience (LoRA, QLoRA, DPO)
Knowledge of multi-agent frameworks (LangGraph, CrewAI, AutoGen)
Background in enterprise AI deployments, information retrieval, or knowledge graphs
Open-source GenAI projects, technical writing, or community contributions (GitHub, HuggingFace, arXiv)

€80,000 – €100,000 gross annual salary
30 vacation days + German public holidays
How we work
Fully remote-first with an international team. Occasional travel to Frankfurt required (up to 4 days/month).

Talents2Germany

An IT remote company.

Ogechi Human Resources · Talents2Germany

Interested in this position? Apply directly to Talents2Germany — no account required.