Job description
Design and own end-to-end RAG pipelines — from document ingestion and chunking strategy to retrieval evaluation and answer quality
Evaluate, fine-tune, and deploy LLMs (OpenAI, Anthropic, open-source) for domain-specific German-language use cases
Architect robust, scalable AI systems that meet enterprise reliability and compliance requirements
Build evaluation frameworks — automated evals, human-in-the-loop testing, regression suites — to ensure production reliability
Collaborate with fullstack engineers to expose AI capabilities through clean APIs and intuitive product interfaces
Stay current with the GenAI field and translate relevant research into practical product improvements on a short cycle
Requirements & qualifications
What we’re looking for
Technical must-haves
5+ years of software engineering experience, with at least 2 years in applied AI/ML in production
Deep Python fluency — you write clean, testable, production-ready code (not just notebooks)
Hands-on experience with RAG architectures and vector databases (Pinecone, Weaviate, Qdrant, or similar)
Practical knowledge of at least one major LLM provider API (OpenAI, Anthropic, Cohere) and prompt engineering best practices
Strong understanding of MLOps: model versioning, deployment, monitoring, and graceful degradation in production
Experience with orchestration frameworks such as LangChain, LlamaIndex, or similar
Who you are
- You close the research-to-production gap faster than anyone else on the team
- German language on B1 / B2 level and willingness to learn German and to reach a working proficiency level (C1) within 6 months
- Comfortable with ambiguity — you define the problem and propose the solution, not just wait for a spec
- Strong bonus points
- Experience with multilingual NLP tasks, particularly German-language text processing
- Fine-tuning or RLHF experience (LoRA, QLoRA, DPO)
- Knowledge of multi-agent frameworks (LangGraph, CrewAI, AutoGen)
- Background in enterprise AI deployments, information retrieval, or knowledge graphs
- Open-source GenAI projects, technical writing, or community contributions (GitHub, HuggingFace, arXiv)
Benefits
Compensation & Benefits
- €80,000 – €100,000 gross annual salary
- 30 vacation days + German public holidays
- How we work
- Fully remote-first with an international team. Occasional travel to Frankfurt required (up to 4 days/month).
Salary & compensation
Contact information
About Talents2Germany
An IT remote company.