Senior GenAI Engineer — LLMs - RAG - Python (f,m,d) — Remote in Germany at Talents2Germany in Hessen, Germany (full-time)

  • Talents2Germany
  • Hessen, Germany
  • Posted July 20, 2026
Full-time hybrid $under 25000 / year
Apply now

Job description

Design and own end-to-end RAG pipelines — from document ingestion and chunking strategy to retrieval evaluation and answer quality

Evaluate, fine-tune, and deploy LLMs (OpenAI, Anthropic, open-source) for domain-specific German-language use cases

Architect robust, scalable AI systems that meet enterprise reliability and compliance requirements

Build evaluation frameworks — automated evals, human-in-the-loop testing, regression suites — to ensure production reliability

Collaborate with fullstack engineers to expose AI capabilities through clean APIs and intuitive product interfaces

Stay current with the GenAI field and translate relevant research into practical product improvements on a short cycle

Requirements & qualifications

What we’re looking for

Technical must-haves

5+ years of software engineering experience, with at least 2 years in applied AI/ML in production

Deep Python fluency — you write clean, testable, production-ready code (not just notebooks)

Hands-on experience with RAG architectures and vector databases (Pinecone, Weaviate, Qdrant, or similar)

Practical knowledge of at least one major LLM provider API (OpenAI, Anthropic, Cohere) and prompt engineering best practices

Strong understanding of MLOps: model versioning, deployment, monitoring, and graceful degradation in production

Experience with orchestration frameworks such as LangChain, LlamaIndex, or similar

Who you are

  • You close the research-to-production gap faster than anyone else on the team
  • German language on B1 / B2 level and willingness to learn German and to reach a working proficiency level (C1) within 6 months
  • Comfortable with ambiguity — you define the problem and propose the solution, not just wait for a spec
  • Strong bonus points
  • Experience with multilingual NLP tasks, particularly German-language text processing
  • Fine-tuning or RLHF experience (LoRA, QLoRA, DPO)
  • Knowledge of multi-agent frameworks (LangGraph, CrewAI, AutoGen)
  • Background in enterprise AI deployments, information retrieval, or knowledge graphs
  • Open-source GenAI projects, technical writing, or community contributions (GitHub, HuggingFace, arXiv)

Benefits

Compensation & Benefits

  • €80,000 – €100,000 gross annual salary
  • 30 vacation days + German public holidays
  • How we work
  • Fully remote-first with an international team. Occasional travel to Frankfurt required (up to 4 days/month).

Salary & compensation

$under 25000 per year

Contact information

About Talents2Germany

An IT remote company.

Apply now