Senior AI Architect
Jimmy Technologies · Prague, Praha, Hlavní město, Czechia · Hybrid
Pay: EUR 56 – 65 a hour
Posted Oct 1, 2026
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
We are seeking a highly experienced German-speaking Senior AI Architect for a long-term public - sector project in Germany. We're looking for an architect with a deep technical foundation in modern AI systems : someone who has led the architecture of multiple GenAI solutions and understands LLMs not just conceptually, but from the inside, including fine-tuning and productive deployment.
The environment is primarily on-premises / sovereign cloud , so experience designing AI systems outside of hyperscaler-native setups is key.
This is a long-term, full-time contract position , approx. 90% remote and 10% on site in Nuremberg.
Work Conditions
Start Date : ASAP
Location : ~90% remote, ~10% on site in Nuremberg
Workload : Full-time
Long-term contract based-role
Very good German and strong communication skills.
Lead architect experience on at least 2–3 GenAI projects, ideally in the public sector (not required).
In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and comparable architectures.
Deep understanding of modern AI model architecture and hands-on implementation experience, e.g. LLM fine-tuning or building productive GenAI solutions.
Experience with on-prem architectures or sovereign cloud environments.
Technical background, ideally a degree in computer science, machine learning, artificial intelligence, or data science.
Project management qualities are a strong plus.
Technical Requirements
Mandatory
Large Language Models: architecture, selection, evaluation, deployment
RAG and GraphRAG architectures
AI Gateways and LLM orchestration patterns
LLM fine-tuning and/or productive GenAI solution development
On-prem or sovereign cloud AI infrastructure
Nice to have
Public sector project experience (Germany / DACH)
AWS
Project management or technical delivery lead experience
Academic background in ML, AI, or data science