TL;DR
We're hiring a Site Reliability Engineer to own and evolve deepset's cloud and customer infrastructure end to end. You'll work across SaaS, private cloud, and on-prem environments to make our self-hosted platform production-ready, drive CI/CD and GitOps maturity, and reduce complexity at scale. Your work will directly shape how deepset's AI platform is built, deployed, and scaled for our own cloud and for customers running it in their own environments.
Why deepset
At deepset, we’re making sovereign AI accessible to every organization. With Haystack, thousands of developers build advanced AI applications, while our Enterprise platform helps teams scale across use cases, users, and environments. We’re remote-first, flexible, and built on trust and ownership. You’ll work alongside strong technical talent, take on meaningful challenges, and help turn complex AI into solutions that are practical, reliable, and ready for the real world.
What you will do
You won’t just “keep things running” - you’ll help define how our platform is built, deployed, and scaled across cloud and customer environments.
Build and operate real-world infrastructure. Design, configure, and evolve infrastructure that runs both in our cloud and inside customer environments (SaaS, private cloud, on-prem).
Make self-hosted production-ready. Help us deliver a production-grade, self-hosted platform that can be deployed on any Kubernetes setup in weeks - not months.
Drive automation & platform maturity. Improve CI/CD pipelines, GitHub workflows, and GitOps setups so teams can ship faster with confidence.
Reduce complexity and cost. Continuously simplify systems and optimize infrastructure spend without compromising performance or reliability.
Shape how we build. Champion best practices in reliability, scalability, and security across the organization, not as rules, but as working systems.
Requirements
2-5 years of experience working with large-scale production infrastructure
Experience with distributed or service-oriented architectures
Hands-on expertise with:
Working knowledge of Infrastructure as Code (Terraform preferred)
Solid troubleshooting skills - you can debug across systems, not just within one layer
A pragmatic mindset: you balance speed, simplicity, and reliability
Ownership and accountability - you take responsibility for systems end-to-end
Ability to work independently while staying aligned with the team’s goals
Nice to have
Familiarity with observability stacks (e.g. Datadog, Prometheus)
Experience optimizing cloud costs at scale
Interest or experience in Machine Learning / LLM systems
Experience improving developer experience and platform tooling using AI agents
Contributions to SRE practices like postmortems, SLIs/SLOs, and reliability engineering culture
Benefits
Remote-first setup with flexible hours & tech of your choice
30 days vacation + extra days for family sick leave
Competitive salary & stock options for every team member
Monthly sports & mental health support allowance with Oliva
Annual learning & development budget
Monthly team socials & in-person meetups
Dog-friendly Berlin HQ
About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.
Visit us to learn more: deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)
