"Our product Privatemode AI is our secure alternative to ChatGPT. It enables AI workflows with sensitive data by keeping all data encrypted-even during processing-using confidential computing. You can access it via a user-friendly app or a fully OpenAI-compatible API. See for yourself: Most of our code is available on GitHub. Our tech stack API: Go, Kubernetes RAG: Python, Qdrant Model hosting: Python, vLLM Scaling: pipeline/tensor parallelism, optimization for Nvidia H100 and B200 Portal and app: TypeScript, React, Electron"
"Your mission As part of our team, you'll work on the Privatemode platform across frontend, backend, and model hosting. Tasks include: Extending our OpenAI-compatible API and confidential processing stack Building RAG features, embedding pipelines, and agent functionality Hosting and optimizing the performance of cutting-edge open-source LLMs Scaling models using parallelism and efficient GPU orchestration CI/CD automation and documentation Prototyping and iterating on new features As a Senior Software Engineer, you also help less experienced team members with their personal development."
Venture-backed cybersecurity startup develops Privatemode AI to enable secure AI workflows by keeping all data encrypted even during processing using confidential computing. Privatemode offers a user-friendly app and a fully OpenAI-compatible API, with most code available on GitHub. The technical stack spans Go and Kubernetes for the API, Python and Qdrant for RAG, vLLM for model hosting, and GPU optimizations for Nvidia H100 and B200. Responsibilities include extending the OpenAI-compatible API and confidential processing stack, building RAG and embedding pipelines, hosting and optimizing open-source LLMs, scaling with parallelism, and CI/CD automation. Compensation ranges €80k–€120k plus stock options with flexible remote or Bochum/Berlin locations.
Read at Berlin Startup Jobs
Unable to calculate read time
Collection
[
|
...
]