ClickHouse utvecklar en analysdatabas och molntjänster för att behandla stora datamängder samt Langfuse för observerbarhet i AI-applikationer.
Data Platform Engineer
Vous contribuerez à faire évoluer la plateforme d’entrepôt de données de ClickHouse, qui alimente les analyses et les décisions de l’entreprise. Vous développerez des composants Airflow, des macros dbt et des pipelines de données fiables et performants, notamment avec ClickHouse, Python et SQL. Le poste est basé à Londres et requiert une licence en informatique ou dans un domaine connexe.
3× större chans till intervju med ett kallt mejl
Visa originalannonsenFakta om ClickHouse
- Officiell domän
- clickhouse.com
- Lediga jobb
- 10
Om annonsen
Den fullständiga beskrivningen som publicerats av ClickHouse.
About the role
At ClickHouse, we believe in making product decisions grounded in data, not gut feelings. To support that, we've built a comprehensive internal data warehouse — read more about it on our blog https://clickhouse.com/blog/building-a-data-warehouse-with-clickhouse. It powers analytics, forecasting, and decision-making across every team in the company. Our stack centers on ClickHouse as the core storage and processing engine, complemented by dbt, Airflow, S3, AWS, Superset, and GitHub Actions.
We ingest data from 30+ distinct external sources, process over 2.5 PB of data, and deliver most data marts to business consumers with a 1-hour end-to-end latency - a standard that demands highly optimized, rock-solid transformation pipelines. We're looking for a Senior Data Engineer to help evolve the DWH platform, push its technical boundaries, and deliver reliable, high-performance data models to business users across the organization.
Key responsibilities
- DWH Platform Development - Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture. - Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns. - Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale.
- Team contributions - Conduct thorough code reviews for team members and other team contributors. - Actively participate in technical and architectural design discussions. - Drive technical leadership in specific areas of our stack. - Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows. - Contribute to platform stability through proactive troubleshooting and timely incident resolution.
- Data modeling - Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices. - Mentor and support contributors through code reviews and technical guidance. - Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic.
Qualifications
Required:
- Exceptional SQL skills
- this is non-negotiable.
- Strong hands-on experience with Airflow, dbt, and Python.
- Proven track record building and optimizing large-scale, high-throughput data pipelines.
- Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality.
- Bachelor's degree in Computer Science or a related field.
- Comfortable thriving in a fast-paced startup environment
- exciting and dynamic, but sometimes wonderfully chaotic. Preferred:
- Hands-on experience with ClickHouse
- a significant advantage.
- Familiarity with AWS or other cloud platforms.
- Experience with CI/CD development, especially using GitHub Actions.
Perks
Flexible work environment
- ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.
- Healthcare
- Employer contributions towards your healthcare.
- Equity in the company
- Every new eligible team member who joins our company receives equity.
- Time off
- Flexible time off in the US, generous entitlement in other countries.
- A USD$500 Home office setup if you’re a remote employee.
- Global Gatherings
- We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites. CULTURE -
We all shape IT
As part of a rapidly scaling start-up, you will be instrumental in shaping our culture. Are you interested in finding out more about our culture? Learn more about our values here https://clickhouse.com/company/careers. Check out our blog posts https://clickhouse.com/blog or follow us on LinkedIn https://www.linkedin.com/company/clickhouseinc/life/0c1ee7f4-2129-488d-b413-e7f6270659fd/?viewAsMember=true to find out more about what’s happening at ClickHouse.
Equal opportunity & privacy
ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Please see here https://clickhouse.com/legal/applicant-privacy-notice for our Privacy Statement.
Förkunskapskrav
- Compétences exceptionnelles en SQL
- Expérience pratique avec Airflow, dbt et Python
- Expérience avérée dans la création et l’optimisation de pipelines de données à grande échelle et à haut débit
- Bonne compréhension des fondamentaux des entrepôts de données, de l’ETL/ELT, de la modélisation dimensionnelle et de la
- Licence en informatique ou dans un domaine connexe
- Expérience pratique de ClickHouse appréciée
- Familiarité avec AWS ou d’autres plateformes cloud
- Expérience en développement CI/CD, notamment avec GitHub Actions
Förmåner som nämns
- Environnement de travail flexible
- Participation de l’employeur aux frais de santé
- Actions de l’entreprise
- Congés flexibles aux États-Unis, généreux dans les autres pays
- 500 USD pour l’installation d’un bureau à domicile pour les employés à distance
- Rencontres d’entreprise en présentiel
Sök jobbet
Hur söker jag?
Annonsen är publicerad på ClickHouses webbplats. Öppna originalannonsen ↗ för att skicka in din ansökan. Screeningpass fyller inte i formulär åt dig.
Vem kan du skriva till på ClickHouse om den här tjänsten?
Starta en kontaktsökning från den här sidan. Screeningpass föreslår upp till tre personer med koppling till tjänsten. Du väljer vem du vill skriva till, sedan söker Screeningpass efter personens e-postadress på jobbet och förbereder ett meddelande. Du läser igenom det och skickar det själv med Gmail. Det finns inte alltid en e-postadress tillgänglig, och du är aldrig garanterad ett svar.
Vad kostar det att hitta en kontakt?
En sökning kostar 1 kredit. Du får tillbaka krediten om sökningen misslyckas. När du skapar konto får du 3 krediter, vilket räcker till 3 sökningar.
Vad används Screeningpass till?
Screeningpass samlar annonser för praktik, lärlingsanställningar och jobb som publicerats av företag. För en annons hittar Screeningpass en person att kontakta på företaget, söker efter personens jobbmejladress och tar fram ett meddelande utifrån ditt CV. Se hur det fungerar i detalj.