Beskrivelsen av denne bedriften er ikke tilgjengelig på dette språket ennå.
Senior/Lead Data Software Engineer (Python, Spark, Azure)
We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities. You will play a key role in migrating from an IaaS Big Data platform to Azure-native Databricks, optimizing data workflows and improving data…
3× større sjanse for intervju med en uoppfordret e-post
Se den opprinnelige stillingsannonsenInformasjon om EPAM Systems
- Bransje
- IT-tjenester
- Offisielt domene
- epam.com
- Ledige stillinger
- 405
Stillingsdetaljer
Den fullstendige beskrivelsen publisert av EPAM Systems.
Description de l’offre
We are seeking a Senior/Lead Data Software Engineer to join our team working on a scalable, ML-ready platform that enhances portfolio model development and deployment with advanced data governance and AI capabilities. You will play a key role in migrating from an IaaS Big Data platform to Azure-native Databricks, optimizing data workflows and improving data quality. Join us to contribute to innovative solutions that boost client services and regulatory compliance.
responsibilities
Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
- Manage and process 12 TB of data efficiently across platforms Tune machine learning models for Azure environments using Java Spark and Delta tables Update and maintain libraries to address security vulnerabilities Develop and maintain ETL/ELT pipelines using PySpark and related technologies
- Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
- Monitor data quality and implement improvements to ensure accuracy and reliability Automate deployment and operational tasks using Terraform and GitLab CI/CD Support data governance initiatives to comply with regulatory standards Troubleshoot and resolve performance issues in data processing systems
- Document system processes and provide technical guidance to junior engineers
- Implement best practices for code quality and data security Participate in code reviews and knowledge sharing sessions Optimize costs associated with data storage and processing requirements Proficiency in Python and Spark with at least 3 years in data engineering roles Strong experience with Azure Databricks and PySpark Proven expertise in designing and implementing ETL/ELT solutions Experience migrating big data platforms to Azure-native services Proficiency with Delta tables for model tuning Knowledge of data governance and regulatory compliance frameworks Familiarity with Docker, Kubernetes (AKS), and Terraform for infrastructure automation Ability to manage large data volumes with high efficiency Excellent problem-solving and analytical skills Strong communication and collaboration abilities English proficiency at B2 level or higher
3× større sjanse for intervju med en uoppfordret e-post
Søk på denne stillingen
Hvordan søker jeg?
Stillingsannonsen er publisert på nettsiden til EPAM Systems. Åpne den opprinnelige stillingsannonsen ↗ for å sende inn søknaden din. Screeningpass fyller ikke ut skjemaet for deg.
Hvem kan du skrive til hos EPAM Systems om denne stillingen?
Start et kontaktsøk fra denne siden. Screeningpass foreslår opptil tre personer knyttet til stillingen. Du velger hvem du vil skrive til, så søker Screeningpass etter personens jobb-e-postadresse og klargjør en melding. Du leser gjennom meldingen og sender den selv med Gmail. En e-postadresse er ikke alltid tilgjengelig, og du er aldri garantert svar.
Hvor mye koster det å finne en kontakt?
Et søk koster 1 kreditt. Du får kreditten tilbake hvis søket mislykkes. Når du registrerer deg, får du 3 kreditter, nok til 3 søk.
Hva kan du bruke Screeningpass til?
Screeningpass samler stillingsannonser for praksisplasser, lærlingplasser og jobber som bedrifter har publisert. For en stilling finner Screeningpass en kontaktperson i bedriften, søker etter personens jobbrelaterte e-postadresse og lager en melding basert på CV-en din. Se hvordan det fungerer i detalj.