ITDS provides IT services and specialist teams for its clients’ projects.
Senior PySpark Data Engineer – Big Data & Cloud Integration
You will develop and optimize data pipelines with PySpark and Spark on YARN, then integrate them into cloud environments, primarily on GCP. You will work with data scientists and engineers to productionize analytical solutions. The role is based in Kraków and offers a hybrid work model.
3× plus de chances d’entretien avec un cold email
View original job listingInformation about ITDS
- Official domain
- itds.pl
- Open jobs
- 162
Job details
The full description published by ITDS.
Unleash the power of data — transform experimental insights into scalable, high-performance workflows! Kraków-based opportunity with hybrid work model. As a Senior PySpark Data Engineer, you will be working for our client, a leader in large-scale data engineering and cloud integration. You will play a pivotal role in converting cutting-edge experimental code into robust, production-ready data pipelines, enabling innovative solutions across diverse projects. Join a dynamic environment where your expertise accelerates data-driven decision-making and fosters technological advancement.
Your main responsibilities: Convert experimental code into scalable, efficient workflows and modules. Develop and optimize data pipelines using PySpark and Spark on YARN.
- Collaborate with data scientists and engineers to productionize analytical solutions.
- Ensure code quality, perform performance tuning, and implement best data engineering practices.
- Maintain and improve performance of data workflows in a large-scale environment. Integrate data pipelines within cloud ecosystems, primarily Google Cloud Platform (GCP).
- Support continuous improvement through performance monitoring and optimization. You're ideal for this role if you have: 5+ years of experience in data engineering and PySpark/Spark development. Strong SQL skills and experience with Spark optimization techniques. Hands-on experience with the Hadoop ecosystem, especially Spark on YARN. Knowledge of cloud platforms, preferably GCP, is a strong plus. It is a strong plus if you have: Certifications or additional experience in cloud computing or big data solutions. Language required for the role: English, with a communicative proficiency. Eligibility to work in Europe: Only candidates with an existing legal right to work in the European Union will be considered for this role. #MAKEYourCareerBETTER Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
Apply for this job
How do I apply?
The job is published on ITDS’s website. Open the original posting ↗ to submit your application. Screeningpass does not fill in a form for you.
Who should you write to at ITDS about this role?
Start a contact search from this page. Screeningpass suggests up to three people connected to the role. Choose whom to write to, then Screeningpass looks for their professional email and prepares a message. You review it and send it yourself with Gmail. An email address is not always available, and a reply is never guaranteed.
How much does finding a contact cost?
A search costs 1 credit. Your credit is returned if the search fails. Signing up gives you 3 credits, enough for 3 searches.
What does Screeningpass do?
Screeningpass brings together internships, apprenticeships and jobs published by companies. For a job, Screeningpass finds someone to contact at the company, looks for their professional email and prepares a message using your CV. See how it works in detail.