Data Engineer

• Utilize Spark and Python to design, develop, and manage data ingestion and transformation processes.
• Build large-scale, distributed data processing pipelines capable of handling massive volumes of both structured and unstructured data in near real-time.
• Apply Spark to enrich and transform corporate data, facilitating search, visualization, and advanced analytics.
• Collaborate closely with analysts and business stakeholders to create and refine analytics models.
• Work alongside Data Scientists and Machine Learning specialists to support model development and deployment.
• Regularly update progress in PI Demo sessions with thorough status reports.

• Attractive salary up to 155 PLN/h netto
• Additional benefits package (medical healthcare, sports membership, etc.)
• Possibility to cooperate with an international company with a stable market position
• Long-term cooperation
• Flexible working hours, Polish time zone

Must have:

• At least 4 years of hands-on experience with Spark and Python.
• Proficient in Spark SQL or Hive SQL with a minimum of 4 years of experience.
• 3+ years working with Hadoop/Hive ecosystem or other Big Data technologies.
• Background in designing data flows, including ETL and ELT processes.
• Skilled in using BitBucket and GIT, including version control and branching practices.
• Knowledgeable in Agile/SAFe methodologies.

Additional Advantages:

• Experience with cloud platforms (AWS, GCP, or Azure) is a strong asset.
• Foundational understanding of machine learning models, including building, validating, and maintaining regression models, is beneficial.