• Building distributed and highly parallelized BigData processing pipeline which process massive amount of data (both structured and unstructured) in near real-time
  • Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
  • Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment

  • Growth opportunity in an international organisation with an established position in the market
  • High-end equipment provided by the client
  • Possibility to receive a cafeteria benefit offer

  • Minimum 5 years of experience in Scala and Spark
  • Proficiency in writing, optimizing, and debugging Spark jobs and applications
  • Experience with Spark SQL and DataFrames
  • Experience with setting up, configuring, and managing EMR clusters, including auto-scaling and data integration
  • Hands-on experience with data transfer between Hadoop and relational databases using Sqoop
  • Expertise in Hive, including query optimization, partitioning, data modeling, and HiveQL queries
  • Knowledge and experience with Impala
  • Experience with CI/CD pipelines using Jenkins
  • Proficiency in project management with JIRA

Jesteśmy Devire – firmą rekrutacyjną, której celem jest łączenie świetnych ludzi ze świetnymi pracodawcami.

Niezależnie czy rozglądasz się za nową pracą na stałe czy projektem w formie współpracy B2B – możesz polegać na naszym wsparciu na każdym kroku.

Współpracujemy z pracodawcami z terenu całej Polski i realizujemy rekrutacje we wszystkich kluczowych obszarach technologicznych.