- Building distributed and highly parallelized BigData processing pipeline which process massive amount of data (both structured and unstructured) in near real-time
- Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
- Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment
- Growth opportunity in an international organisation with an established position in the market
- High-end equipment provided by the client
- Possibility to receive a cafeteria benefit offer
- Minimum 5 years of experience in Scala and Spark
- Proficiency in writing, optimizing, and debugging Spark jobs and applications
- Experience with Spark SQL and DataFrames
- Experience with setting up, configuring, and managing EMR clusters, including auto-scaling and data integration
- Hands-on experience with data transfer between Hadoop and relational databases using Sqoop
- Expertise in Hive, including query optimization, partitioning, data modeling, and HiveQL queries
- Knowledge and experience with Impala
- Experience with CI/CD pipelines using Jenkins
- Proficiency in project management with JIRA
Devire
200
Jesteśmy Devire – firmą rekrutacyjną, której celem jest łączenie świetnych ludzi ze świetnymi pracodawcami.
Niezależnie czy rozglądasz się za nową pracą na stałe czy projektem w formie współpracy B2B – możesz polegać na naszym wsparciu na każdym kroku.
Współpracujemy z pracodawcami z terenu całej Polski i realizujemy rekrutacje we wszystkich kluczowych obszarach technologicznych.