Big Data Engineer – Hadoop

Commerzbank - Centrum Technologii Cyfrowych w Polsce
Mid
Online interview
Employment contract
Łódź
Paid vacation
26

Project description

You will be responsible for the continuous development, Implementation and Maintenance of the Commerzbank Compliance Data Lake on the central Hadoop Platform witch is one of the foundations of Commerzbank 4.0 Transformation to a digital technology company.

Your tasks

  • Act as a functional lead and SPOC for the requirement and delivery management towards the main customer team based in Frankfurt (only for Senior Developer)
  • Development, implementation and maintenance of the Compliance Data Lake solution on basis of the Hadoop-Big Data-Platform using the DP CSA CAMP (Compliance agile solution-based) on a domain-specific language.
  • Creating packages for software deployment and test using CAMP as well as integration into the Compliance specific framework based on JAVA development on SparkSQL of the HDP Big Data Hadoop platform
  • Support testing including error analysis and QA measures and apply fixes accordingly as part of 3rd level support
  • Support of continuous improvement and optimization of the Software Lifecycle Processes including CAMP and CI/CD solutions

Who we're looking for?

Expectations:

  • Experience in implementing ETL solutions and processing Frameworks on HDP Hadoop Big Data solutions
  • Implementing and maintenance of the compliance specific Framework CSA on Hadoop using Spark Framework
  • Implementation and maintenances of Big Data Solutions using Hive, Sqoop, Spark, Scala & Kafka, etc.
  • Good knowledge of Agile tools&methods (Jira, Kanban+Scrum, CI/CD processes)
  • English B2 level - mandatory


Alternative Skills:

  • Basic knowledge, or willingness to learn Domain-specific language (DSL)
  • Basic knowledge, or willingness to learn of UC4/Automation one
  • Basic knowledge, or willingness to learn of Banking Compliance business topics, such as Anti Money Laundering, Customer Due Diligence, KYC Scoring and Watch List Filtering
  • German - nice to have

Skills
Big Data
Hadoop
ETL
Toolset
Laptop
PC
Additional monitor
Headphones
Personal container
Phone
Operating system
Work environment
Tech supervisor
Open space
Flexible working hours
7 - 19
Office hours
Healthcare
  • Healthcare package
  • Healthcare package for families
Leisure package
  • Leisure package
  • Leisure package for families
Bonuses
  • Financial bonus
Kitchen
  • Cold beverages
  • Hot beverages
  • Lunches
Traning
  • Conferences
  • Trainings
Parking
  • Car parking
  • Bicycle parking
Other
  • Shower
  • Chill room
  • Integration events

Our company

Commerzbank - Centrum Technologii Cyfrowych w Polsce

Łódź >350
Tech skills
  • Java
  • C++
  • .NET

Check out similar job offers