Big Data Platform Engineer

Commerzbank - Centrum Technologii Cyfrowych w Polsce
Mid
Online interview
Employment contract
Łódź
Paid vacation
26

Project description

Description of the position
In your role as a Big Data Platform Engineer you will be responsible for the continuous development of the Commerzbank central Hadoop Platform witch is one of the foundations of Commerzbank 4.0 Transformation to a digital technology company.

You take a role in an innovation driven team, that will provide the key technology which is based on modern Hadoop Distribution from Hortonworks Data Platform and Data Flow. They are the base stack for our Data Lake and Analytics Platform This Software Stack needs to be scaled out in terms of size, amount of users, segments and uses cases as well as technological enhancements to fit the requirements of our clients.


Description of the cluster
You would work in the Big Data cluster and take care for the needs of the BDAA client who want to have an access to Data lake Platform of Hadoop platform. We work in a cluster structure which allows the project teams to work on their tasks in a self-organized and flexible manner. Each project team assumes product responsibility from start to end, from software development to operation. The teams use agile working methods for their organization in order to be able to deliver products to customers faster and more efficiently.

Your tasks

Your main tasks are:

  • Rollout upgrades and changes of configuration of services of the Hadoop Platform
  • Automation of configuration of the Platform Ansible to provide a continuous scalable platform
  • Support Data Scientists and operative Use Cases Developers with their problems on your platform
  • Solve challenges like how to embed modern technology into an existing infrastructure
  • Support Use Case Application Operation as 3d Level Support
  • On-Call Service 24/7

Who we're looking for?

Your main tasks are:

  • Rollout upgrades and changes of configuration of services of the Hadoop Platform
  • Automation of configuration of the Platform Ansible to provide a continuous scalable platform
  • Support Data Scientists and operative Use Cases Developers with their problems on your platform
  • Solve challenges like how to embed modern technology into an existing infrastructure
  • Support Use Case Application Operation as 3d Level Support
  • On-Call Service 24/7


What we expect from you:

  • High knowledge of UNIX/LINUX (Red Hat) RH 7.x
  • Good knowledge of Hortonworks Data Platform (HDP) 2.6.x or higher
  • Basic knowledge of Hortonworks Data Flow (HDF) 3.x or higher


Alternative Skills:

  • Basic knowledge of Spark
  • Basic knowledge of Hive
  • Basic knowledge of Google Cloud GCP


Foreign language skills:

  • English B2 level - mandatory
  • German - nice to have

Skills
Unix or Linux
Spark
Toolset
Laptop
PC
Additional monitor
Headphones
Personal container
Phone
Operating system
Work environment
Tech supervisor
Open space
Flexible working hours
7 - 19
Office hours
Healthcare
  • Healthcare package
  • Healthcare package for families
Leisure package
  • Leisure package
  • Leisure package for families
Bonuses
  • Financial bonus
Kitchen
  • Cold beverages
  • Hot beverages
  • Lunches
Traning
  • Conferences
  • Trainings
Parking
  • Car parking
  • Bicycle parking
Relocation package
  • Language courses
  • Visa Services
Other
  • Shower
  • Chill room
  • Integration events

Our company

Commerzbank - Centrum Technologii Cyfrowych w Polsce

Łódź >350
Tech skills
  • Java
  • C++
  • .NET
  • HTML
  • JavaScript
  • Python
  • Perl
  • C#
  • Spring
  • Hibernate

Check out similar job offers