(Regular/Senior) Big Data Operations Engineer

Commerzbank - Centrum Technologii Cyfrowych w Polsce
Mid
Online interview
Employment contract
Łódź
Paid vacation
26

Project description

In your role as a Big Data Operations Engineer who will be responsible for administration, operation and deployment of applications on big data platforms. You will take a role in an innovation driven team, which drives innovative products using state of the art technology such as the Commerzbank Data Lake and Google Cloud technology.

Main tasks:

  • Working in cross-functional cells and deep involvement in the development process from the beginning in order to support the cell in implementing operational requirements such as monitoring, traceability and resilience
  • Daily monitoring of production processes and incidents, taking the necessary measures and responsible coordination of problem solving in the cell and beyond the cluster and the key area
  • 3th-Level-Support
  • Maintain, Deploy and Configurate Big Data Sales Analytics Use Cases on Google Cloud and Data Base environment, Hive, Docker-Swarm, Kubernetes, Tomcat / Jetty (depending on Use Case)
  • Responsibility for technical users and all configuration items related to your product in prelive and production
  • Installation and configuration of the dedicated applications in prelive and production and rollout of increments using our continuous integration and continuous deployment environment

Who we're looking for?

What we expect from you:

  • Linux/Unix and shell scripting - good knowledge
  • SQL / Databases - good knowledge
  • Scheduling tools (like Cron, UC4 or similar)
  • Experience with cloud solutions such as e.g. GCP – Google Cloud Platform (preferred), AWS, Azure or Kubernetes
  • Experience with Applications Containers like Docker, Docker Compose and Docker-Swarm
  • Experience with Applications Servers, e.g. Tomcat, Jetty
  • Readiness for business travels to Germany (few trips within first months due to gain training)

Nice to have:

  • Experience with Hadoop ecosystem or willingness to learn
  • Cloudera or Hortonworks Data Platform (HDP)
  • Monitoring tools experience such as Grafana, Nagios, Zabbix, Prometheus
  • CI/CD tools, e.g. Jenkins, TeamCity
  • Version Control tools, e.g. GIT (preferred), SVN
  • Jira, Bitbucket, Confluence
  • Knowledge of ITIL processes (certificates is an advantage but no required)
  • Data quality topics - practical experience
  • Python, PySpark
  • Spark/Beam

Foreign language skills:

  • English B2 level mandatory
  • German optional

Skills
Linux or Unix
Shell
GCP
Azure or Kubernetes
AWS
Docker
Tomcat
Toolset
Laptop
PC
Additional monitor
Headphones
Personal container
Phone
Operating system
Work environment
Tech supervisor
Open space
Flexible working hours
7 - 19
Office hours
Healthcare
  • Healthcare package
  • Healthcare package for families
Leisure package
  • Leisure package
  • Leisure package for families
Bonuses
  • Financial bonus
Kitchen
  • Cold beverages
  • Hot beverages
  • Lunches
Traning
  • Conferences
  • Trainings
Parking
  • Car parking
  • Bicycle parking
Other
  • Shower
  • Chill room
  • Integration events

Our company

Commerzbank - Centrum Technologii Cyfrowych w Polsce

Łódź >350
Tech skills
  • Java
  • C++
  • .NET

Check out similar job offers