DevOps Engineer - Hadoop

  • HSBC Service Delivery (Polska)
  • Krakow
  • Employment contract
  • 11.07.2019

Requirements

Experience level: Mid

  • General HDP Knowledge (HDFS, Yarn, Ranger).
  • General HDF Knowledge (Nifi, Kafka, Storm).
  • Experience of secured HDP (Kerberos/LDAP Integration).
  • Real world management of the HDP/HDF platform,
  • Dashboarding metrics using Ambari/Grafana.

Technologies

Necessary on this position:
  • Hadoop
  • DevOps Tools: Terraform, Ansible, Jenkins, Git
  • Python
Nice-to-have:
  • Cloud

Project you can join

   The Data and Analytics IT team is part of the overall Commercial Banking (CMB) IT team under the remit of the CMB CIO. 

   The team is responsible for partnering with various stakeholders within the CMB business Transformation and other lines of business and functions to provide robust, secure, leading edge technology solutions for data analytics that are scalable, provide competitive advantage to the business in a changing regulatory and competitive landscape across the world. 

Key Accountabilities:

  • Troubleshooting issues on the cluster: Spark, HDFS, Yarn, Hive,
  • Support our users: guide them so as they use the platform in the best way.
  • Work on automation (DevOps), monitoring, reporting around the platform.
  • Upgrades in Hortonworks Data Platform (HDP).
  • Upgrades in Hortonworks Data Flow (HDF).
  • On-prem Hadoop migration to GCP.

Work time division

System maintenance
70%
System implementation
15%
Designing systems
15%

How we manage our projects?

  • Methodology: Scrum
  • Who makes architectural decisions? Development Team

Toolset

  • Laptop
  • PC
  • Additional monitor
  • Headphones
  • Personal container
  • Phone
  • Freedom to pick your tools

Work environment

  • Tech supervisor
  • Open space
  • Separate rooms
  • Dress code
  • Flexible working hours
  • Remote possible: 30%
  • Paid vacation: 26

Bonuses

  • Healthcare package
  • Healthcare package for families
  • Financial bonus
  • Equity
  • Cold beverages
  • Hot beverages
  • Fruits
  • Snacks
  • Lunches
  • Adaptation tips
  • Language courses
  • Temporary housing
  • Help finding an apartment
  • Visa Services
  • Sign up bonus
  • Flight ticket
  • Money for moving expenses
  • Conferences
  • Trainings
  • Books
  • Car parking
  • Bicycle parking
  • Shower
  • Chill room
  • Playroom for children
  • Integration events

Hsbc logo

Contact this employer

HSBC Service Delivery (Polska) is a Data Controller ...