We are embarking on an exciting project that requires expertise in a diverse range of technologies. This project aims to enhance our systems' efficiency and performance through the implementation of cutting-edge tools and methodologies. As part of our team, you will be responsible for deploying and maintaining critical infrastructure components, streamlining development workflows, and optimizing system performance. This project offers an opportunity to work with state-of-the-art technologies and contribute to the evolution of our IT landscape.

  1. Data Engineering and Processing:
  • Utilize Databricks (or equivalent platforms) to develop and maintain data engineering solutions.
  • Write and optimize SQL queries and Python scripts for data processing and analysis.
  1. Data Modeling and Architecture:
  • Design and implement data models, ensuring they align with data warehousing principles and Lakehouse architecture.
  • Develop and maintain data warehouses to support business intelligence and analytics.
  1. ETL Processes:
  • Design, develop, and manage ETL pipelines using Azure Databricks (Spark, Spark SQL, Python, SQL).
  • Implement ETL/ELT design patterns to ensure efficient data extraction, transformation, and loading.
  1. Spark-Based Data Processing:
  • Leverage Spark and Python for large-scale data processing tasks.
  • Develop and optimize data processing workflows using Spark.
  1. Real-Time Data Processing:
  • Implement real-time data processing solutions using Delta Live Tables and Spark Streaming.
  • Ensure timely and accurate processing of streaming data for real-time analytics and applications.
  1. Workflow Design and Optimization:
  • Design data processing workflows that are scalable and maintainable.
  • Continuously monitor and optimize workflows to improve performance and efficiency.
  1. Collaboration and Communication:
  • Work closely with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Communicate effectively with stakeholders to ensure alignment on data engineering initiatives.

MUST

1) Hands on Data Engineering Experience using Databricks (or equivalent) , SQL and Python skills(as a script)
2) Solid understanding of data modelling, data warehousing principles and Lakehouse architecture 3) Expert knowledge of ETL using Azure Databricks (Spark, Spark SQL, Python, SQL) and understand the ETL/ETL design patterns 4) Proficiency in Spark-based Python for data processing. 5) Strong experience in data modeling and designing data processing workflows using Spark. 6) Familiarity with Delta Live Tables and Spark Streaming for real-time data processing.

NICE TO HAVE

a) Understanding of ETD (Extract, Transform, Load) product and lifecycle.

b) Reconciliation experience

Luxoft, a DXC Technology Company is a global digital strategy and software engineering firm with over 17,000 international employees within its 58 offices in 29 countries. It is headquartered in Zug, Switzerland. 

In January 2019, Luxoft was acquired by U.S. company DXC Technology. Luxoft partnered with LG Electronics to create a next-generation Autonomous Mobility concept vehicle that integrates consumers' personalized digital lifestyles into a driving experience. Luxoft enabled Switzerland's first Blockchain based e-vote platform with the City of Zug and Hochschule Luzern's Blockchain Lab.

Luxoft, a DXC Technology Company is a world-renowned company. It has been present on the Polish market for over 13 years. We have offices in Krakow, Warsaw, Wroclaw, and Gdansk. We employ over 2,000 professional experts carrying out projects for over 100 clients from the financial, automotive, medical, tourist industries, etc. We work for many international clients, including the USA, Great Britain, and Switzerland.

So far, Luxoft Poland has made a name for itself as a company that offers work on innovative projects, we offer various experiences in the field of IT, opportunities for rapid development, an extensive training program, and attractive benefits for employees.

At present, 62% of Luxoft Poland employees come from Poland, and 38% from around 50 countries, including Ukraine, Brazil, India, Turkey, Spain, Portugal, Italy, Romania, USA, etc.

At Luxoft, a DXC Technology Company almost 80 percent of employees are experts with the "Senior" experience level, with at least five years of experience. We care about our employees, so every day we try to provide them with the best possible conditions for work and development.

Technology is our passion! We focus on top engineering talent means that you will be working with the best industry professionals from around the world. Because of that, Luxoft is a global family with an epic atmosphere – we love what we do!