About the Role
As a Data Engineer at Sporty Group, you will play a critical role in ensuring the smooth processing and handling of data for our machine learning and data science initiatives. You will design, build, test, optimize, and maintain data pipelines and architectures for various aspects of our rapidly growing business.
Responsibilities
- Design, develop, and maintain scalable batch ETL and near-real-time data pipelines and architectures.
- Ensure data quality, accuracy, and consistency.
- Identify and implement process improvements for optimizing data delivery and infrastructure scalability.
- Build new API integrations.
- Communicate with data scientists, MLOps engineers, product owners, and BI analysts.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field.
- 3+ years of experience in data engineering, data platforms, BI or related domain.
- Experience with data-centric applications and large-scale databases.
- Experience with data modeling and event-driven architectures.
- Proficient in SQL.
- Familiarity with Python.
- Experience with Apache Airflow & Apache Spark.
- Solid understanding of cloud data services (AWS preferred).
Nice to have
- Understanding of ML Models.
- Understanding of containerization and orchestration technologies (Docker/Kubernetes).
- Relevant knowledge or experience in the gaming industry.
