We are looking for a Data Engineer to join a small team and modernize a simple data platform into a centralized self-service analytics project.
CUSTOMER
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries.
PROJECT
Within an internal project at Sigma Software, we have two primary goals: to automate reporting and to create a self-service data analytics system for our company.
You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to and collaborating with BI engineers making reports in Apache Superset, and other roles consuming such data. Additionally, you’ll work with various other team members who rely on this data.
RESPONSIBILITIES
Our goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources.
- Lay down the foundation and model the data
- Develop a platform for building and maintaining data pipelines that collect data from different sources
- Create Data Warehouse
- Analyze and prepare domain descriptions in collaboration with Business analytics
- Create Data Marts
- Design a permission model with flexible control over vertical and horizontal access to data
REQUIREMENTS
- Experience with Python
- Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
- Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
- Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
- Experience debugging and optimizing Spark jobs
- Experience with dbt & dagster is a plus
- Experience with Azure DevOps or similar services & tools
- Strong written and verbal communication skills
- At least an Upper-Intermediate level of English
Experience with a Business Intelligence tool would be a plus.
- Style guide
- Code review
- Static Code Analysis
- TDD
- BDD
- Code metrics
- Knowledge Base
- Unit tests
- Integration tests
- System tests
- Pentests
- Performance tests
- Manual testing
- Automated testing
- CI
- Laptop
- Additional monitor
- Headphones
- Windows
- OS X
- Methodology: Scrum, Kanban, Lean
Packages and extras
- Language courses
- Conferences
- Trainings
- Books
- Healthcare package
- Leisure package
Relocation package
- Open to Ukrainian candidates
Amenities
- Cold beverages
- Hot beverages
- Snacks
Sigma Software
2000+
Sigma Software is a multinational company with over 21 years of experience providing our customers with best-in-class solutions. We are an IT consulting and software product company with development offices in Sweden, the USA, Canada, Ukraine, Latin America, Poland, Portugal, Hungary, Bulgaria, and the Czech Republic.
All open vacancies are available both remotely and in the offices.
We deliver the smartest solutions to our customers in the areas of government, telecommunications, advertising, automotive, gaming, and others. We are a global player with more than 2000 specialists working from 40 offices in 19 countries.
Taking high demand for quality, minimal hierarchy, freedom of decision-making, attention to every opinion, flexibility, and dedication to every project and every customer make us different.
Today, Sigma Software is a whole ecosystem that includes its own business incubator, educational platform, business association of companies, its own product line, and patented innovative solutions.