- Design scalable, efficient, and reusable Data Hub architectures to integrate structured and unstructured data from various sources.
- Establish standards, best practices, and design patterns to ensure consistency across all implementations.
- Guide and mentor other data engineers, offering technical direction and conducting code reviews.
- Develop and optimize batch and real-time data processing workflows to enhance efficiency.
- Implement data validation, anomaly detection, and automated monitoring to ensure high data reliability.
- Lead efforts to automate data workflows, ensuring smooth deployment through DevOps pipelines.
- Collaborate closely with architects, AI engineers, and business teams to align data solutions with organizational goals.
- Ensure that data solutions comply with governance, security, and regulatory requirements.
- Maintain and promote high-quality technical documentation for data models, pipelines, and best practices.
- Private medical care
- Multi-sport card
- Annual bonus
- Trainings and certificates
- Advanced expertise in Python and SQL for data engineering tasks.
- Extensive experience with Azure Data Factory, ADLS, Azure SQL, and Synapse.
- In-depth knowledge of Databricks (primary tool) and Apache Spark for scalable data processing.
- Proven experience in designing enterprise-level data platforms, focusing on scalability, security, and efficiency.
- Familiarity with real-time data processing tools, including Azure Stream Analytics, Event Hubs, or similar platforms.
- Strong understanding of CI/CD, Terraform, Kubernetes/AKS, and Docker for infrastructure automation.
- Experience ensuring data security, lineage tracking, and compliance with industry regulations.
- Capability to guide and mentor data engineering teams, setting the technical direction.
- Strong skills in creating clear and structured technical documentation, with the ability to communicate complex topics effectively.
- Proficiency in English (both written and spoken), at a minimum B2 level.
- Minimum 6 years of experience
Amenities
- Cold beverages
- Hot beverages
- Fruits
- Shower
- Chill room
- Integration events
- Car parking
- Bicycle parking
Hello, Sailor!
We've been expecting you. Our community is eager for new members.
Develocraft is an international IT & Engineering workforce provider from Gdańsk. We blend our passion for creating real business impact with our love for our team, from recruiters to developers. <3
We see ourselves as your agent, not your employer. We're here to help you get what YOU want. If you don't like an offer, we'll find another. If you're aiming for the Champions League glory next season, Cristiano, we sure won't try to set up an interview with Manchester United's team. ;)
Why work with us? We're a remote-first company (though some clients prefer hybrid) and still fresh (6 years on the market), so you can have a real impact here. We're growing fast, ensuring a team of quality you can rely on.
Our experts are here to support you. Whether you work in our team or as a consultant for a client, we'll try to design a career path with you, not just slot you into a role and hope for the best.