Data Engineer

7N
Mid
15 120 - 19 320
pln
net / month (B2B)

Online interview
B2B
Warsaw Remote
Remote possible
100%

Project description

On behalf of our client from the pharmaceutical industry we are looking for a talented Data Engineers who would like to help them transform the way new therapeutic hypotheses are formed and validated.

The team works in 3 distributed development work streams delivering value for the scientists from the laboratories. One of the work streams is focused on delivering a data engineering platform which is the hub of scientific data from in-house and external organisations. On a very high level a platform should allow to pull the data from the selected sources, expose it to semi automated curation, store harmonised data, validate the data, enhance the data, process the harmonised data to calculate evidences and associations, allow query capabilities of the data.

Your tasks

  • Design and implement the solution and justify the choices to the product owner (located in CA, USA)
  • Review the current architecture and confront this with challenges, limitations and new requirements for post pilot release
  • Share the knowledge by code/design reviews, etc.
  • Project in a therapeutic research area: genetics, biotechnology.


Who we're looking for?

  • Experienced with JVM programming (at least one of Java, Scala) and backend frameworks like Spring Boot
  • 3+ years of data engineering professional experience, majority of time spent on hands-on experience
  • Knowledge about architecture and design of big data solutions, being able to justify decisions and choices
  • Experienced with orchestrating data processing pipelines
  • Experienced with monitoring of data processing
  • Experienced with different data formats for big data like PARQUET and data compressions
  • Willing to share knowledge with other team members
  • Fluent English is a must
  • Comfortable in a distributed work environment (part of the team working in different time zones - calls after 5pm 1-2 times a week)

Nice to have experience with:

  • Big data volumes Apache Spark JVM tuning messaging systems like RabbitMQ RDBMS databases and ETL processing


Skills
JVM
Spring Boot
Apache Parquet
RDBMS
ETL
How we manage our projects?
Methodology
Scrum/Kanban
How we code?
Style guide
Code review
Pair programming
Static code analysis
TDD
Code metrics
How we test?
Unit tests
Integration tests
Performance tests
Manual testing
Test automation
CI
Toolset
Laptop
Additional monitor
Headphones
Operating system
Work environment
Healthcare
  • Healthcare package
  • Healthcare package for families
Leisure package
  • Leisure package
Kitchen
  • Cold beverages
  • Hot beverages
  • Fruits
  • Snacks
Traning
  • Trainings
Parking
  • Car parking
Other
  • Shower
  • Chill room
  • Integration events

Our company

7N

Warsaw, Gdańsk 800+
Tech skills
  • C#
  • Java
  • JavaScript

Check out similar job offers