Data Engineer – STÄNGD (Stängd)

The data engineer is responsible for implementing the end-to-end data transformations from ingestion to consumption, ensuring a governed, and structured use-cases consumption area. There should be a strong focus on data quality and code quality, enhancing functional and non-functional requirements, and ensuring scalable and performant processes while leveraging PaaS and IaaS components

Responsibility

Data architecture

• Develop in a structured, performant manner, data requirements and activities requested by use cases, enhancing data quality and leveraging the solution architecture
• Connect securely to data sources, understand it’s limitations and data assets, and ingest data from it to our main storage components
• Store and maintain metadata, enhancing transparency and the execution of idempotent routines
• Understand and implement data architecture design
• Give feedback and validate feasibility of data architecture design

Software engineering

• Develop applications and components leveraging design patterns and practices, ensuring an extensible and maintainable codebase
• Ensure a high code quality, enhancing secure and bug-free features to use-cases and clients
• Leverage Azure and cloud-native components for optimal execution of the data processing activities

Use-cases support

• Collaborate closely with use cases to gather and develop feature requirements and the availability of data assets
• Ensure SLA’s in case of failure and assist quickly with hotfix and bugfix development
• Assist use-cases on exploration and machine learning capabilities through workshops and knowledge sharing sessions

Focus

• Data architecture
• Software engineering
• Use-cases support

Qualifications

• Excellent understanding of software engineering principles
• Excellent understanding of data quality measures
• Experience with Azure Data Factory, Azure Data Lake, Databricks and spark, and apache Airflow
• Experience with Python development
• Experience in data modelling
• Knowledge in cloud-native architectures and best practices
• Experience with Azure PaaS and IaaS offerings

KPIs

• Story points accomplished per sprint
• On-time sprint goal completion
• # of bugs and defects post-release
• Use case satisfaction with development and support
• Codebase satisfactory level, measured by quality gates

Start: Asap
Längd: 6 månader med option på förlängning
Ort: Remote