Data Engineer

Details of the offer

Data Engineer - Analytics/Modelling Location: Birmingham/London, UK Mode: Hybrid Responsibilities Lead the design and implementation of AWS-based data products that leverage reusable datasets.
Collaborate on creating scalable data solutions using a range of new and emerging technologies from the AWS platform.
Demonstrate AWS data expertise when communicating with stakeholders and translating requirements into technical data solutions.
Manage both real-time and batch data pipelines.
Our technology stack includes a wide variety of technologies such as Kafka, AWS Kinesis, Redshift, and DBT.
Design and model data workflows from ingestion to presentation, ensuring data security, privacy, and cost-effective solutions.
Create a showcase environment to demonstrate data engineering best practices and cost-effective solutions on AWS.
Build a framework suitable for stakeholders with low data fluency.
This framework should enable easy access to data insights and facilitate informed decision-making.
Requirements Expertise in the full data lifecycle: project setup, data pipeline design, data modelling and serving, testing, deployment, monitoring, and maintenance.
Strong data architecture background in cloud-based architectures (SaaS, PaaS, IaaS).
Proven engineering skills with experience in Python, SQL, Spark, and DBT, or similar frameworks for large-scale data processing.
Deep knowledge of AWS services relevant to data engineering, including AWS Glue, AWS EMR, Amazon S3, Redshift.
Experience with Infrastructure-as-Code (IaC) using Terraform or AWS CloudFormation.
Proven ability to design and optimize data models to address data quality and performance issues.
Excellent communication and collaboration skills to work effectively with stakeholders across various teams.
Ability to create user-friendly data interfaces and visualizations that cater to stakeholders with varying levels of data literacy.


Nominal Salary: To be agreed

Source: Talent_Dynamic-Ppc

Requirements

Solutions Analyst

About the role: Are you passionate about legal innovation and digital transformation, and want to join an international law firm that is at the cutting edge ...


Gowling Wlg - West Midlands Combined Authority

Published 13 days ago

Mot Tester

Job DescriptionJob IntroductionAn Inchcape Vehicle Technician MOT Tester will have superb technical knowledge, a professional attitude, and will ensure that ...


Jago Consultants - West Midlands Combined Authority

Published 13 days ago

Work From Home As An Online Computer Science Tutor - Part Time

Explore teaching opportunities with Findtutors for Computer science courses through online instruction. We are actively seeking dynamic and innovative privat...


Findtutors - West Midlands Combined Authority

Published 13 days ago

Trainee Cloud Engineer (Career Pathway With Employment Guarantee)

Job Description Are you passionate about building and optimising cloud-based infrastructures to drive innovation and efficiency in modern businesses? Are you...


Nuyew Tech Academy - West Midlands Combined Authority

Published 13 days ago

Built at: 2024-11-27T20:21:31.560Z