Senior Data Integration Engineer
ApplyLocations: London, United Kingdom
Time Type: Full time
Posted on: Posted 30+ Days Ago
Job Requisition ID: R-014328
Main Purpose:As a highly experienced Data Engineer in our Digital Transformation Team, you will play a crucial role in developing advanced data abstraction layers to facilitate seamless integration between legacy trading systems (built on WPF, .Net (C#, VB), Oracle, Java) and our modern AWS-based data and analytics stack.
Your expertise will drive the successful transformation of our data infrastructure, furthering the use of advanced analytics and data-driven decision-making across the company. You will manage a specialist team of engineers and scientists in order to achieve your objectives.
Knowledge Skills and Abilities, Key Responsibilities:Abilities, Experience and Qualifications Bachelor's or Master's degree in Software Engineering, Computer Science or a related field.Proven experience in enterprise scale data engineering.Expertise in working with legacy systems (SQL Server, Oracle, Java) and integrating them with cloud platforms, preferably AWS (S3, RDS, Lambda, Glue, Redshift).Must be capable of working with multiple data structures, including but not limited to JSON, XML.Exposure to data mapping/design tools such as Altova suite (MapForce), Schematron, ERWIN.Worked with Apache Spark, Kafka, Hive, Hbase, Flume, Sqoop, Trino.Proven experience with Object Relational Mapping systems (ORMs) and SOAP / REST, APIs.Expert programming skills in Java and Python.Familiarity with SQL and NoSQL databases, Data Modelling, and ETL processes, Change Data Capture (CDC).Knowledge of data warehousing principles and architectures.Experience with data governance and security.Experience in a Commodity Trading, Financial Markets or Logistics Management environment is desirable.Key Responsibilities Develop abstraction layers to integrate disparate systems, ensuring data consistency, validity, traceability and accessibility for self-service by data scientists and analysts.Work closely with stakeholders to understand data requirements and translate business needs into well-structured technical specifications.Collaborate closely with our Trading Technology, Data Science and Cloud DevOps teams.Manage a small team of engineers / computer scientists / data scientists.Competencies Ability to solve difficult technical problems under pressure.Ability to communicate effectively with a diverse set of stakeholders across business lines and technologies.Understanding and experience implementing software engineering best practices.Ability to manage and prioritize your and others' work.Key Relationships and Department Overview:You will report to the Head of the SSI Team & CTO who reports to the CIO and Chief Data Scientist.The Digital Transformation Team is a joint venture between Trading Technology and the Data Science and Engineering Team.Equal Opportunity Employer We are an Equal Opportunity Employer and take pride in a diverse workforce. We do not discriminate in recruitment, hiring, training, promotion or other employment practices for reasons of race, colour, religion, gender, sexual orientation, national origin, age, marital or veteran status, medical condition or handicap, disability, or any other legally protected status.
#J-18808-Ljbffr