Clearance : DV Introduction: Hexegic is seeking to recruit a skilled an innovative data/ software engineer to join our expanding team.
This role is essential for helping customer build and maintain data pipelines and applications using proprietary commercial software, ensuring data driven projects can be rapidly prototyped and delivered in line with customer needs.
Objective: The primary role of the Data Engineer is to design, develop and maintain bespoke full end-to-end data projects.
This role involves working closely with data scientists, analysts, product owners and other engineers to ensure seamless data integration and software functionality.
Key Responsibilities: Application Development.
Python proficiency preferred, or a familiarity with similar languages.
API awareness for data retrieval and integration into data processing pipelines.
Understanding of user agents.
Proficiency in collaborative software development practices, including version control and pull request management within team settings.
Data Engineering .
Developing front-end/user-facing application development.
Building "ontologies" to aid in the creation and management of structured data assets.
Data pipeline building (Pandas/SQL/similar), for the creation of simple/bespoke data pipelines.
PySpark knowledge for more larger scale data pipelines.
Understanding of pipeline scheduling, health checks and identifying potential mechanisms of failure to ensure digital continuity.
Personal Qualities.
The ideal candidate will: Have the capability to independently own and execute tasks, whilst effectively reporting within a larger team framework.
Have strong, natural IT skills.
Be inquisitive with strong interpersonal skills.
Be able to communicate complex material in a clear and concise manner to a range of user abilities including management.