Job Title: Senior Big Data Developer Duration - 12 Months Location - Belfast Hybrid - 3 days in the office Job Description: We are seeking a highly motivated and detail-oriented Big Data Platform Development Engineer to join the team.
The ideal candidate will be responsible for onboarding new users and clients, setting up build pipelines, reviewing code and queries, and performing coding, testing and performance tuning of jobs.
The candidate should have a strong technical background in Big Data technologies, such as Hadoop, Spark, and Hive, and be comfortable working with complex systems.
The candidate should also have excellent communication and organizational skills to collaborate with both internal and external stakeholders.
Candidate will have the opportunity to be a contributor to the Markets Data Strategy and contribute towards the goal of increasing revenue by providing key analytics/MIS/metrics for decision making, whilst also improving regulatory quality and accuracy.
The candidate will work directly with bright and innovative individuals on both the business and technology side, giving broad exposure to front-to-back trade processing and electronic trading across all asset classes.
The successful candidate can make a significant difference to business performance.
Key Responsibilities: - Onboard new users and clients to the Big Data platform.
- Collaborate with cross-functional teams to identify and prioritize data requirements, data quality issues, and performance bottlenecks - Setup build pipelines to automate the build and deployment process.
- Responsible for conducting code reviews, detecting suboptimal queries and performance issues.
- Guide teams to follow most optimal industry standard practices.
- Design and develop highly scalable and fault-tolerant big data solutions on the Cloudera platform.
- Monitor and optimize risk data platform for performance, scalability and cost-effectiveness Qualifications: - Bachelor's or master's degree in Computer Science, Information Systems, or a related field - 5+ years of experience in big data technologies, with at least 3 years of experience in Apache Spark and Cloudera - Strong knowledge of big data technologies, including Hadoop, Hive, HBase, Kafka, and YARN - Excellent programming skills in Python and/or Scala - Strong analytical, problem-solving, and communication skills - Ability to work independently and collaboratively in a fast-paced, agile environment