Staff Data Engineer (Insights) We are looking for a Staff Data Engineer to join our client.
Their mission is to help create seamless shopping experiences through a vast global network, community engagement, and advanced enterprise technology.
This role focuses on enabling brands and retailers to gather, analyze, and act on valuable user-generated content at a massive scale.
Key Responsibilities: Design, build, and maintain large-scale, distributed data systems that support the company's infrastructure and services.
Develop data pipelines, optimize data storage and retrieval processes, and ensure the reliability and scalability of the data architecture.
Collaborate closely with cross-functional teams to understand data needs and provide technical solutions.
Implement and advocate for software engineering best practices to ensure maintainable and efficient data systems.
Play a key role in troubleshooting issues, continuously improving processes, and shaping the future of data-driven decision-making.
Who you are: Bachelors degree in Computer Science or a related field.
7+ years of experience building robust, scalable, distributed data systems using open-source and public cloud technologies.
Expertise with data orchestration tools such as Apache Airflow or Dagster.
Proficiency in big data storage and processing technologies such as DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, PostgreSQL/MySQL.
Strong knowledge of event-driven architectures and streaming technologies such as Apache Kafka, Kafka Streams, or Apache Flink.
Experience with public cloud platforms like AWS, GCP, or Azure, and infrastructure as code tools like Terraform.
Solid grasp of software engineering practices including CI/CD, agile development, and version control systems like Git.
Excellent problem-solving, technical leadership, and analytical skills.
Ability to communicate effectively and work collaboratively with cross-functional teams.
Passion for staying up-to-date with emerging data technologies and trends.
Why join us?
Customer-focused: We view our success through the lens of our customers' outcomes and prioritize their needs.
Transparency & Integrity: We believe in the power of authentic feedback and always strive to do the right thing.
Performance-driven: We are passionate, curious, and driven, always seeking to push boundaries.
Innovative: We embrace agility and experimentation, continuously seeking ways to improve.
Inclusive & diverse: We value diverse perspectives and believe that fostering an inclusive culture enhances creativity and performance.
Any further questions on the role, please feel free to reach out to Brendan McCrory directly