Lead Data Engineer (Hybrid)
This is a Hybrid role
Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead teams working on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. You will also help us drive the vision forward for data engineering projects by helping us extend and improve standards, and by building high performing, collaborative, enthusiastic teams.
Responsibilities
- Evaluating architectural designs, technical tradeoffs, and solutions to problems to guide teams to deliver sustainable data and compute environments to facilitate usage of data assets.
- Coaching engineers to improve their technical and soft skills.
- Align teams with Annalect’s technical standards.
- Ensure compliance with critical security requirements.
- Leading collaboration with product and design to ensure delivery deadlines are met.
- Design, build, test and deploy scalable and reusable systems that handle large amounts of data
Qualifications
- 6+ Experience designing and managing data flows
- Experience designing systems and APIs to integrate data into applications
- 9+ years of Linux, Bash, Python, and SQL experience
- 6+ years using Spark or Hadoop ecosystem software
- 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift
- 6+ years managing team of developers
- Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges
Additional Skills
- Educational attainment of a degree in Computer Science or Engineering or comparable professional experience.
- Understanding and experience with Agile methodologies and their application to teams.
- Experience working with global teams and managing offshore resources.
- Experience managing external vendors and evaluating and integrating third-party solutions.
