We are pursuing a highly motivated individual with strong problem-solving skills to take on the challenge of structuring and engineering data and cutting-edge AI model evaluation and reporting processes.
As a Data Engineer, you will:
- Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling.
- Design and develop data pipelines to automate repetitive tasks within data science and data engineering.
- Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems.
- Partner with software engineering teams to deploy and validate production artifacts.
- Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams.
- Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain.
- Comfortable leading projects in environments with undefined or loose requirements.
Qualifications :
- Bachelor’s degree in computer science, Information Systems, or another related field
- 7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in a Big Data environment.
- Experience in building data pipelines through Spark with Java/Scala on Hadoop or Object storage.
- Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.
- Experience working on Nifi will be an added advantage.
- Experience working with APIs will be an added advantage.
- Experience and working in a Unix environment is an added advantage
- Strong analytical skills are required for debugging production issues, providing root causes, and implementing the mitigation plan.
- Ability to multi-task across multiple projects, interface with external/internal resources, and provide technical leadership to junior team members.
- Flexibility to work as a member of matrix-based diverse and geographically distributed project teams.
- Experience of working in Agile teams.
