The Senior Data Engineer will design, code, test, and analyze software programs and applications. This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle. This role will also analyze and amend software errors in a timely and accurate fashion and provide status reports where required.
Ideal Skills:
- Python (must have excellent Python skills)
- IICS
- AWS
- Snowflake
Responsibilities:
- Work with Product team to determine requirements and propose approaches to address users' needs
- Analyze requirements to determine approach/proposed solution
- Design and Build Solutions using relevant programming languages
- Thoroughly test solutions using relevant approaches and tool
- Conduct research into software-related issues and products
- Bring out-of-box thinking and solutions to address challenging issues
- Effectively prioritize and execute tasks in a fast-paced environment
- Work both independently and in a team-oriented, collaborative environment
- Flexible and adaptable to learning and understanding new technologies
- Highly self-motivated and directed
Technical Skills Required:
- Hands on experience in developing Data Lake and Data Warehouse and Data Marts
- Experience in industry standard ETL/ELT tools
- Hands on experience with AWS cloud architecture and development using AWS resources like S3, Lambda, API Gateway, RDS, etc
- Proficiency in relational databases (Snowflake, Redshift, etc), database concepts and dimensional modeling
- Experience in data cleansing, data validation and data wrangling
- Proficiency in SQL and Scripting (Unix sell scripts, Python)
- Hands on experience in trouble shooting complex ETL and SQL problems
- Hands on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.
