Our client is actively seeking a highly skilled and experienced Senior Level Engineering Consultant with expertise in AWS, Python, and AWS Glue. The ideal candidate will be responsible for designing, developing, and maintaining scalable and robust data pipelines and solutions using these technologies. This role requires a deep understanding of cloud-based infrastructure, data engineering, and software development practices.
Key Responsibilities:
- Architect, design, and develop data pipelines and ETL processes using AWS Glue and Python to support data integration and analytics.
- Utilize AWS services such as EC2, S3, Lambda, RDS, and Redshift to build scalable and secure cloud-based solutions.
- Implement data extraction, transformation, and loading (ETL) workflows to manage data from various sources into a centralized data warehouse or data lake.
- Optimize data processing and storage solutions for performance, cost, and scalability.
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Implement monitoring, logging, and alerting mechanisms to ensure the reliability and performance of data pipelines.
- Ensure data security and compliance with industry standards and best practices.
- Create and maintain comprehensive documentation for data pipelines, infrastructure, and processes.
Qualifications:
- Minimum of 5 years of experience in a similar role with a strong focus on AWS, Python, and AWS Glue.
- Proficiency in AWS services (EC2, S3, Lambda, RDS, Redshift), Python programming, and AWS Glue for ETL processes.
- Strong understanding of data warehousing concepts, data modeling, and ETL best practices.
- Excellent analytical and problem-solving skills with the ability to troubleshoot complex data and infrastructure issues.
- Strong interpersonal and communication skills to work effectively with cross-functional teams.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
Preferred Qualifications:
- Certifications: AWS Certified Solutions Architect, AWS Certified Data Analytics, or other relevant AWS certifications.
Additional Skills:
- Experience with other data integration tools, big data technologies (such as Hadoop, Spark), and data visualization tools.
Does this sound like you? Apply here for more information!
