Position: AWS Data Engineer
Location: Bloomfield, CT (Onsite)
Duration: FTE/ Direct Hire
Job Description:
Relevant Experience:
- 7-10 years of hands on Pyspark/Databricks development experience.
- Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.
- Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
- Should have CICD experience using tools like GIT, Jenkins etc
- Should have extensive hands-on experience with SPARK and real time analytic frameworks, data streaming & Structured streaming.
- Knowledge in Databricks reporting.
- They need to be experienced in programming language (Python, Pyspark)
- Hands-on experience integrating open-source components into data-analytic solutions
- Working with vendors to enhance tool capabilities to meet enterprise needs
- Willingness to continuously learn & share learnings with others
- Strong troubleshooting and performance tuning skills.
- Experience building multi-tenant, virtualized infrastructure a strong plus
Technical/Functional Skills:
- AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL, Sprak Streaming, Data Streaming
