Job Description:
Skills. Datawarehouse using AWS, Glue, redshift, price Mart, and python.
AWS Data Engineer :
- Overall experience of 10 + years with extensive hands-on experience in AWS cloud, database and data warehouse architecture and delivery
- As Data Engineer will be responsible for providing the required data engineering capabilities that will enable ingestion and sustaining of these new data sets
- Provide Deep expertise on data sources, required transformations, quality, consistency, velocity, access
- Extensive hands-on experience implementing data migration and data processing using AWS services: VPC/SG, EC2, S3, AutoScaling, CloudFormation, LakeFormation, DMS, Kinesis, Kafka, Nifi, CDC processing Redshift, Snowflake, RDS, Aurora, Neptune, DynamoDB, Cloudtrail, CloudWatch, Docker, Lambda, Spark,Glue, Sage Maker, AI/ML, API GW, etc.
- Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc