Sr Data Engineer Strictly W2 Only
Experience: 7+years
Location: Charlotte, North Carolina (OnSite)
Job Summary
We're looking for a hands-on, collaborative Data Engineer to join our Data Services team. In this role you'll have the opportunity to build and troubleshoot ingestion pipelines for multiple sources of data. You will also work closely with our business intelligence and reporting solutions team to help develop valuable data models and visualizations for the business.
We’re currently leveraging AWS cloud and using a range of AWS services like S3, DynamoDB, Athena, Redshift, SQS, Lambda and Glue.
However, we are migrating to Snowflake as our primary data warehouse platform for new projects and developing a new data pipeline architecture
Job Responsibilities
Work with data analysts to build pipelines for required projects and requests
Define, build, test, and implement scalable data pipelines using python and SQL
Monitor pipeline performance and efficiency
Troubleshoot data related issues including missing data, poor data quality, etc.
Collaborate with analytics and reporting teams to develop data models that feed business intelligence tools
Maintain code via CI/CD process as defined in our Azure DevOps platform
Job Qualifications
7+ years in an ETL or Data Engineering roles; building and implementing data pipelines and modeling data
Leverage Python to create maintainable, reusable, and complex functions
Strong SQL skills to write efficient queries and improve inefficient ones
Familiarity with AWS data services: S3, DynamoDB, Athena, Redshift, Lambda, Glue, SQS, SNS, and API Gateway
Experience managing Snowflake instances, including data ingestion and modeling
Experience with Azure Cloud Services, Azure Data Factory and data warehousing skills on traditional platforms.
Strong understanding of Azure data services (Azure SQL Database, Azure Data Lake, HDInsight, Stream Analytics).
Highly self-motivated and directed with an attention to detail
Persuasive and professional communication skills (presentations, documentation, and emails)
We do not discriminate against any employee or applicant for employment on the basis of race, color, religion, gender, sexual orientation, national origin, age, disability, or any other legally protected status. We believe in creating a workplace that is free from discrimination, harassment, and retaliation, and we strive to foster a culture of respect, inclusion, and belonging.
