Data Engineer Lead
Job Descriptions
A CRG client in the Statesville area is currently seeking a highly skilledData Engineering Lead to join their innovative and growing team. This role is crucial in driving the company's data infrastructure and pipelines and ensuring seamless management, and optimization of data systems. The ideal candidate will possess extensive experience in data engineering, strong leadership abilities, and a passion for leveraging data to enhance operational efficiency and business intelligence. As a Data Engineering Lead, you would play a pivotal role in shaping the future of the company's data infrastructure and contributing to its mission of delivering reliable energy solutions to the community.
Location: Statesville, NC (Hybrid 2 days on-site)
Pay: $125,000+ yearly
Key Responsibilities:
- Lead and mentor the data engineering team, focusing on AI and automation.
- Collaborate across teams to drive development from conception to production.
- Design, implement, and manage CI/CD pipelines to ensure smooth software deployment.
- Enhance processes for infrastructure and application optimization.
- Ensure the security, compliance, and scalability of the infrastructure, application, and services.
- Document infrastructure, processes, and procedures clearly.
- Create, maintain, and optimize .NET applications to support business needs.
- Develop and maintain monitoring and logging for Azure resources.
- Support and administer legacy Oracle and SQL databases.
- Assemble large datasets that meet business requirements.
- Build infrastructure for optimal data extraction, transformation, and loading using Azure, ETL tools, and SQL technologies.
- Provide architectural feedback to improve application performance and reliability.
- Automate repetitive administration tasks using scripting and configuration management tools.
- Develop and implement backup and disaster recovery plans.
- Stay current with emerging technologies and offer recommendations.
Qualifications:
- Azure Expertise: Extensive experience with Azure, including database administration, monitoring, logging, and infrastructure management.
- SQL and Oracle Proficiency: Five years of experience administering SQL and Oracle environments, with a focus on SQL/PL-SQL performance tuning, query optimization, and database management.
- Data Governance: Demonstrated expertise in establishing and implementing data governance frameworks and ensuring compliance with data management best practices.
- Data Engineering Lead Experience: Proven track record in leading data engineering teams, with hands-on experience in designing, implementing, and optimizing data systems.
- Scripting Proficiency: Expertise in scripting languages such as Python, PowerShell, and Bash for automating processes, developing CI/CD pipelines, and managing infrastructure.
- ERP Systems: Experience in working with ERP systems, including data migration, implementation, and strategy development.
- ETL Pipelines: Skilled in designing and building ETL pipelines in cloud environments, optimizing data extraction, transformation, and loading processes.
- Strategic Development and Automation: Strong background in developing and executing strategies for automating data processes, enhancing operational efficiency, and supporting business intelligence initiatives.
- Cloud and DevOps: Four-plus years of experience in DevOps and cloud environments, with a focus on automating and scaling infrastructure, ensuring security, and maintaining high availability.
Category Code: JN008