Title: Data Quality Engineer
Location: Dallas, TX
Role Purpose
We are seeking a Lead Data Engineer to join our team of data experts. The ideal candidate will have a passion for designing and implementing end-to-end data solutions, from data ingestion and processing to analytics and reporting. As a Lead Data Engineer, you will work closely with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs. You will also be responsible for leading a team of data engineers and ensuring that all data engineering projects are completed on time and within budget.
Role Responsibilities
- Collaborate with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs
- Design and implement end-to-end data solutions using technologies such as Snowflake, Databricks, Azure
- Lead a team of data engineers and ensure that all data engineering projects are completed on time and within budget
- Develop and maintain data governance policies and procedures
- Build and maintain data pipelines and ETL processes using Python, Spark, and SQL
- Ensure data quality and integrity by developing and implementing data validation and testing strategies
- Design and implement data security measures to protect the confidentiality, integrity, and availability of our organization's data
- Provide technical leadership to the data engineering team and help them implement best practices in data engineering and data architecture
- Continuously monitor and evaluate the performance of data systems and make recommendations for improvements
- Stay up-to-date with the latest data technologies and trends and provide recommendations for their adoption
- Manage project timelines and deliverables
Skills & Experience
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
- 10+ years of experience in data engineering and data architecture
- Strong knowledge of data technologies, such as Snowflake, Databricks, Apache Spark, Dbt, Fivetran, Azure Data Factory
- Experience designing and developing end-to-end data solutions, data pipelines, and ETL processes
- Strong understanding of data governance, data quality, and data security principles
- Strong expertise in Python and SQL
- Excellent problem-solving and analytical skills
- Strong communication and leadership skills
- Ability to work independently and as part of a team
- Experience working in an Agile environment
- Experience managing projects and teams
- Experience in pre-sales activities, including scoping and estimation of projects, and presenting solutions to clients
- Experience in complete project life cycle activities on development and maintenance projects.
- Knowledge and experience in developing software using agile methodologies.
- Experience working with a globally distributed team.
- Proven track record of technical leadership roles delivering solutions within defined timeframes.
- Skilled in building relationships with clients and in practice development activities.
- Demonstrated success in performing work and managing complex and/or large consulting projects.
- Excellent written and oral communication skills; Ability to communicate effectively with technical and non-technical staff.
- Retail domain knowledge is preferred.