We are seeking a highly skilled and motivated Data Engineer to join our data management team. The data management team is responsible for delivering clean – defined, reliable, consistent, and actionable – data to internal and external stakeholders. This role assists in developing and improving upon all constituent parts of the data engineering lifecycle using cloud-native technologies. The ideal candidate will possess strong technical skills in data discovery, modeling, and data movement processes/tools, along with a strong understanding of data architecture and design.
Responsibilities:
- Develop and implement data dictionaries and metadata catalogs for performance enhancements, data classification, lineage, or other data maturity efforts.
- Design and implement dynamic, efficient, and scalable data pipelines to be used in various stages of the data engineering cycle to support the data architecture.
- Use version control systems for data pipelines and infrastructure as code (IaC) to manage changes and updates efficiently.
- Work with both structured and unstructured data to support multiple analytical needs.
- Optimize data retrieval and develop dashboards, reports, and visualizations for business use.
- Monitor and optimize the performance of databases and data pipelines to ensure high throughput and low latency, supporting the scaling of data processing systems.
- Maintain comprehensive documentation of data landscape including runbooks, best practices, and data maturity stage tracking or goals. Ensure documentation is clear and accessible to both technical and non-technical stakeholders.
- Work closely with business and technical resources across the organization to ensure data needs are met and to foster a data-driven culture. Communicate complex data concepts and processes effectively to stakeholders with varying levels of technical expertise.
Qualifications:
- Education: Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field.
- Desired Experience: 2+ years of experience in a role involving Data Analysis, SQL query writing, Python scripting for data processing, and ETL development.
- Desired Technical Skills:
- Experience with ETL tools and methodologies.
- Understanding of data warehousing concepts and experience with data modeling.
- Experience with Data Analysis tools and techniques.
- Proficiency in SQL and experience with database management systems.
- Python programming skills, especially for data manipulation and visualization
- Analytical Skills:
- Ability to analyze complex data sets to identify trends, patterns, and insights.
- Ability to define and document data in technical and business terms.
- Communication Skills: Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical audiences.
- Problem-Solving: Strong problem-solving skills and the ability to think critically to overcome challenges in data management and processing.