Senior Data Analytics Engineer
Location: Chicago, IL (Hybrid 3x-4x per week)
Prodigy Resources is seeking a Senior Data Engineer specializing in data UX/visualization to join our dynamic data infrastructure and analytics team. In this pivotal role, you will lead the design, development, and maintenance of robust data pipelines. Your expertise will ensure that data is not only efficiently processed but also presented in intuitive visual formats that empower stakeholders to extract actionable insights.
Responsibilities:
- Design, build, and optimize scalable data pipelines to ingest, process, and transform large volumes of data from various sources.
- Develop efficient data models and schemas to support analytics and reporting requirements, ensuring data integrity and performance.
- Create compelling and interactive data visualizations that enable stakeholders to explore, analyze, and derive insights from complex datasets.
- Continuously improve the usability and accessibility of data visualization tools and dashboards to meet the needs of diverse users.
- Identify opportunities to optimize data processing and visualization performance, implementing best practices and efficient algorithms.
- Conduct exploratory data analysis to uncover patterns, trends, and correlations within the data, providing valuable insights to stakeholders.
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that address their needs.
- Implement rigorous testing and validation processes to ensure the accuracy, reliability, and consistency of data and visualizations.
- Document data pipelines, data models, and visualization designs to facilitate knowledge sharing and ensure maintainability.
- Provide mentorship and guidance to junior team members, promoting best practices and fostering a culture of continuous learning and improvement.
- Stay abreast of emerging trends, tools, and technologies in data engineering, data visualization, and UX/UI design, and evaluate their potential impact on our data infrastructure.
- May perform other duties as assigned.
Required Qualification:
- BS or BA degree in Computer Science or a related field
- 8+ years of relevant experience in data engineering with a focus on data visualization and user experience.
- Proficient experience in SQL, Python, Databricks, and PySpark.
- Demonstrate the ability to perform data analysis, interpret findings, and generate actionable insights to drive business decisions.
- Experience designing intuitive user interfaces. Experience with data visualization tools. Power BI and Superset/Preset preferred.
- Creative problem-solving skills and the ability to think critically to overcome challenges and achieve objectives.
- Ability to analyze complex datasets, identify patterns and trends, and translate insights into actionable recommendations.
- Excellent verbal and written communication skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.
- Ability to thrive in a fast-paced and dynamic environment, and willingness to adapt to evolving priorities and technologies.
- Strong collaboration and interpersonal skills, with a proven ability to work effectively in cross-functional teams.
- Experience with Git, Jira, AWS, and Infrastructure as Code (Terraform) preferred.