Active Security Clearance Required
Job Summary
As a Senior Data Engineer, you will be responsible for designing, developing, and managing data solutions using Snowflake. You will work closely with data scientists, analysts, and other engineering teams to ensure the availability, performance, and scalability of our data warehouse. Your expertise will be crucial in creating and maintaining Snowflake environments, developing data pipelines, and implementing best practices for data engineering.
Key Responsibilities
- Snowflake Development and Management:
- Design and implement Snowflake architecture including data warehouses, databases, schemas, and tables.
- Develop and maintain ETL/ELT pipelines using Snowflake's native tools and SQL.
- Optimize Snowflake performance, ensuring efficient query processing and data retrieval.
- Monitor and manage Snowflake environments, including scaling and resource allocation.
- Data Pipeline Development:
- Build and automate data pipelines to ingest, process, and store data efficiently.
- Ensure data integrity, accuracy, and timeliness across pipelines.
- Collaborate with data engineering teams to design scalable data solutions.
- Collaboration and Support:
- Work closely with data scientists and analysts to understand data requirements and deliver solutions that meet their needs.
- Provide support for data-related issues and resolve them in a timely manner.
- Contribute to documentation and best practices for Snowflake development.
- Data Governance and Compliance:
- Implement data governance policies and procedures to ensure data security and compliance.
- Maintain and enforce data access controls and auditing mechanisms.
- Performance Tuning and Optimization:
- Analyze query performance and optimize Snowflake SQL queries and data models.
- Implement best practices for data loading and retrieval to enhance performance.
- Continuous Improvement:
- Stay updated with Snowflake's latest features and capabilities.
- Propose and implement improvements to existing data engineering processes and tools.
Qualifications
Required
- Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
- Experience: Minimum of 5 years of experience in data engineering with at least 3 years of hands-on experience with Snowflake.
- Expertise in Snowflake data warehouse platform, including Snowflake architecture, SQL, and Snowflake-specific features.
- Proficiency in ETL/ELT tools and data pipeline development.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and data integration tools.
- Strong SQL skills and experience with data modeling and data warehousing concepts.
Preferred
- Experience with data visualization tools (e.g., Tableau, Looker).
- Knowledge of data engineering frameworks and tools (e.g., Apache Airflow, DBT).
- Certifications related to Snowflake or cloud data engineering.
