We are currently seeking an experienced Data Engineer who is proficient in utilizing Azure and DBT. As part of our dynamic and growing data team, the successful candidate will be responsible for designing, developing, and managing data integration processes, ensuring that extraction, transformation, and loading (ETL) processes operate smoothly. In addition, they will contribute to the development and maintenance of databases, data architecture, data processing, and data provisioning.
Responsibilities:
- Design and build optimized and robust ETL processes using DBT.
- Develop and manage data pipelines, ensuring that they fulfill business requirements and align with company's data architecture.
- Leverage Azure for the development and deployment of scalable cloud-based solutions.
- Perform data profiling, data validation, and data quality checks.
- Implement and maintain optimal data pipeline architecture.
- Collaborate with data scientists and analysts in the development of data tools for analytics and data scientist team members.
- Participate in the planning and implementation of the data platform for collecting, connecting, analyzing, and visualizing data ensuring it aligns with the business goals.
- Adhere to compliances and maintain data privacy.
Qualification & Experience:
- BS or MS degree in Computer Science, Engineering, or a related subject.
- At least 3 years of experience as a data engineer.
- Profound experience with DBT and Azure.
- Strong knowledge of SQL, Python, and other data-related programming languages.
- Prior experience with data architecture, data migration and cloud-based data platforms.
- Knowledge of data management fundamentals and data storage principles.
- Understanding of various data architectures and concepts such as Data Lakes, Data Warehouses, ETL, ELT, and Business Intelligence tools.
