Position Summary:
As a Senior Data Engineer, you will support data related initiatives within Data Strategy and Architecture (DSA) department with a focus on enabling data operations and analytics platform and enabling data for consumption by data operations, reporting, business intelligence and analytics user community. This role is responsible for developing data ingestion patterns, data extraction, load, and transformation (ETL) programs for the initiative, developing and executing ETL test plans, and automating the ETL process through scheduling and exception-handling routines.
Essential Functions:
- Works with business teams to understand business use cases, requirements and translate business requirements into data requirements.
- Works with applications specialists (SMEs) to understand data sources and perform data discovery and document the learnings
- Creates ETL system design specifications and data flow diagrams.
- Prepares technical and system specifications documents including Source to Target Mapping covering data sources integration patterns, controls, data transformation and load rules.
- Designs, develops, tests and deploys ELT programs to extract, stage, cleanse, transform and load the data needed.
- Troubleshoots, maintains, and supports the warehouse and the downstream data feeds sent to consuming applications.
- Supports system, integration and UAT testing.
- Assists with performing source data quality assessments
- Performs root cause analysis, resolves production issues and support production teams.
- Performs other job duties as assigned and fulfill report and data extraction requests as needed
- Adherence to legal and company standards
Education and Experience:
- Bachelor’s degree in software engineering, computer science, information technology or related field is required.
- Five (5) years’ experience in ETL/ELT development using Informatica products such as data Catalog, Data Integration and Data Quality etc.
- Proficiency in warehousing architecture techniques, including Data Lake, ODS, DM, and EDW
- Experience in one or more scripting languages: Python, Boto3, Pandas, SQL and/or Kafka
- Experience working in Analytics Databases like Snowflake, Redshift and BigQuery
- Experience in snowflake and AWS Cloud technologies will be an added advantage
- Ability to analyze a company’s big-picture data needs
- Strong project management skills
- Clear communication skills
- Ability to troubleshoot and solve complex technical problems
- Consumer Financial Services background, preferably credit card business knowledge
Summary of Qualifications:
- Ability to gather requirements, apply strong analysis and design skills to build ELT and system specifications
- Proficient in designing and developing SQL Queries & ETL Programs
- Strong project management & analytical skills
- Ability to work with data warehouse users, IT Business Analysts
- Strong problem solving, written and verbal communication skills
- Hands on experience with SQL-Based databases highly beneficial (and preferred)
- Knowledge of Cloud-based solutions and databases beneficial (e.g. Snowflake)
- Proficiency in Python preferred.
