Permanent Job Alert:
Title: Senior Data & AI Infrastructure Engineer
Location: Plano
Salary: $165,000
Industry: FinTech
Contact: phoebe.kemp@forsythbarnes.com
Brief Overview:
The Senior Data Engineer is responsible for leading the transformation of the Company's technology data lake and analytics platform within the AWS ecosystem. This role is pivotal in enabling Data Science and Advanced Analytics by designing and building the necessary infrastructure to support these advanced capabilities. The Senior Data Engineer works collaboratively with technology, business analysts, and product team members to implement innovative data and AI solutions that drive our next-generation initiatives.
We are seeking a dynamic individual who thrives in a fast-paced, transformation-focused environment where creativity and risk-taking are encouraged, but where production stability and quality are also paramount. This is a unique opportunity to be a key contributor to our cutting-edge data analytics and AI development efforts.
JOB Responsibilities:
- Define and implement a Data Lake reference architecture on AWS.
- Define the data pipeline and ingestion workflow, incorporating modeling from different data sources and types, including voice recordings.
- Design and build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS technologies.
- Build analytics tools that provide actionable insights into customer acquisition, operational efficiency, and key business performance metrics, leveraging modeling techniques for analysis.
- Assemble large, complex data sets that meet functional / non-functional business requirements
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Work with stakeholders including Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
- Create data tools for analytics and business analyst team members that assist them in building and optimizing our product into an innovative industry leader.
- Provide stewardship to maintain data quality, uphold regulatory guidelines, and data security.
- Manage the data dictionary, ensuring alignment with AI modeling terminology and standards.
Job Requirements:
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) and working familiarity with various databases.
- Experience building and optimizing data pipelines, architectures, and small to medium data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement, utilizing AI modeling techniques for comprehensive analysis.
- Strong analytic skills related to working with structured and unstructured datasets
- Build processes supporting data transformation, data structures, metadata, dependency.
- A successful history of manipulating, processing, and extracting value from disconnected datasets, with data extraction and pattern recognition.
- We are looking for a candidate with 5 years of experience in a Data Engineer role, who has attained a degree in Computer Science, Statistics, Information Systems.
- Experience with AWS cloud services: EC2, Lake Formation, Athena, Glue, S3 Storage, IAM; Additionally: Grafana, Docker, Datahub, Salesforce.
- Demonstrated ability to work with generative AI technologies and broader AI concepts, including ChatGPT API, LangChain, vector databases, SageMaker, and embeddings models.
- Experience with MLOps practices and deploying ML containers is a plus.
If you're interested, please apply by emailing a copy of your most up-to-date CV and your current availability.
Please feel free to pass this on to anyone you think it may suit or anyone you know may be interested.
