Background - 1 Onsite Lead Developer with 15+ years of relevant hands-on experience and 2 Onsite Developers with 8-10 years of relevant hands-on experience in managing IT Projects with specific experience in managing Development related to Data Visualization focused on the SDLC Waterfall and Agile methodologies, Good to have experience of creating and managing systems/processes related to the Compliance of Audits done by Federal Government focused on the SDLC in Banking and Financial Services Companies
Responsibilities-
· Hands-on development experience and understanding in designing
and developing data processing patterns to simplify the complexity of real-world data engineering architecture. Patterns that are cost-efficient and scalable provide performance and reliability of a modern Lakehouse, with low-latency of streaming.
· Understand the design and develop the standard framework modules, high-performance services and client libraries for big data using one or more tools from AWS, Azure, Kubernetes, Spark, DBT, Databricks and Snowflake, AWS S3, and Azure Blob Store.
· Hands-on experience in operationalizing tensof hundreds of data pipelines, deploying, testing & upgrading pipelines and best practices to
eliminate operational burdens for managing and building high quality data pipelines.
· Experience in query optimizer and execution engine that's fast, tuning free, scalability, ACIDtransactions and timetravel patterns using spark jobs, DBT on Databricks and snowflake.
· Quickly evaluatevarious technologiesand complete POCdriving architecture design for the applications.
· Work in complexenvironment with multilocation teams.
· Work in team of agiledevelopers.
