Job Title: Product Support Lead – Azure – Databricks Data Warehouse Operations with TWS

Location: Jersey City, NJ

About the Role:

We are seeking an experienced and detail-oriented Product Support Lead to join our Data Warehouse Operations team. This role will focus on maintaining, monitoring, and troubleshooting data pipelines and batch processes within a complex architecture that includes Azure, Databricks, and TWS (Tivoli Workload Scheduler). You will be responsible for ensuring the smooth operation of critical data workflows, addressing issues in real-time, and collaborating with cross-functional teams to improve our data infrastructure.

Key Responsibilities:

• Monitor and ensure the health and stability of data pipelines and batch jobs running across Azure, Databricks, and TWS.

• Proactively identify, investigate, and resolve data pipeline failures or performance bottlenecks.

• Lead the triage and troubleshooting of production issues, working closely with engineering and operations teams.

• Collaborate with data engineers to optimize the performance and scalability of data workflows.

• Ensure adherence to SLAs and report on pipeline performance metrics.

• Maintain and update operational runbooks, documenting key workflows and troubleshooting steps.

• Manage the lifecycle of TWS job schedules, ensuring seamless batch processing and on-time execution.

• Provide leadership and mentorship to junior support team members.

• Develop and implement continuous improvement strategies for data operations.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.

• 15+ years of experience in a data operations or product support role, preferably in data warehouses or cloud-based environments.

• Strong experience with Azure cloud services, including data storage (e.g., Azure Data Lake, Blob Storage) and compute (e.g., Azure Databricks).

• Hands-on experience with Databricks for data engineering, ETL processing, and pipeline orchestration.

• Deep understanding of TWS (Tivoli Workload Scheduler) for batch processing and scheduling.

• Strong troubleshooting skills, with the ability to quickly diagnose and resolve production issues.

• Knowledge of database technologies (SQL, NoSQL) and data integration tools.

• Excellent communication skills, with the ability to work collaboratively across technical and business teams.

• Strong organizational skills and the ability to manage multiple priorities in a fast-paced environment.

Preferred Qualifications:

• Experience with Python or Scala for data processing and scripting.

• Familiarity with CI/CD pipelines and DevOps practices in data environments.

• Knowledge of ITIL processes and best practices for incident and problem management.

• Experience working in an Agile/Scrum environment.

Thanks

ANNU GULATI

NuTech Information Systems

1177 Summer Street, Suite 202,

Stamford, CT 06902

annu@nutechsoft.com

Direct : 203-554-1523

( P) 203-961-8911 Ext230

Nutech Information Systems

New Jobs

Product Support Lead – Azure – Databricks Data Warehouse Operations