The effort would involve managing the databricks platform, provide, develop architectural solutions and implement new cutting databricks
features(e.g. AI/ML), suggest new capabilities, monitor the platform for efficiencies, continue to progress the platform by applying
incremental capabilities – Premium storage etc. and be overall owner of the environment. Also would need the team to integrate with
new source systems, put in development effort to support PI effort and work on defects/bugs identified in production.
Identify gaps in technical architecture and advise on best practices
Data structure and storage best practices
Data governance and data strategy
DevOps support
Work with architects and multiple partner vendors
Design the solution for the features, obtain Approvals from Business and IT Product Owners
Develop and implement architectural changes as needed
Provide data Structure ,Data Governance and storage best practices
Develop new integration pipelines
Develop fixes for defects, issues identified in production
