Role: Kubernetes/Spark/Scala
Location: Richfield, MN (Initially Remote)
Yrs. of experience: 10+ Yrs.
Mode of employment: Full-Time
Job Description:
Must have skills: Kubernets, Spark, SQL, Scala and Azure
Hands on experience in Pyspark, Spark SQL programming.
Should have hands on in Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault.
Good knowledge in Azure concepts like Azure service principles.
Airflow scheduling .
Skilled in creating design documentation and knowledge of Data Engineering tools and technologies.
Expertise in cloud related big data integration and infrastructure tech stack using Azure & Apache Spark.
Very good data engineering mindset to build, maintain piplelines and resolve failures.
