Job Overview:
We are looking for a highly skilled Kubernetes Expert with specialized experience in AWS Elastic Kubernetes Service (EKS) to join our team. The ideal candidate will have a deep understanding of Kubernetes architecture, AWS EKS, and best practices for deploying, managing, and scaling containerized applications. Additionally, a conceptual understanding of Spark workloads is highly desirable. This role involves designing, implementing, and maintaining robust Kubernetes infrastructure to support our diverse applications and services. Spark/Hadoop administrators with Kubernetes will be a plus for this role.
Key Responsibilities:
- Kubernetes and EKS Management:
- Design, deploy, and manage Kubernetes clusters on AWS EKS.
- Implement best practices for Kubernetes architecture, including cluster setup, configuration, and management.
- Ensure high availability, scalability, and resilience of Kubernetes clusters.
- Spark/Hadoop administrators with Kubernetes
- Container Orchestration:
- Develop and maintain Helm charts for Kubernetes resource management.
- Optimize Kubernetes deployments for resource efficiency and performance.
- Automate the deployment process using CI/CD pipelines and infrastructure-as-code tools like Terraform.
- Security and Compliance:
- Implement robust security practices within Kubernetes clusters, including RBAC, network policies, and pod security policies.
- Ensure compliance with organizational security standards and regulatory requirements.
- Manage secrets and sensitive data using Kubernetes secrets and AWS Secrets Manager.
- Monitoring and Logging:
- Set up and maintain monitoring and logging solutions for Kubernetes clusters using tools like Prometheus, Grafana, and AWS CloudWatch.
- Implement alerting mechanisms to proactively identify and resolve issues.
- Performance Optimization:
- Analyze and optimize the performance of Kubernetes clusters and containerized applications.
- Implement auto-scaling policies to dynamically adjust resources based on workload demands.
- Collaboration and Support:
- Collaborate with development teams to design and implement scalable and efficient containerized solutions.
- Provide technical support and guidance on Kubernetes-related issues.
- Conduct training sessions and knowledge sharing with team members to promote best practices.
- Spark Workloads (Good to Have):
- Conceptual understanding of Apache Spark workloads, including job execution, resource allocation, and performance optimization.
- Experience with running Spark jobs on Kubernetes is a plus.
Required Skills and Experience:
- Technical Expertise:
- Extensive experience with Kubernetes and managing Kubernetes clusters in production environments.
- In-depth knowledge of AWS EKS and AWS services integration.
- Proficiency in containerization technologies such as Docker.
- Strong understanding of Helm, Terraform, and other infrastructure-as-code tools.
- Spark/Hadoop administrators with Kubernetes
- Security and Networking:
- Expertise in implementing security best practices within Kubernetes environments.
- Knowledge of Kubernetes networking, including network policies and service meshes.
- Monitoring and Automation:
- Experience with monitoring and logging tools such as Prometheus, Grafana, and AWS CloudWatch.
- Strong automation skills using CI/CD tools and scripting languages (e.g., Python, Bash).
- Problem-Solving and Communication:
- Excellent problem-solving skills and the ability to troubleshoot complex issues.
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
- Certifications:
- AWS Certified Solutions Architect, AWS Certified DevOps Engineer, or similar certifications.
- Certified Kubernetes Administrator (CKA) or Certified Kubernetes Application Developer (CKAD).
