As a Senior Software Engineer specializing in Data Platforms, your role will involve transforming requirements into practical solutions through coding, fostering collaboration across diverse teams, and offering strategic insights to drive innovation. You will lead small to medium-sized project teams, serving as a trusted advisor and subject matter expert. Your expertise will guide fellow engineers, equipping them with the necessary tools to achieve project objectives effectively.
Common Data Platform
In the data platform team, we're pioneering the next wave of advancements and adoption in Big Data technology. Utilizing an open-source software stack and cutting-edge cloud infrastructure, we're developing new capabilities to handle vast data volumes and adapt to dynamic data environments. We're looking for innovative individuals who can lead the charge in driving these data platform capabilities from inception through implementation.
What you'll do:
- Design and develop the next-generation big data platform on public cloud infrastructure.
- Prototype proof-of-concept solutions with rapid iteration and experimentation.
- Manage forks of essential open-source tools for platform maintenance.
- Create tools for self-service data management and cluster administration.
- Collaborate with architects and senior technical leads to enhance complex software components.
- Design, configure, and implement scalable systems capable of processing terabytes of data across hybrid on-premise and cloud environments.
- Collaborate with business customers, product managers, and engineers to design and implement feature-based solutions in an agile manner.
- Design architecture for data integration pipelines, ensuring efficient extraction, transformation, and loading of data from diverse sources using Spark, SQL, and other technologies.
- Develop robust and scalable applications using SQL, Scala/Python, and Spark.
- Implement real-time data streaming and processing using Kafka and/or Spark streaming.
- Build data ingestion processes to maintain Data Lakehouse on Google Cloud Platform and Azure.
- Maintain design documentation, test cases, and performance monitoring using Git, Jenkins, and Confluence. Implement continuous integration and deployment workflows using Git and Jenkins.
What you'll bring:
- 5-10 years of relevant experience in designing and building resilient, scalable systems.
- Comprehensive knowledge of big data technologies such as Apache Hadoop, Hive, Sqoop, Kafka, and Spark.
- Proven ability to translate requirements into project parameters with agility.
- Expertise in writing complex, optimized queries for large datasets.
- Strong skills in developing robust, scalable applications using SQL, Scala/Python, Shell Scripting, and Spark.
- Experience in developing data pipelines using Airflow or similar tools.
- Hands-on proficiency with Python, Spark, Java, Azure/GCP, Kafka (or other messaging services), and relational databases (MySQL, Oracle etc.).
- Proficiency in CI/CD development environments/tools including Git, Maven, and Jenkins.
- Experience with public cloud platforms such as Azure or Google.
- Demonstrated ownership of end-to-end design, development, and deployment of solutions.
- Strong initiative to drive change and adapt quickly to new and emerging technologies.
- Ability to balance long-term strategic vision with short-term implementation goals.
- Excellent communication and interpersonal skills.
- Track record of mentoring and coaching junior engineers.
- Focus on reusability, frameworks, patterns, and configuration tools to accelerate development.
- Practitioner of Agile (Scrum) methodology, adept at working in distributed teams.
About Walmart General/Not Function Specific
Sam Walton opened the first Sam's Club in 1983 to meet a growing need among customers who wanted to buy merchandise in bulk. Since then, Sam's Club has grown rapidly, opening more than 600 clubs in the U.S. and 100 clubs internationally. By offering affordable, wholesale merchandise to members, Sam's Club helps make saving simple for families and small business owners. Sam's Club employs about 110,000 associates in the U.S. The average club is 134,000 square feet and offers bulk groceries and general merchandise. Most clubs also have specialty services, such as a pharmacy, an optical department, a photo center, or a tire and battery center.
Future Ways of Working:
Our company's success can be attributed to our employees. While technology has allowed us to be effective while working remotely, there is no substitute for being in the office together; it helps to shape our culture, collaborate, innovate, build relationships, and move more quickly. We strive to provide flexibility in order to promote a healthy work-life balance but recognize that in-person interactions are important to our culture and shared success. We'll meet in person on a regular and purposeful basis.
Benefits:
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
Equal Opportunity Employer:
Sam’s Club is an Equal Opportunity Employer- By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity- unique styles, experiences, identities, abilities, ideas and opinions- while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
