Job Title: Data Engineer (MongoDB/Databricks with DevOps)
Work Location: Hybrid once a week at office in Maryland.
Clearance: MBI Clearance preferred
Work Authorization: Citizen/GC holder for 3+ years
Company: Sara Software Systems
Responsibilities:
- Design, implement, and maintain MongoDB data models and schemas for real-time event-driven processing.
- Develop and optimize data pipelines and workflows using Databricks.
- Create and manage MongoDB databases to serve as authoritative transactional data stores for online processing.
- Collaborate with software engineers to integrate MongoDB solutions into applications.
- Implement and manage CI/CD pipelines for MongoDB and Databricks workflows.
- Automate data infrastructure provisioning and management using infrastructure as code (IaC) tools.
- Monitor and optimize MongoDB performance, ensuring scalability and reliability.
- Ensure data security and compliance with IRS standards, implementing necessary security measures.
- Develop technical documentation, including data models, data dictionaries, and data flow diagrams.
- Provide support for data migration and integration from legacy systems to MongoDB.
- Conduct performance tuning and index optimization for MongoDB databases.
- Manage data replication and backup strategies to ensure data availability and integrity.
- Execute tasks to support environments within AWS Gov Cloud or Treasury Cloud.
- Provide data engineering design activities to modernize legacy functionality into event-driven and business rules orchestrated services.
- Develop and assess logical and physical designs.
- Analyze legacy system use cases, features, and functionality that should be built into the modernized system for requirement support.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- At least 5 years of experience in data engineering, with a focus on MongoDB database management and optimization.
- Expert in NoSQL (MongoDB) database management and optimization.
- Proficient in data modeling techniques and database architecture principles, particularly for MongoDB.
- Strong experience with Databricks for data analytics and pipeline development.
- Knowledge of data pipeline orchestration and scheduling.
- Deep understanding of data security and compliance requirements.
- Knowledge of legacy data formats such as QSAM and VSAM.
- Experience with big data technologies is a plus.
- Experience modernizing data stores.
- Proficiency in CI/CD tools, scripting, and automation.
- Experience with infrastructure as code (IaC) and configuration management tools.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Must have or be able to obtain an MBI (Minimum Background Investigation) clearance.
- If you already have MBI clearance, Remote work can be an option