Job Summary:
Dexian is seeking a Observability Data Pipeline Engineer (Quickwit/Clickhouse) for an opportunity with a client located in Orlando, FL.
Responsibilities:
- Design, implement, and maintain data pipelines
- Collaborate with data scientists and analysts to understand data needs
- Ensure efficient and scalable data processing and storage
- Monitor the performance of data pipelines
- Troubleshoot and resolve data pipeline issues
- Implement improvements to enhance pipeline reliability and efficiency
- Work with various data sources, including databases, APIs, and streaming data
- Ensure data quality and integrity
- Document data pipeline processes and procedures
- Stay up-to-date with the latest data engineering technologies and best practices
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3+ years of experience in data engineering
- Proficiency in programming languages such as Python or Java
- Experience with data processing frameworks like Apache Spark or Hadoop
- Strong understanding of database technologies, both SQL and NoSQL
- Experience with cloud platforms such as AWS, Google Cloud, or Azure
- Excellent problem-solving skills
- Attention to detail
- Ability to work in a fast-paced environment
- Strong communication and collaboration skills
- Experience with Clickhouse or Quickwit
- Experience Designing and Managing Data pipelines specifically for Observability Migrations
- Experience with data pipeline technologies including Cribl, Confluent/Kafka, Airflow, and Apache Ni-Fi or Vector.dev, or FluentD
- Python scripting or programming
Desired Skills and Experience
Observability Data Pipeline Engineer Needed.
Long-term contract and 40 hours per week from start.
100% Remote.
Open to US Citizens, must be based in US.
Experience Needed:
Experience with Clickhouse or Quickwit.
Experience Designing and Managing Data pipelines specifically for Observability Migrations.
Experience with data pipeline technologies including Cribl, Confluent/Kafka, Airflow, and Apache Ni-Fi or Vector.dev, or FluentD.
Python scripting or programming.
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
