Data Engineer

Harnham • chandler, az, us • 4m ago

Role Responsibilities:

Take over the management of the database, including permissions and architecture
Create ETL pipelines to feedback into ML pipelines.
Onboard new data sets and integrate them with existing ones.
Convert more work to dbt as a first project.
Convert high-priority tasks to Change Data Capture (CDC).
Build and optimize ETL pipelines to remove bottlenecks.
Ensure best practices in data governance and security.

Technical Skillsets:

Must Haves:

3-5+ years of experience as a Data Engineer
Strong Python experience.
Proficiency in PostgreSQL, including specific optimizations.
Knowledge of best practices in database architecture and security, including data governance and permission allocation.
Experience with dbt or SQLmesh (data transformation tools).

Nice to Have:

Experience with Change Data Capture (CDC).
Background in the financial industry (an economics degree is a plus).
Expertise in creating high-performance Python code and optimizing pipelines.
Familiarity with Cassandra or other NoSQL databases, especially as we are nearing our storage limits and will need to manage text data.

Tools:

Python
PostgreSQL
DBT or SQLmesh (or similar data transformation tools)
Cassandra (highly preferred) or NoSQL database
On-prem database servers

Related Jobs

Uber eats | Deliver with Uber - Flexible Gig

Uber eats • chandler, az, us • 1h ago

1h ago

Uber eats | Flexible Schedule - Deliver with Uber Eats

Uber eats • mesa, az, us • 1h ago

1h ago

Veyo | PART TIME DRIVER GIG | MORNINGS | AFTERNOONS

Veyo • scottsdale, az, us • 1h ago

1h ago

Lotlinx, Inc. | Account Executive

Lotlinx, Inc. • chandler, az, us • 1h ago

1h ago

Veyo | Delivery Driver - Healthcare Appointment Driver

Veyo • chandler, az, us • 1h ago

1h ago

Veyo | Drive with Veyo - Great Flexible Gig!

Veyo • gilbert, az, us • 1h ago

1h ago

DBSI | Transformation Strategist (Sales Leader)

DBSI • chandler, az, us • 1h ago

1h ago

Veyo | Medical Courier - $10,000 GUARANTEED!

Veyo • scottsdale, az, us • 1h ago

1h ago

LVI Associates | UltraPure Water Engineer

LVI Associates • mesa, az, us • 1h ago

1h ago

Milton Hershey School | Milton Hershey School | House Parent

Milton Hershey School • chandler, az, us • 1h ago

1h ago