Back to all roles

Senior Engineer – Ingestion & Streaming Frameworks

Remote-first Full-time Now hiring

Job Description:

  • Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into Snowflake, Iceberg, and Databricks
  • Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, Fivetran) and design new patterns for API sources
  • Build self-service tooling so product engineers can onboard new sources without becoming experts in our infrastructure
  • Write and review the Terraform behind our ingestion infrastructure
  • Partner with product, data, and analytics teams to pick the right ingestion pattern for each source and stand it up end-to-end
  • Lead production troubleshooting and incident response, and turn each incident into a durable platform fix
  • Raise the bar on engineering quality, observability, cost discipline, and security in everything the team ships
  • Mentor mid-career engineers and pull peers along through code review, pairing, and design feedback

Requirements:

  • 6+ years in data engineering, platform engineering, or data-focused software engineering
  • 3+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, security groups), IAM (roles, policies, permission boundaries), and the data services this role touches
  • 2+ years writing production Terraform or equivalent IaC
  • 1+ years building self-service tooling, internal platforms, or paved-path frameworks
  • Strong SQL skills and the ability to reason about how data physically lives in a warehouse or lake
  • Production experience with Snowflake or an equivalent cloud data warehouse and a workflow orchestrator (Airflow / MWAA preferred)
  • Hands-on experience with at least one ingestion approach: CDC tooling (DMS, Debezium), managed connectors (Fivetran, Airbyte), or rolling your own pipelines for API sources
  • Solid CI/CD discipline in GitHub or equivalent
  • AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent
  • Working knowledge of Python is expected; mastery isn’t the bar
  • Clear written and verbal communication, especially in async, remote settings.

Benefits:

  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off
  • Remote work options

Apply tot his job Apply To this Job

More remote roles

[Remote] Senior Enterprise Technical Lead, Government

Remote-first Full-time

[Hiring] Lead Health Information Specialist @Datavant

Remote-first Full-time

Embedded ROI Processor-Entry level

Remote-first Full-time

Payer Coding Ops Hourly

Remote-first Full-time

Health Information Specialist I

Remote-first Full-time

Payer Coding Ops Hourly

Remote-first Full-time

Senior Product Marketing Manager, Life Sciences

Remote-first Full-time

Customer Service / Tech Support Rep – Tech Products

Remote-first Full-time

Talent Connect - WAH 2025

Remote-first Full-time

Veterans Billed Specialist - Veterans Evaluation Services

Remote-first Full-time

[Remote] Mid Office Services Specialist (MLO)

Remote-first Full-time

Project Manager | Remote, USA

Remote-first Full-time

Remote Part‑Time Data Entry Clerk – Precision‑Focused Data Management for arenaflex’s Leading E‑Commerce Operations

Remote-first Full-time

General AI Data Annotator – Thai (United States)

Remote-first Full-time

Remote Part‑Time Chat Support Representative – No Experience Required – Join arenaflex’s Dynamic Customer Experience Team

Remote-first Full-time

Virtual Customer Service Representative – Work From Home Opportunity | Join arenaflex E-Commerce Customer Support Team

Remote-first Full-time

Experienced Full Stack Data Entry Representative – Remote Customer Service

Remote-first Full-time

Accounts Payable Officer & Data Entry Clerk

Remote-first Full-time

Functional Database Analyst- ERP System

Remote-first Full-time

Recruiter Coordinator

Remote-first Full-time