Jobiglo

No results.

Senior Data Engineer

silver

New
Senior 🇬🇧 English
Python SQL PostgreSQL dbt Google Cloud Storage Airflow Dagster Prefect Temporal Scrapy Playwright Selenium Beautiful Soup asyncio HTTPX Pub/Sub Cloud Tasks

Job description

About the role

Fundable is a startup data platform that helps investors and other teams discover and research companies by bringing together information on companies, investors, funding activity and people. It is looking for a senior data engineer to own the data platform from architecture through production, turning high volumes of data from provider APIs, webhooks, files and web scraping into trusted records. Today the enrichment and extraction workflows run serially in a container; the engineer will lead the move to a platform supporting concurrent processing, event-driven intake and orchestrated batch workflows.

Key responsibilities

  • Build concurrent ingestion for provider APIs, webhooks, files and scraping, with rate limits and failure handling.
  • Orchestrate scheduled workflows and historical backfills with tools such as Airflow, Dagster or Prefect, and build event-driven intake with Pub/Sub or Cloud Tasks, including retries, dead-letter queues and controlled replay of failed work.
  • Store original payloads, including provider JSON, in Google Cloud Storage before transforming them with dbt, and establish medallion layers for raw, standardized and curated data.
  • Implement idempotent upserts, safe retries, replay and backfills that avoid duplicate records, and make data traceable to its source.
  • Define data contracts, build automated validation and pipeline tests, and monitor freshness and failures; design and optimize PostgreSQL schemas, queries and loading patterns.
  • Integrate provider enrichment and LLM-based structured extraction from text into the platform.

Required profile

  • Experience building multi-source production data platforms from zero to one, from architecture and pipelines through deployment and operation.
  • Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect or Temporal (Airflow preferred).
  • Hands-on production experience with dbt and GCP.
  • Experience building event-driven systems with messaging or task queues, including asynchronous processing and failure recovery.
  • Nice to have: startup or small team experience, entity resolution, LLM-based extraction or enrichment, and familiarity with BigQuery and Dataform.

Required skills

  • Strong SQL and PostgreSQL, including data modeling, query optimization and incremental loading.
  • Strong Python, including async HTTP and concurrent processing with asyncio, aiohttp or HTTPX.
  • Web scraping with Scrapy, Playwright, Selenium or Beautiful Soup.

The interview process includes a silver screening, an offline case study, client behavioral and case study interviews, and a final round.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec silver.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:ashby

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

💬 Chat with us on Telegram

Published 3 hours ago

Expires 1 month from now

3 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

silver