Integration Engineer

About the role

SD Solutions is seeking an Integration Engineer to design, build, and maintain third‑party data integrations for a Master Data Management platform built on the Databricks Data Intelligence Platform. The role blends full‑stack development with data engineering, delivering reliable connectors that enrich customer data at scale.

Key responsibilities

• Own end‑to‑end integration development, from API contract through streaming pipeline to UI configuration.
• Build PySpark Structured Streaming pipelines on Databricks to ingest and transform third‑party data.
• Develop Python/FastAPI services that handle authentication, rate limiting, retries, and expose configuration endpoints.
• Create Node.js/React interfaces for customers to configure, monitor, and manage integrations.
• Act as the primary technical liaison with data providers, reviewing API documentation, testing transactions, and validating integration compliance.

Required profile

• Strong communication and partnership skills to work with vendors and internal teams.
• Ability to deliver repeatable, well‑scoped work end‑to‑end.
• Focus on consistency, reliability, and steady delivery cadence.

Required skills

• Python
• PySpark and Spark Structured Streaming
• Databricks platform
• FastAPI
• Node.js
• React
• RESTful API integration
• Authentication mechanisms, rate limiting, exponential backoff