Data/Software Engineer (SAS to Python)

About the role

Improving is seeking a Data/Software Engineer to help convert legacy SAS code to Python and SQL on Databricks, leveraging generative AI. You will own end‑to‑end deliverables, ensure pipeline reliability, and collaborate closely with client and stakeholder teams.

Key responsibilities

• Build and run pipelines that process SAS inventories and converted outputs.
• Validate converted code for parity against SAS outputs (row counts, checksums, schema, data types).
• Own deployment through Databricks Asset Bundles (DABs) and GitLab CI/CD.
• Manage Unity Catalog objects, permissions, and environment promotion.
• Troubleshoot job failures and performance issues, including Spark and Delta Lake tuning.
• Apply data validation and reconciliation practices to ensure correctness.

Required profile

• 4+ years of professional data or software engineering experience.
• Strong Python and SQL skills.
• Hands‑on Databricks experience (Unity Catalog, Workflows, DABs).
• GitLab CI/CD experience with pipelines, merge requests, and automated testing.
• Clear written and spoken English for client‑facing collaboration.
• Demonstrated ownership of scoping, delivery, and proactive risk flagging.

Required skills

• Python
• SQL
• Databricks (Unity Catalog, Workflows, Databricks Asset Bundles)
• GitLab CI/CD
• Git branching and code review
• Spark
• Delta Lake
• Infrastructure as Code

What we offer

• Long‑term contract
• 100% remote work
• Vacation and PTO
• Two annual bonuses
• Two salary reviews per year
• English classes
• Apple equipment
• Online course platform
• Budget for books and work materials