Irth Solutions

The Most Complete SaaS Platform for Damage Prevention, Asset Protection and Risk Management

Senior Data Architect

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 1995H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

32 days ago

Salary

Not specified

Bachelor Degree8 yrs expEnglishAWSAzureCloudDynamo DBGoogle Cloud PlatformPy SparkPythonScalaSparkSQLUnity

Job Description

• Design the high‑level and detailed architecture blueprint for Irth’s new Databricks‑based data estate, including lakehouse patterns, medallion architecture (Bronze/Silver/Gold), and semantic layers. • Develop a multi‑cloud ingestion and consolidation strategy for data sourced from AWS (S3, RDS, DynamoDB), Azure (SQL MI, Storage Accounts), GCP, and on‑prem systems. • Define patterns for data lineage, metadata management, data quality, CDC/SCD, streaming and batch ingestion, and federated query capabilities. • Establish an enterprise‑level data governance model, including classification schemas, residency rules, cataloging (Unity Catalog), retention policies, and security standards. • Partner with security and compliance teams to enforce GDPR, PIPEDA, Australian Privacy Act, SOC 2, and other regulatory requirements. • Architect for scalability, reliability, cost‑efficiency, and support of downstream analytics, reporting, GIS workflows, and AI/ML workloads. • Produce architectural documentation, diagrams, runbooks, and design standards / best practices. • Collaborate closely with a distributed team of data engineers to implement ingestion pipelines, Delta Lake storage patterns, orchestration workflows, and Databricks Lakeflow components. • Provide technical leadership, code reviews, architectural guidance, and hands‑on support when needed. • Ensure architecture is implemented consistently across tenants, clouds, products, and engineering teams. • Work with DevOps/Platform teams on infrastructure, identity, networking, VPC/VNet, and CI/CD integration. • Establish monitoring, observability, and operational governance for the data estate. • Define and enforce RBAC/ABAC policies, encryption standards, audit logging, and tenant‑level isolation. • Partner with governance teams to unify metadata and lineage across all sources via Unity Catalog and Purview integration. • Ensure ongoing compliance with data residency and cloud‑specific regulatory constraints. • Develop standards for retention, archival, disaster recovery, and cross‑region protections. • Architect support for operational reporting, BI (Power BI, Databricks SQL), semantic modeling, and consumption patterns. • Design foundations enabling AI/ML use cases such as predictive risk modeling, summarization, geospatial analytics, and LLM‑driven insights. • Advance a BI‑tool‑agnostic semantic model strategy for consistent business definitions across products. • Serve as Irth’s senior expert on Databricks Lakehouse architecture, modern data engineering, and multi‑cloud data strategy. • Mentor engineers and analysts in best practices for data modeling, governance, pipeline design, and scalable architectures. • Partner with product teams, executives, and stakeholders to translate business requirements into technical data solutions. • Participate in vendor evaluations, roadmap planning, and architectural governance boards.

Job Requirements

  • 8+ years of experience in data architecture, data engineering, or platform architecture, with at least 3 years in a senior or lead role.
  • Deep expertise with Databricks (Azure preferred), including Delta Lake, Unity Catalog, SQL Warehouses, Lakehouse design, and pipeline orchestration.
  • Strong experience building multi‑cloud or hybrid data architectures (AWS, Azure, GCP).
  • Expert in medallion architecture, lakehouse design patterns, metadata management, lineage, and enterprise governance.
  • Advanced SQL and experience with one or more: Python, Scala, PySpark, Spark SQL.
  • Strong understanding of security, compliance, RBAC/ABAC, encryption, and data residency considerations.
  • Experience with CDC, SCD Type 1/2, streaming ingestion, batch pipelines, and workload performance optimization.
  • Demonstrated ability to translate highly complex technical concepts to non‑technical audiences.
  • Strong documentation, diagramming, architectural review, and communication skills.
  • Preferred
  • Experience with Unity Catalog–Purview integration and enterprise metadata strategies.
  • Background in geospatial data, operational risk modeling, or AI/ML enablement.
  • Knowledge of Power BI semantic modeling or BI‑platform‑agnostic semantic layer design.
  • Experience with highly regulated or multi‑tenant data environments.
  • Certifications: Databricks Data Engineer Professional, Databricks Architect, Azure Data Architect, AWS/GCP data certifications.

Benefits

  • Join a dynamic, growing company that is well respected in its industry.
  • Competitive salary
  • Health plans options including medical, dental, & vision
  • 401k (US), RSP (Canada) + company match
  • Flexible PTO policy plus company-paid holidays
  • Benefits options such as health insurance, life insurance, discounts and perks programs
  • Generous “work from home” stipend to get you started
  • Team events including monthly lunches for everyone, volunteer outings, and quarterly gatherings
  • Hybrid employees have access to snacks, beverages and coffee at our Columbus office

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer

ActioNet, Inc.

Turning Vision into Action. ActioNet is Your Most Trusted Innogrator!

Data Engineer33 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

Data Engineer delivering advanced data analytics at ActioNet

Amazon RedshiftAWSCloudETLMongoDBMySQLOraclePostgresPythonScalaSQL
United States

Data Engineer

Oddball

A strangely human digital agency

Data Engineer33 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Data Engineer developing scalable data pipelines at federal software company

AirflowAmazon RedshiftApacheAWSBigQueryCloudETLInformaticaOraclePostgresPythonSparkSQL
United States

Lead Data Engineer

Launch Potato

Launch Potato’s brands and technologies help customers discover new products and services that make their lives better!

Data Engineer33 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor

Lead Data Engineer managing scalable data engineering efforts at Launch Potato

AWSCloudDistributed SystemsDockerETLPythonSparkSQL
United States

Senior Data Engineer

Launch Potato

Launch Potato’s brands and technologies help customers discover new products and services that make their lives better!

Data Engineer33 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor

Lead Data Engineer developing data solutions for a digital media company

AWSCloudDistributed SystemsDockerETLPythonSparkSQL
United States
$150K - $190K / year