Irth Solutions
The Most Complete SaaS Platform for Damage Prevention, Asset Protection and Risk Management
Senior Data Architect
Location
United States
Posted
32 days ago
Salary
Not specified
Bachelor Degree8 yrs expEnglishAWSAzureCloudDynamo DBGoogle Cloud PlatformPy SparkPythonScalaSparkSQLUnity
Job Description
• Design the high‑level and detailed architecture blueprint for Irth’s new Databricks‑based data estate, including lakehouse patterns, medallion architecture (Bronze/Silver/Gold), and semantic layers.
• Develop a multi‑cloud ingestion and consolidation strategy for data sourced from AWS (S3, RDS, DynamoDB), Azure (SQL MI, Storage Accounts), GCP, and on‑prem systems.
• Define patterns for data lineage, metadata management, data quality, CDC/SCD, streaming and batch ingestion, and federated query capabilities.
• Establish an enterprise‑level data governance model, including classification schemas, residency rules, cataloging (Unity Catalog), retention policies, and security standards.
• Partner with security and compliance teams to enforce GDPR, PIPEDA, Australian Privacy Act, SOC 2, and other regulatory requirements.
• Architect for scalability, reliability, cost‑efficiency, and support of downstream analytics, reporting, GIS workflows, and AI/ML workloads.
• Produce architectural documentation, diagrams, runbooks, and design standards / best practices.
• Collaborate closely with a distributed team of data engineers to implement ingestion pipelines, Delta Lake storage patterns, orchestration workflows, and Databricks Lakeflow components.
• Provide technical leadership, code reviews, architectural guidance, and hands‑on support when needed.
• Ensure architecture is implemented consistently across tenants, clouds, products, and engineering teams.
• Work with DevOps/Platform teams on infrastructure, identity, networking, VPC/VNet, and CI/CD integration.
• Establish monitoring, observability, and operational governance for the data estate.
• Define and enforce RBAC/ABAC policies, encryption standards, audit logging, and tenant‑level isolation.
• Partner with governance teams to unify metadata and lineage across all sources via Unity Catalog and Purview integration.
• Ensure ongoing compliance with data residency and cloud‑specific regulatory constraints.
• Develop standards for retention, archival, disaster recovery, and cross‑region protections.
• Architect support for operational reporting, BI (Power BI, Databricks SQL), semantic modeling, and consumption patterns.
• Design foundations enabling AI/ML use cases such as predictive risk modeling, summarization, geospatial analytics, and LLM‑driven insights.
• Advance a BI‑tool‑agnostic semantic model strategy for consistent business definitions across products.
• Serve as Irth’s senior expert on Databricks Lakehouse architecture, modern data engineering, and multi‑cloud data strategy.
• Mentor engineers and analysts in best practices for data modeling, governance, pipeline design, and scalable architectures.
• Partner with product teams, executives, and stakeholders to translate business requirements into technical data solutions.
• Participate in vendor evaluations, roadmap planning, and architectural governance boards.
Job Requirements
- 8+ years of experience in data architecture, data engineering, or platform architecture, with at least 3 years in a senior or lead role.
- Deep expertise with Databricks (Azure preferred), including Delta Lake, Unity Catalog, SQL Warehouses, Lakehouse design, and pipeline orchestration.
- Strong experience building multi‑cloud or hybrid data architectures (AWS, Azure, GCP).
- Expert in medallion architecture, lakehouse design patterns, metadata management, lineage, and enterprise governance.
- Advanced SQL and experience with one or more: Python, Scala, PySpark, Spark SQL.
- Strong understanding of security, compliance, RBAC/ABAC, encryption, and data residency considerations.
- Experience with CDC, SCD Type 1/2, streaming ingestion, batch pipelines, and workload performance optimization.
- Demonstrated ability to translate highly complex technical concepts to non‑technical audiences.
- Strong documentation, diagramming, architectural review, and communication skills.
- Preferred
- Experience with Unity Catalog–Purview integration and enterprise metadata strategies.
- Background in geospatial data, operational risk modeling, or AI/ML enablement.
- Knowledge of Power BI semantic modeling or BI‑platform‑agnostic semantic layer design.
- Experience with highly regulated or multi‑tenant data environments.
- Certifications: Databricks Data Engineer Professional, Databricks Architect, Azure Data Architect, AWS/GCP data certifications.
Benefits
- Join a dynamic, growing company that is well respected in its industry.
- Competitive salary
- Health plans options including medical, dental, & vision
- 401k (US), RSP (Canada) + company match
- Flexible PTO policy plus company-paid holidays
- Benefits options such as health insurance, life insurance, discounts and perks programs
- Generous “work from home” stipend to get you started
- Team events including monthly lunches for everyone, volunteer outings, and quarterly gatherings
- Hybrid employees have access to snacks, beverages and coffee at our Columbus office
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer33 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor
Data Engineer delivering advanced data analytics at ActioNet
Amazon RedshiftAWSCloudETLMongoDBMySQLOraclePostgresPythonScalaSQL
United States
Data Engineer33 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Data Engineer developing scalable data pipelines at federal software company
AirflowAmazon RedshiftApacheAWSBigQueryCloudETLInformaticaOraclePostgresPythonSparkSQL
United States
Lead Data Engineer
Launch PotatoLaunch Potato’s brands and technologies help customers discover new products and services that make their lives better!
Data Engineer33 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor
Lead Data Engineer managing scalable data engineering efforts at Launch Potato
AWSCloudDistributed SystemsDockerETLPythonSparkSQL
United States
Senior Data Engineer
Launch PotatoLaunch Potato’s brands and technologies help customers discover new products and services that make their lives better!
Data Engineer33 days ago
Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor
Lead Data Engineer developing data solutions for a digital media company
AWSCloudDistributed SystemsDockerETLPythonSparkSQL