Upstart 13

Bringing down borders in technology.

Senior Data Engineer – Microsoft Fabric

Data EngineerData EngineerFull TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

4 days ago

Salary

Not specified

Bachelor Degree6 yrs expEnglishCloudETLPy SparkSparkSQL

Job Description

• Own the design, build-out, and evolution of our data platform on Microsoft Fabric • Design and implement end-to-end ELT pipelines using Data Factory, Spark notebooks (PySpark/Spark SQL), and Dataflows Gen2 • Build and maintain a medallion architecture (Bronze → Silver → Gold) • Implement data validation, schema enforcement, and automated quality checks; partner with governance on lineage • Manage Fabric platform operations, capacity monitoring, Git-based CI/CD for notebooks and pipelines • Deliver well-structured Gold-layer tables optimized for Direct Lake • Design and implement RTM Isolation strategies using CDC • Collaborate with BI stakeholders to deliver AI-Ready Gold-layer tables

Job Requirements

  • 6+ years building production ETL/ELT pipelines in cloud data platforms
  • Strong hands-on experience with Microsoft Fabric (Lakehouses, Warehouses, Data Factory, Spark notebooks, OneLake)
  • Deep understanding of lakehouse and medallion architecture patterns
  • Proficient in PySpark, Spark SQL, and/or T-SQL for data transformation and optimization
  • Experience with Delta Lake table management (partitioning, optimization, incremental loads, merge/upsert patterns)
  • Familiarity with dimensional modeling and star-schema design principles
  • Working knowledge of Git-based CI/CD for data artifacts (notebooks, pipelines, TMDL/PBIP a plus)
  • Comfortable working with the SQL analytics endpoint and understanding Direct Lake requirements

Benefits

  • 20+ Paid time off days

Related Categories

Related Job Pages

More Data Engineer Jobs

Lead Data Engineer, Databricks – Manufacturing/MES

CompuGain

Deliver game-changing modern applications with Unisys

Data Engineer5 days ago
ContractRemoteTeam 201-500H1B Sponsor

Lead Data Engineer designing Azure Databricks data pipelines for manufacturing analytics

AzureCloudERPIoTPySparkSparkSQL
California
Data Engineer5 days ago
Full TimeRemote

The Python Developer is tasked with designing, developing, and implementing Python-based automation for the reconciliation process, which includes building robust, scalable ETL data pipelines to integrate data from various sources. This role involves developing, testing, and deploying Python automation scripts and workflows while collaborating with technical leads to ensure solution maintainability and performance enhancement.

PythonSQLETLDatabricksApache AirflowAWSAWS LambdaAmazon S3
United States
$110K - $125K / year
Full TimeRemote

The developer will design, build, and maintain PowerApps solutions and Power BI dashboards integrating operational and financial data to provide actionable insights for stakeholders. Key duties include developing PowerApps applications for workflow automation and building/optimizing dashboards using visualization tools like Power BI.

PowerAppsPower BITableauQlikExcelPower AutomateSharePoint
United States
$120K - $130K / year

B2B Data Engineering Lead

dentsu Austria

Champions of meaningful progress.

Data Engineer5 days ago
Full TimeRemoteTeam 51-200Since 1900H1B No Sponsor

Data Engineering Lead for B2B Data Products designing and scaling data solutions

CloudPythonSQL
North Carolina
$94K - $121K / year