AGENTIC

The Event for the Autonomous AI Era

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 11-50Since 2017H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

127 days ago

Salary

Not specified

Bachelor Degree7 yrs expEnglishAirflowAzureCloudERPETLPythonSparkSQL

Job Description

• Design, build, and maintain scalable ETL/ELT pipelines from diverse ERP sources into centralized Data Lakes and Warehouses • Develop connectors for structured/semi-structured data using Python, SQL, APIs, or middleware solutions • Implement bronze, silver, and gold layers for ingestion, cleaning, and curated datasets • Organize data structures for optimized use in Power BI and AI systems • Align global units of measure (lbs, kg, packaging, linear feet) across products and regions • Execute data deduplication, enrichment, and harmonization from disparate systems • Work closely with the Data Architect Lead on schema definitions, partitioning strategies, and infrastructure design • Set up and maintain sandbox/staging environments for safe testing • Provide ready-to-use, clean datasets to support BI dashboards and AI/ML use cases • Document pipeline architectures, data transformation logic, and integration points clearly • Ensure adherence to data governance policies and assist with metadata management

Job Requirements

  • 7+ years of experience in enterprise-scale data engineering
  • Strong proficiency in SQL (Advanced) and Python for Data Processing
  • Spark or Databricks for distributed data workflows
  • Cloud platforms such as Azure Data Lake/Blob, Synapse, or equivalents
  • ETL orchestration tools like Azure Data Factory (ADF), Airflow, or dbt
  • API integrations and data ingestion from ERP systems (e.g., NetSuite, QuickBooks, Salesforce, RF Smart, etc.)
  • Demonstrated experience with master data frameworks, unit conversion, and ERP-to-warehouse mapping
  • Handling both structured and unstructured data
  • Data modeling best practices (star schema, snowflake schema, etc.)
  • Fluent English (C1 level) – required for daily client calls and clear technical documentation
  • Strong interpersonal and collaboration skills to work with cross-functional teams (BI, QA, DevOps, Business Analysts)

Benefits

  • Professional development

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer127 days ago
Full TimeRemoteTeam 10,001+Since 1978H1B No Sponsor

Online Data Engineer Manager managing data engineering teams at The Home Depot

AirflowBigQueryETLJavaScriptPySparkPythonReactSQL
New Jersey
$125K - $220K / year

Senior Data Engineer, Graph Analytics

TRM Labs

Blockchain intelligence solutions to detect, monitor and investigate fraud and financial crime in digital assets.

Data Engineer128 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

Senior Data Engineer building scalable graph systems at TRM Labs

ApacheHadoopPythonSparkSQL
United States

Senior Data Engineer, Data and Intelligence Product

AcuityMD

Accelerate access to medical technology.

Data Engineer130 days ago
Full TimeRemoteTeam 11-50Since 2019H1B Sponsor

Senior Data Engineer building healthcare data and intelligence products at AcuityMD.

Python
Massachusetts
$175K - $200K / year

Staff Data Engineer, Marketing Technology

Thumbtack

We help people care for their home from top to bottom — and empower small businesses nationwide to grow.

Data Engineer130 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

Staff Data Engineer developing data systems for marketing at Thumbtack

PythonSQL
California
$212.4K - $323.4K / year