AGENTIC
The Event for the Autonomous AI Era
Senior Data Engineer
Location
United States
Posted
127 days ago
Salary
Not specified
Bachelor Degree7 yrs expEnglishAirflowAzureCloudERPETLPythonSparkSQL
Job Description
• Design, build, and maintain scalable ETL/ELT pipelines from diverse ERP sources into centralized Data Lakes and Warehouses
• Develop connectors for structured/semi-structured data using Python, SQL, APIs, or middleware solutions
• Implement bronze, silver, and gold layers for ingestion, cleaning, and curated datasets
• Organize data structures for optimized use in Power BI and AI systems
• Align global units of measure (lbs, kg, packaging, linear feet) across products and regions
• Execute data deduplication, enrichment, and harmonization from disparate systems
• Work closely with the Data Architect Lead on schema definitions, partitioning strategies, and infrastructure design
• Set up and maintain sandbox/staging environments for safe testing
• Provide ready-to-use, clean datasets to support BI dashboards and AI/ML use cases
• Document pipeline architectures, data transformation logic, and integration points clearly
• Ensure adherence to data governance policies and assist with metadata management
Job Requirements
- 7+ years of experience in enterprise-scale data engineering
- Strong proficiency in SQL (Advanced) and Python for Data Processing
- Spark or Databricks for distributed data workflows
- Cloud platforms such as Azure Data Lake/Blob, Synapse, or equivalents
- ETL orchestration tools like Azure Data Factory (ADF), Airflow, or dbt
- API integrations and data ingestion from ERP systems (e.g., NetSuite, QuickBooks, Salesforce, RF Smart, etc.)
- Demonstrated experience with master data frameworks, unit conversion, and ERP-to-warehouse mapping
- Handling both structured and unstructured data
- Data modeling best practices (star schema, snowflake schema, etc.)
- Fluent English (C1 level) – required for daily client calls and clear technical documentation
- Strong interpersonal and collaboration skills to work with cross-functional teams (BI, QA, DevOps, Business Analysts)
Benefits
- Professional development
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer127 days ago
Full TimeRemoteTeam 10,001+Since 1978H1B No Sponsor
Online Data Engineer Manager managing data engineering teams at The Home Depot
AirflowBigQueryETLJavaScriptPySparkPythonReactSQL
Senior Data Engineer, Graph Analytics
TRM LabsBlockchain intelligence solutions to detect, monitor and investigate fraud and financial crime in digital assets.
Data Engineer128 days ago
Full TimeRemoteTeam 51-200H1B Sponsor
Senior Data Engineer building scalable graph systems at TRM Labs
ApacheHadoopPythonSparkSQL
United States
Data Engineer130 days ago
Full TimeRemoteTeam 11-50Since 2019H1B Sponsor
Senior Data Engineer building healthcare data and intelligence products at AcuityMD.
Python
Staff Data Engineer, Marketing Technology
ThumbtackWe help people care for their home from top to bottom — and empower small businesses nationwide to grow.
Data Engineer130 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor
Staff Data Engineer developing data systems for marketing at Thumbtack
PythonSQL