Vytwo Technologies Inc
Delivering Talent. Driving Results
Senior Data Engineer
Location
United States
Posted
2 days ago
Salary
$55 - $60 / hour
Seniority
Senior
Professional Certificate7 yrs expEnglishAirflowApacheAWSAzureCloudETLGoogle Cloud PlatformPySparkPythonSQL
Job Description
• Design, develop, and maintain scalable data pipelines using Python, PySpark, and other modern programming languages to support both batch and streaming workloads
• Build and optimize data processing frameworks on cloud platforms such as Databricks or Snowflake, ensuring performance, reliability, and cost efficiency
• Design and implement robust data models, including transactional (OLTP) and dimensional (OLAP) schemas, to support analytics, reporting, and application integration
• Develop high quality SQL code including complex queries, stored procedures, and views, with a focus on performance tuning and efficient data access patterns
• Create and manage workflow orchestration using Apache Airflow or similar tools, ensuring reliable scheduling, dependency management, and monitoring
• Implement and enforce data governance and metadata standards through tools such as Microsoft Purview, including data lineage, classification, cataloging, and security policies
• Build automated data quality and validation frameworks to ensure accuracy, completeness, and reliability of production datasets
• Collaborate with cross functional teams including data architects, analysts, scientists, and business stakeholders to understand requirements and deliver scalable, well designed data solutions
• Lead technical design sessions and code reviews, promoting engineering best practices, reusability, and maintainability
• Support cloud infrastructure and DevOps practices, including CI/CD pipelines, version control, testing automation, and environment management
• Monitor and troubleshoot production data pipelines, proactively addressing issues, performance bottlenecks, and system failures
• Contribute to the evolution of the enterprise data platform, recommending tools, frameworks, and architectures to improve scalability and efficiency
Job Requirements
- 7+ years of experience in data engineering, software engineering, or similar disciplines
- Hands-on experience with Databricks or Snowflake
- Experience with orchestration tools such as Apache Airflow
- Experience working with cloud ecosystems (Azure preferred; AWS/GCP acceptable)
- Advanced SQL skills and experience with OLTP and OLAP data modeling
- Solid understanding of modern data warehousing, data lake, and ELT/ETL design patterns
- Familiarity with data governance tools, especially Microsoft Purview
- Solid programming expertise in Python, PySpark, or similar languages
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer2 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Analytics Engineer building data structures for marketing analytics
BigQueryCloudSQL
United States
Data Engineer2 days ago
Full TimeRemoteTeam 1,001-5,000Since 2003H1B No Sponsor
Senior Data Warehouse Engineer for UBC’s Enterprise Data Warehouse team
AzureETLPythonSQLSSIS
United States
Technical Staff Member, Data Platform
Anchorage DigitalTrusted institutional partner in crypto and first federally chartered crypto bank
Data Engineer2 days ago
Full TimeRemoteTeam 201-500Since 2017H1B Sponsor
Data Platform Engineer building advanced digital asset platform for institutions
AirflowCloudSQL
New York
Customer Data Platform Strategist – Freelance
MediacurrentOpen Source Product Agency. Defining, designing and delivering websites, platforms and digital experiences.
Data Engineer2 days ago
ContractRemoteTeam 51-200Since 2007H1B No Sponsor
Customer Data Platform Strategist managing data strategies and integrations for Mediacurrent.
CloudSQL




