Bridgeway Benefit Technologies
Leader in technology solutions for the Taft-Hartley industry.
Senior Data Engineer
Location
United States
Posted
42 days ago
Salary
Not specified
Bachelor Degree5 yrs expEnglishAirflowAzureKafkaPythonSparkSQLTableauTerraformUnity
Job Description
• Design, develop, and maintain a scalable data warehouse/lakehouse environment.
• Design and implement ELT pipelines to ingest, transform, and deliver high-quality data for analytics and reporting, incorporating current best practices, such as “pipelines as code”.
• Ensure data security and compliance, including role-based access controls for security, encryption, masking, and governance best practices to ensure compliant handling of sensitive information.
• Optimize performance of data workflows and storage for cost efficiency and speed.
• Partner with engineers, analysts, and stakeholders to meet data needs; balance cost, performance, simplicity, and time-to-value while mentoring teams and documenting standards.
• Define and implement robust testing frameworks, enforce data contracts, and establish observability practices including lineage tracking, SLAs/SLOs, and incident response runbooks to maintain data integrity and trustworthiness.
• Monitor, troubleshoot, and resolve data & automation issues.
• Collaborate within an Agile-Scrum framework and develop comprehensive technical design documentation to ensure efficient and successful delivery.
• Serve as a trusted expert on organizational data domains, processes, and best practices.
Job Requirements
- 5+ years of experience in data engineering and ELT with a focus on large-scale data platforms
- 3+ years of experience with Databricks
- Advanced proficiency in analytical SQL, including ANSI SQL, T-SQL, and Spark SQL
- Strong Python skills for data engineering
- Expertise in data modeling
- Hands-on experience with data quality and observability practices (tests, contracts, lineage tracking, alerts)
- Practical knowledge of orchestration tools and CI/CD concepts for data workflows
- Excellent communication and a track record of technical leadership and mentoring
- Strong understanding of integrating data solutions with AI and machine learning models
- Strong problem-solving skills and attention to detail.
- Experience with version control systems like Git preferred
- Strong understanding of data governance and best practices in data management, with hands-on experience using Unity Catalog
- Hands-on experience in designing and managing data pipelines using Delta Live Tables (DLT) on Databricks
- Streaming and ingestion tools, such as Kafka, Kinesis, Event Hubs, Debezium, or Fivetran
- DAX, LookML, dbt; Airflow/Dagster/Prefect, Terraform; Azure DevOps; Power BI/Looker/Tableau; GitHub CoPilot knowledge is a plus
- Bachelor’s degree in Computer Science, Information Technology, or a related field. Master’s degree preferred
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer42 days ago
Full TimeRemoteTeam 10,001+Since 1969H1B No Sponsor
Retail Big Data Modeling Architect designing and implementing robust data models.
HadoopNoSQLSparkSQL
California + 1 moreAll locations: California, Texas
Senior Azure Data Engineer
SmartbridgeSimplifying business transformation through thought leadership and innovation. Bring your digital agenda to reality.
Data Engineer43 days ago
ContractRemoteTeam 51-200H1B Sponsor
Senior Azure Data Engineer designing and building Azure data platforms for Smartbridge
AzureETLPySparkPythonSQLVault
United States
Senior Data Engineer
CAREWe work to fight poverty and achieve social justice by empowering women and girls. www.CARE.org
Data Engineer43 days ago
Full TimeRemoteTeam 5,001-10,000Since 1945H1B Sponsor
Senior Data Engineer responsible for data pipelines at Care Access
AirflowAzureCloudPythonSQL
Data Engineer43 days ago
Full TimeRemote
As a Data Operations Engineer, you will manage data acquisition, ensure data compliance, maintain data storage security, and collaborate with various teams to support operations.
Data Processing