thyssenkrupp

engineering. tomorrow. together.

Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 10,001+Since 1811H1B SponsorCompany SiteLinkedIn

Location

Michigan

Posted

34 days ago

Salary

Not specified

Bachelor Degree1.1 yrs expEnglishAirflowAzureCloudCyber SecurityETLITSMMatillionPythonSQL

Job Description

• Develop, maintain, and monitor data ingestion and enrich ETL/ELT pipelines within the platform that load and convert raw data into data products. • Partner with regional and/or global IT infrastructure teams to support and configure data platform storage and compute layers. • Maintain and build CI/CD pipeline code and automated test plans to ensure automated deployment between development and production environments. • Manage data platforms related to ITSM ticketing processes (incident & change requests). • Collaborate with data team members, architects, data stewards, data owners, and business SMEs to develop data product business requirements for data cleansing and enrichment. • Implement data security and data governance policies within the data platform to protect sensitive information and maintain data quality. • Partner with cybersecurity and compliance teams to rigorously ensure compliance with applicable data security, data protection, and regulation requirements. • Partner with global data teams to ensure that the local data platform & products maintain interoperability. • Continuously identify and drive opportunities to improve platform performance, reduce complexity and technical debt and reduce cloud computing and storage costs. • Maintain support documentation within the team repository. • Escalate data platform issues to the attention of management / appropriate partners. • Leverage agile frameworks and Azure DevOps to execute the team backlog. • Implement data platform metadata management standards and policies.

Job Requirements

  • Bachelor’s degree, or equivalent work experience.
  • Minimum 1+ years of experience in IT Industry and 1 year of experience as a Data Engineer or equivalent work experience.
  • At least 1 year of prior data engineering experience of building ETL/ELT data pipelines using Airflow, Fivetran, Qlik, DBT, ADF, Snowpipe, Matillion and/or similar tools to load and transform structure and semi-structured data.
  • At least 1 year of experience building and supporting cloud native databases, warehouses data lakes, lake houses, and/or data repositories.
  • At least 1 year of experience writing python and/or SQL to manipulate, transform, and load large disparate data sets.
  • Advanced working SQL knowledge and prior experience loading data into relational databases, data warehouses, and/or data lakes on Microsoft Azure Cloud or other cloud platform.
  • Ability to concisely and completely document business requirements into user stories within Azure DevOps and create related technical documentation.
  • Basic working knowledge of implementing identity and access management (IAM) and data object, column, and row level access controls to protect sensitive information.
  • Fundamental understanding of implementing DevOPs, code management, versioning/branching, and automated testing concepts.
  • Experience with leveraging IDEs (e.g., Visual Studio Code and/or Snowflake Notebooks).
  • Have a fundamental understanding of how to effectively leverage elastic compute and interoperable storage to scale data pipelines/processing up and out.
  • Strong project management and organizational skills.
  • Experience with performing root cause analysis to answer specific business questions, resolve issues, & identify improvement opportunities.
  • Experience designing and implementing relational, star schema, and snowflake data models.
  • Excellent verbal and written communication skills; ability to provide meaningful, regular status communications to various levels of leadership.
  • Proven track record of driving continuous personal improvement by learning and adapting quickly to the latest technologies and trends.
  • Familiarity with SAP supply chain data and/or within aerospace is preferred but not required.

Benefits

  • Medical, Dental, Vision Insurance
  • Life Insurance and Disability
  • Voluntary Wellness Programs
  • 401(k) and RRSP programs with Company Match
  • Paid Vacation and Holidays
  • Tuition Reimbursement
  • And more! Benefits may vary based on job, country, union role, and/or company segment.

Related Categories

Related Job Pages