thyssenkrupp
engineering. tomorrow. together.
Data Engineer
Location
Michigan
Posted
34 days ago
Salary
Not specified
Bachelor Degree1.1 yrs expEnglishAirflowAzureCloudCyber SecurityETLITSMMatillionPythonSQL
Job Description
• Develop, maintain, and monitor data ingestion and enrich ETL/ELT pipelines within the platform that load and convert raw data into data products.
• Partner with regional and/or global IT infrastructure teams to support and configure data platform storage and compute layers.
• Maintain and build CI/CD pipeline code and automated test plans to ensure automated deployment between development and production environments.
• Manage data platforms related to ITSM ticketing processes (incident & change requests).
• Collaborate with data team members, architects, data stewards, data owners, and business SMEs to develop data product business requirements for data cleansing and enrichment.
• Implement data security and data governance policies within the data platform to protect sensitive information and maintain data quality.
• Partner with cybersecurity and compliance teams to rigorously ensure compliance with applicable data security, data protection, and regulation requirements.
• Partner with global data teams to ensure that the local data platform & products maintain interoperability.
• Continuously identify and drive opportunities to improve platform performance, reduce complexity and technical debt and reduce cloud computing and storage costs.
• Maintain support documentation within the team repository.
• Escalate data platform issues to the attention of management / appropriate partners.
• Leverage agile frameworks and Azure DevOps to execute the team backlog.
• Implement data platform metadata management standards and policies.
Job Requirements
- Bachelor’s degree, or equivalent work experience.
- Minimum 1+ years of experience in IT Industry and 1 year of experience as a Data Engineer or equivalent work experience.
- At least 1 year of prior data engineering experience of building ETL/ELT data pipelines using Airflow, Fivetran, Qlik, DBT, ADF, Snowpipe, Matillion and/or similar tools to load and transform structure and semi-structured data.
- At least 1 year of experience building and supporting cloud native databases, warehouses data lakes, lake houses, and/or data repositories.
- At least 1 year of experience writing python and/or SQL to manipulate, transform, and load large disparate data sets.
- Advanced working SQL knowledge and prior experience loading data into relational databases, data warehouses, and/or data lakes on Microsoft Azure Cloud or other cloud platform.
- Ability to concisely and completely document business requirements into user stories within Azure DevOps and create related technical documentation.
- Basic working knowledge of implementing identity and access management (IAM) and data object, column, and row level access controls to protect sensitive information.
- Fundamental understanding of implementing DevOPs, code management, versioning/branching, and automated testing concepts.
- Experience with leveraging IDEs (e.g., Visual Studio Code and/or Snowflake Notebooks).
- Have a fundamental understanding of how to effectively leverage elastic compute and interoperable storage to scale data pipelines/processing up and out.
- Strong project management and organizational skills.
- Experience with performing root cause analysis to answer specific business questions, resolve issues, & identify improvement opportunities.
- Experience designing and implementing relational, star schema, and snowflake data models.
- Excellent verbal and written communication skills; ability to provide meaningful, regular status communications to various levels of leadership.
- Proven track record of driving continuous personal improvement by learning and adapting quickly to the latest technologies and trends.
- Familiarity with SAP supply chain data and/or within aerospace is preferred but not required.
Benefits
- Medical, Dental, Vision Insurance
- Life Insurance and Disability
- Voluntary Wellness Programs
- 401(k) and RRSP programs with Company Match
- Paid Vacation and Holidays
- Tuition Reimbursement
- And more! Benefits may vary based on job, country, union role, and/or company segment.