Senior Data Engineer

Data EngineerData EngineerContractRemoteTeam ,H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

64 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishCloudETLPythonSQL

Job Description

• Develop efficient and scalable data extraction methodologies to retrieve data from diverse sources, such as databases, APIs, web scraping, flat files, and streaming platforms. • Design and implement robust data loading processes to efficiently ingest and integrate data into the latest data warehousing technology, ensuring data quality and consistency. • Develop and maintain staging processes to facilitate the organization and transformation of raw data into structured formats, preparing it for downstream analysis and reporting. • Implement data quality checks and validation processes to identify and address data anomalies, inconsistencies, and integrity issues. • Identify and resolve performance bottlenecks in data extraction and loading processes, optimizing overall system performance and data availability. • Ensure adherence to data security and privacy standards throughout the data extraction and warehousing processes, implementing appropriate access controls and encryption mechanisms. • Create and maintain comprehensive documentation of data extraction and warehousing processes, including data flow diagrams, data dictionaries, and process workflows. • Mentor and support junior data engineers, providing guidance on best practices, technical design, and professional development to elevate overall team capability and performance. • Collaborate with cross-functional teams, including data scientists, data analysts, software engineers, and business stakeholders, to understand their data requirements and provide efficient data engineering solutions. • Stay updated with the latest advancements in data engineering, data warehousing, and cloud technologies, and proactively propose innovative solutions to enhance data extraction and warehousing capabilities.

Job Requirements

  • Minimum of 5 years’ experience in data engineering, with a strong focus on data extraction and cloud-based warehousing; a combination of years of experience and relevant advanced technology proficiency will also be considered.
  • Proficiency with Snowflake and data integration tools like Fivetran.
  • Advanced SQL skills and experience with ETL/ELT frameworks.
  • Experience with scripting languages such as Python for data processing and automation.
  • Solid understanding of data modeling and relational database design.
  • Strong communication skills and the ability to collaborate with technical and non-technical stakeholders.
  • Strong analytical and problem-solving skills, with the ability to identify and resolve complex data engineering challenges.

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer, Data Platform Operations

NBCUniversal

Here you can create the extraordinary. Join us.

Data Engineer65 days ago
Full TimeRemoteTeam 10,001+Since 2004H1B Sponsor

Senior Data Engineer leading data platform operations at NBCUniversal.

AirflowCloudPySparkPythonSQL
New York
$140K - $180K / year

Data Engineering Lead/Scientist

Experian

We're unlocking the power of data to help create a better tomorrow.

Data Engineer65 days ago
Full TimeRemoteTeam 10,001+Since 1996H1B Sponsor

Data Engineering Analyst Lead transforming trade data into consumer features at Experian

AWSCloudPythonSQLTableau
United States
$115.7K - $208.3K / year

Senior Data Engineer

Roo

Relief. Support. Community. Connecting Veterinary and Tech relief with animal hospitals at the click of a button!

Data Engineer65 days ago
Full TimeRemoteTeam 11-50Since 2019H1B No Sponsor

Senior Data Engineer at Roo developing data ecosystems and analytics support for veterinary staffing.

AWSJavaScriptMySQLNode.jsPythonSQL
California + 5 moreAll locations: California, Colorado, New York, North Carolina, Texas, Washington
$170K - $220K / year

Senior Manager, Data Engineering

Carrum Health

Helping employers provide premier #healthcare benefits to employees through leading Centers of Excellence. #HR

Data Engineer65 days ago
Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

Senior Data Engineering Manager leading data operations and engineering team at Carrum Health

AirflowAmazon RedshiftApacheAWSAzureCloudETLPythonSQLTableauTerraform
United States
$190K - $220K / year