LMI

Innovation at the Pace of Need™

Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 1,001-5,000Since 1961H1B SponsorCompany SiteLinkedIn

Location

North Carolina

Posted

9 days ago

Salary

$122.2K - $211.3K / year

Bachelor Degree3 yrs expEnglishApacheAWSCassandraCloudDockerETLHadoopKafkaKubernetesPythonRabbit MQRedisSDLCSparkSQL

Job Description

• Performs data engineering and data analysis to create, store, locate , retrieve, analyze, manage, and share documentation/artifacts. • Leads and develops data products within the system/software development life cycle from requirements definition, to architecture, design, implementation, and testing, through deployment and operations, and support. • Defines and develops techniques to integrate, consolidate , and structure data for analytical use, including the ability to inform on data aggregation and associated security implications, and the ability to leverage logical data models to support data source mappings. • Identifies data migration strategies to transition data from legacy systems and technologies to advanced, enterprise-based solutions. • Performs assessments relative to data architecture, design, and implementation, and identifies system impacts associated with new requirements, and requirements changes. • Works in collaboration with developers, data scientists, and other engineers to facilitate data movement and security both on-prem and in the cloud. • Contributes to technical collaboration with internal and external stakeholders.

Job Requirements

  • Active SECRET clearance required
  • Bachelor's Degree in a STEM or related field
  • Minimum 3-years of demonstrated experience with enterprise data management solutions and platforms in the areas of master data management, data quality management, data governance, metadata management, Extract-Transform-Load (ETL), data warehousing, and data lakes
  • Minimum 2-years of experience modeling and managing structured and unstructured data including photos/images, physical specifications/technical diagrams
  • Experience leading legacy data integration and remediation (facades, strangler approaches, etc )
  • Deep understanding of different integration patterns and best practices such as events, synchronous vs asynchronous messaging, peer-to-peer, publish-to-subscribe, distributed logs, and RESTful APIs
  • Must possess and maintain an active Secret Security Clearance.
  • Demonstrated experience working with relational( sql ) database management systems, normalizing complex data to optimize for writing and reading as well as designing efficient queries for operational and analytical purposes.
  • Demonstrated experience working with messaging platforms (Kafka, Rabbitmq , Redis queueing) to create data pipelines that allow applications to operate as loosely coupled components and facilitate easy on-boarding of new features.
  • Has worked with message encoding languages such as Protobuf , Avro, JSON, and can select appropriate solution for a given message stream.
  • Demonstrated experience working with specific non-relational databases such as Apache Druid, Cassandra, and AWS Simple Storage Solution(S3).
  • Should be able to explain when to use these solutions and instead of relational database solutions.
  • Some experience working with distributed, high-volume database solutions such as Apache Hadoop, Apache Spark.
  • Proficiently in scripting data transformations jobs and writing API servers with Python
  • Has worked with domain experts in a field they did not have proficiency to deliver value to customers
  • Demonstrated experience working with Kubernetes (k8s) and containerization (docker).

Benefits

  • High Fringe/Full-Time

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Daymark Health

Daymark Health is a value-based oncology company redefining the cancer care experience for patients, providers, and health plans. Daymark’s comprehensive, personalized cancer care platform empowers patients with dedicated care navigation, symptom-focused support, behavioral health care, and social resources. Combined with evidence-based health interventions and a hybrid in-person + virtual care model, Daymark is improving the overall cancer experience for patients, providers, and health plans – and setting a new standard in cancer care. Daymark’s groundbreaking approach is led by CEO Dr. Justin Bekelman, a pioneer in transforming cancer care, alongside some of the nation’s foremost leaders in oncology and value-based care. Daymark Health is backed by Maverick Ventures, Yosemite, Oncology Ventures, Healthier Capital, Blue Venture Fund, and Healthcare Foundry.

Data Engineer9 days ago
Full TimeRemoteTeam 2-10

At Daymark Health, we are transforming how data drives decision-making in healthcare. We are seeking a Data Engineer who is passionate about building scalable, impactful data pipelines, working with complex healthcare datasets, and contributing to Daymark’s mission. Reporting to ...

United States

Database & Data Sustainment Engineer

Diné Development Corporation

DDC delivers a robust suite of IT solutions designed to help our clients address the challenges of the digital revolution and embrace the opportunities of digital transformation. We provide a full spectrum of IT solutions that support clients in the defense, healthcare, national security, law enforcement, and intelligence communities. With a central focus on innovation, we translate modern technologies, industry best practices, and proven methodologies into client-driven solutions. Our teams of technologists are organized around digital solutions in the areas of systems/software engineering, data management, cloud adoption, and cybersecurity. As thought leaders and strategic partners, we provide a deliberate mix of people, processes, and technology to advance mission goals. Our IT companies have been consistently recognized for driving mission success through process efficiencies, reduced costs, and exploited technologies.

Data Engineer9 days ago
Full TimeRemote

North Stone is seeking a Database & Data Sustainment Engineer to support database operations and data modernization initiatives for enterprise systems. The engineer will manage database environments, optimize performance, and support evolving data requirements across development,...

United States

Data Engineer II

Garner Health

A better way to get your employees to high-quality doctors.

Data Engineer9 days ago
Full TimeRemoteTeam 51-200Since 2019H1B No Sponsor

Data Engineer II joining Garner Health, a fast-growing healthcare technology company

AirflowPostgreSQLPythonSQL
United States
$107K - $150K / year
Full TimeRemoteTeam 501-1,000

The role involves designing and implementing scalable integrations between Databricks and key enterprise systems like Netsuite, Workday, and SalesForce, while developing automated data pipelines using low-code tools and custom AWS solutions. Responsibilities also include owning infrastructure provisioning via Infrastructure as Code (Terraform) and mentoring engineers on best practices.

United States
$110K - $200K / year