Shuru
Give wings to your ideas!
Senior Data Engineer
Location
United States
Posted
136 days ago
Salary
Not specified
Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftApacheAWSBig QueryCassandraCloudDockerDynamo DBETLGoogle Cloud PlatformJavaKafkaKubernetesMongo DBNo SQLPythonScalaSparkSQLTerraformGo
Job Description
• Design and implement scalable data pipelines for ingestion, validation, cleanup, and normalization
• Build and maintain ETL/ELT processes to support both batch and real-time data processing
• Develop data quality frameworks and monitoring systems to ensure data integrity
• Optimize pipeline performance and troubleshoot data flow issues
• Deploy and manage data infrastructure on AWS and GCP platforms
• Implement Infrastructure as Code (IaC) using Terraform for reproducible deployments
• Design and maintain data lakes, data warehouses, and streaming architectures
• Ensure security, compliance, and cost optimization across cloud resources
• Implement event-driven architectures using technologies like Kafka, Kinesis, or Pub/Sub
Job Requirements
- 5+ years of experience in data engineering or related field
- Hands-on experience with data pipeline development and maintenance
- Strong proficiency in Python, SQL, and at least one other programming language (Java, Scala, Go)
- Extensive experience with AWS services (S3, Redshift, EMR, Kinesis, Lambda, Glue)
- Solid experience with GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
- Proven experience with Infrastructure as Code using Terraform
- Strong background in streaming technologies (Apache Kafka, Amazon Kinesis, Google Pub/Sub)
- Experience with data processing frameworks (Apache Spark, Apache Beam, Airflow)
- Proficiency with data warehousing solutions (Redshift, BigQuery, Snowflake)
- Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB)
- Familiarity with containerization (Docker, Kubernetes)
- Experience with monitoring and observability tools (CloudWatch, Stackdriver, Datadog)
Benefits
- Competitive salary and benefits package.
- Opportunity to work with a team of experienced product and tech leaders.
- A flexible work environment with remote working options.
- Continuous learning and development opportunities.
- Chance to make a significant impact on diverse and innovative projects.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
Channel FactoryWe help brands find the right content, context and audience on YouTube at the right price.
Data Engineer136 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Senior Data Engineer leading data infrastructure at a marketing tech startup.
ApacheAWSDistributed SystemsEC2ETLPostgresPySparkPythonRabbitMQRDBMSSQL
New York
Data Engineer, DoD Secret
RacknerDevSecOps and AI from Cloud to Mission Edge | Kubernetes Partner | Multicloud | 8(a) | HUBZone
Data Engineer136 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Data Engineer modernizing secure data infrastructure for military healthcare
AirflowApacheAWSETLPythonSparkSQL
United States
Data Engineer137 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor
Senior Consultant - Data Engineering role at 3Cloud delivering technical solutions
AzureETLPythonSQLSSIS
Data Engineer137 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Data Engineer supporting federal government enterprise data programs
AWSETLPythonSparkSQL
Virginia