3M Consultancy
Mark. Make. Match.
Databricks Developer, Java, Apache Spark, IRS MBI Clearance
Backend EngineerSoftware EngineerFull TimeRemoteTeam 1-10Since 2018H1B No SponsorCompany SiteLinkedIn
Location
United States
Posted
60 days ago
Salary
$100K - $150K / year
Bachelor Degree8 yrs expEnglishApacheCloudETLHbaseHDFSJavaJenkinsJunitKafkaKubernetesMockitoSparkSQLYarn
Job Description
• Build and maintain data pipelines using Apache Spark on Databricks
• Write clean and efficient Java (Java 8 or higher) following best coding practices
• Work with large structured and semi-structured data sets
• Tune Spark jobs to improve performance, stability, and cost
• Partner with other teams to understand requirements and deliver solutions
• Make sure data handling follows security and governance standards
• Investigate and fix issues in production environments
Job Requirements
- Active federal background clearance (client-issued laptop is a plus)
- Bachelor’s degree in Computer Science or a related field
- 8+ years of hands-on experience in data engineering or big data development
- Data & Systems Experience working with large enterprise or government data systems
- Good understanding of data structures, security, and compliance
- Strong experience with Java 8 or newer
- Comfortable with Streams, Lambdas, and object-oriented design
- Hands-on experience with Spark Core, Spark SQL, and DataFrames
- Understanding of RDDs and when to use them
- Experience with batch processing and streaming
- Strong skills in Spark performance tuning
- Able to debug jobs using Spark UI and logs
- Experience with tools like HDFS, Hive, or HBase
- Familiar with Kafka, S3, or cloud-based data lakes
- Experience with Parquet, Avro, or ORC formats
- Experience building batch and real-time ETL pipelines
- Skilled in data cleansing, transformation, and enrichment
- Experience running Spark on YARN, Kubernetes, or cloud platforms
- Familiar with CI/CD tools like Jenkins or GitHub Actions
- Experience with monitoring tools and production logs
- Unit testing using JUnit or TestNG
- Experience with Mockito or similar tools
- Comfortable validating data and testing Spark jobs
Related Guides
Related Job Pages
More Backend Engineer Jobs
Backend Engineer60 days ago
Full TimeRemoteTeam 201-500Since 2008H1B Sponsor
Backend Engineer on Devices Cloud team building cloud services for connected devices
AWSCloudDistributed SystemsDynamoDBJavaKafkaMicroservicesNoSQLPythonGo
Staff Software Engineer, Backend – Growth Platform
AffirmWe create honest financial products that improve lives.
Backend Engineer60 days ago
Full TimeRemoteTeam 1,001-5,000Since 2012H1B Sponsor
Staff Software Engineer responsible for backend platforms at Affirm
AWSDistributed SystemsKotlinKubernetesMySQLPythonSpark
Software Engineer II, Java - MarTech Team
Fanatics, Inc.We amplify pride and create connections for all fans around the world.
Backend Engineer62 days ago
Full TimeRemoteTeam 1,001-5,000Since 2011H1B No Sponsor
Software Engineer II focusing on Java/Spring Boot for backend systems at Fanatics Betting & Gaming.
AWSGRPCJavaSpringSpring BootSpringBootSQL
Backend Engineer
Make - letsMake.com | A studio making world-class products, platforms & systems 💯A digital studio making world-class products, platforms & systems.
Backend Engineer63 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Backend Engineer building large-scale software for Make's award-winning platform
JavaScriptNode.jsTypeScript
Texas
