Advanced Technologies. Powerful Results.
Senior Data Engineer
Location
United States
Posted
11 days ago
Salary
Not specified
No structured requirement data.
Job Description
Role Description
We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects in a dynamic environment.
- Analyze and interpret complex data
- Ability to identify data anomalies and resolve data issues
- Understand specific business processes and domain concepts and relate them to data subject domains
- Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time
- Integrate and manage data from various sources, ensuring data quality, reliability, and performance
- Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake
- Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance
- Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences
- Develop and implement data models within Snowflake to support business intelligence and analytics requirements
- Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions
- Perform tests and validate data flows and prepare ETL processes according to business requirements
- Perform ETL tuning and SQL tuning
- Ability to document data flows representing business logic in ETL routines
- Design and implement data conversion strategy from legacy to new platforms
- Perform design validation, reconciliation, and error handling in data load processes
- Design and prepare technical specifications and guidelines including ER diagrams and related documents
Qualifications
- Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas)
- Must be aware of data modeling concepts including the data modeling Normal forms
- Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS
- 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS
- Experience in business intelligence, data warehousing initiatives
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake
- Strong SQL and Python skills with experience in query optimization and performance
- Strong analytical, problem-solving, and communication skills
- Bachelor’s in mathematics, Computer Science or related technical field
- Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus
- Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required
- Experience with Matillion ELT tool and Snowflake Database is preferred
- Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google)
Requirements
- 8+ years of hands-on experience, preferably with Snowflake, SQL Server, AWS and Matillion ETL
Benefits
- Salary Range: 140,000 - 150,000
Company Description
RxSense believes that a diverse workforce is a more talented and productive workforce. As such, we are an Equal Opportunity and Affirmative Action employer. Our recruitment process is free from discriminatory hiring practices and all qualified applicants are considered for employment without regard to race, color, religion, sex, gender, sexual orientation, gender identity, ancestry, age, or national origin. Neither will qualified applicants be discriminated against on the basis of disability or protected veteran status. We believe in the strength of the collaboration, creativity and sense of community a diverse workforce brings.
Job Requirements
- Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas)
- Must be aware of data modeling concepts including the data modeling Normal forms
- Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS
- 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS
- Experience in business intelligence, data warehousing initiatives
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake
- Strong SQL and Python skills with experience in query optimization and performance
- Strong analytical, problem-solving, and communication skills
- Bachelor’s in mathematics, Computer Science or related technical field
- Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus
- Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required
- Experience with Matillion ELT tool and Snowflake Database is preferred
- Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google)
- 8+ years of hands-on experience, preferably with Snowflake, SQL Server, AWS and Matillion ETL
Benefits
- Salary Range: 140,000 - 150,000
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
The Senior Data Engineer will be responsible for designing and implementing data solutions that support the organization’s goals. Develop and maintain data pipelines and ETL processes Collaborate with cross-functional teams to understand data needs Ensure data quality and integri...
Principal Data Strategist
CaylentCaylent is a cloud native services company that helps organizations bring the best out of their people and technology using Amazon Web Services (AWS). We provide a full-range of AWS services including workload migrations and modernization, cloud native application development, DevOps, data engineering, security and compliance, and everything in between. At Caylent, our people always come first. We are a global company and operate fully remote with employees in Canada, the United States, and Latin America. We celebrate the culture of each of our team members and foster a community of technological curiosity.
Caylent is a cloud native services company that helps organizations bring the best out of their people and technology using Amazon Web Services (AWS). We provide a full-range of AWS services including workload migrations and modernization, cloud native application development, De...
Lead Data Engineer owning data reliability and integrity at Vida Health.
Senior Data Engineer managing enterprise data architecture at AEVEX