Vertical Relevance

Your trusted Financial Services industry partner in Business Transformation, Customer Experience, & AWS Cloud Services.

Multi Cloud Data Architect

Data EngineerFull TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

23 hours ago

Salary

Not specified

No structured requirement data.

Job Description

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

Vertical Relevance is looking for a Multi Cloud Data Architect, to join our team as a full-time employee and work remotely. This person is responsible for the end-to-end planning, building, and deploying of software systems. Candidate will be able to drive the programming of well-constructed, testable code.

As a Multi Cloud Data Architect, you will implement technical solutions as part of a team for customer engagements. This role requires strong teamwork, communication, patience, and organizational skills needed to drive customer success.

At Vertical Relevance we deliver with excellence through teamwork, automating everything, constantly learning and taking ownership for the outcomes our customers experience.

Are you ready to join the team?

Responsibilities

  • Help customers shape their journey to adopting the cloud and provide technical and strategic guidance on their “cloud journey”.
  • Consult, plan, design, and implement Data solutions on the cloud for customers.
  • Design AWS Data Lake implementations.
  • Design and Develop AWS Data Quality and Governance solutions.
  • Become a deep technical resource that earns our customer's trust.
  • Develop high-quality technical content such as automation tools, reference architecture, and white papers to help our customers build on the cloud.
  • Innovate on behalf of customers and translate thoughts into action yielding measurable results.
  • Support solution development by conveying customer needs and feedback as input to technology roadmaps.
  • Assist with technical briefs that document solutions.
  • Assist with reference architecture implementations.
  • Support internal and external brand development through thought leadership.

Qualifications

  • Professional experience architecting/operating Data / DevOps solutions built on AWS and Azure.
  • Experience in software/technology customer facing experience.

Sample Activities You’ll Do

  • AWS Data Architecture and Data Lake Implementation.
  • Assist Customer in building out a framework for data collection, data ingestion and catalog, data storage and data serving designed to optimize the efficiency in which information is accessed, curated, served and analyzed from up to two on-premises data sources.
  • Assist Customer with implementing Amazon Virtual Private Cloud (Amazon VPC), account, Amazon Simple Storage Service (Amazon S3) bucket strategy and capture impact for introducing critical data for a data lake.
  • Assist Customer with achieving modern big data lambda architecture, providing an environment for consumption and utilization of data coming from either batch or streaming sources.
  • Assist Customer with defining detailed data architecture including raw data, conformed, structured, enriched, and aggregated.
  • Provide Customer general best practices in building production quality data pipeline for ingestion, transformation and consumption to downstream applications through a serving layer.
  • Assist Customer with defining details to data catalog and data serving layer through application program interfaces (APIs) if required.
  • Provide Customer general best practices for Amazon S3 data storage approach.
  • Build Ingestion and Orchestration Ingestion based on Customer’s ingestion requirements provided.
  • Assist Customer with designing and building robust data ingestion solutions using monitoring, logging and alerting service with retry capabilities.
  • Assist Customer with server-less approaches where applicable for the ingestion.
  • Assist Customer with building the framework for managing data updates to data stored in objects on Amazon S3.
  • Advise Customer on leveraging AWS Services tools for data ingestion including Amazon Kinesis, Amazon EMR, AWS Lambda or other tool defined as part of the assessment.
  • Advise Customer on orchestration options on AWS Services including but not limited to AWS Glue, AWS Step Functions, AWS Batch, Amazon EMR, AWS Data Pipeline, AWS Lambda or other AWS native orchestration tooling.
  • Assist Customer with building out the orchestration and state management processes to support data processing without data loss and exception and identify error handling.
  • Advise Customer on how the orchestration tooling will provide operational feedback to the support organizations in the event of a failure.

Relevant Technical Tools

  • Primary Languages - Python
  • Tooling, Services & Libraries – Airflow, Kafka, Parquet, Spark, Metaflow, Git, Hadoop

Relevant AWS Services

  • AWS Infrastructure Scripting – CloudFormation, AWS CLI, AWS CDK
  • AWS Storage Services – S3
  • AWS Compute Services – Lambda, Batch
  • AWS Database Services – RDS, DynamoDB, Redshift, Aurora, Neptune
  • AWS Networking Services – VPC
  • AWS Management and Governance Services – CloudTrail, Service Catalog
  • AWS Analytics Services – Athena, EMR, Kinesis, Glue, Lake Formation, Data Pipeline
  • AWS Security, Identity, Compliance Services – IAM
  • AWS Application Integration Services – Step Functions

Company Description

Vertical Relevance was founded to help business leaders drive value through the design and delivery of effective transformation programs across people, processes, and systems. Our mission is to help firms at any stage of their journey develop custom solutions for success and growth.

We provide a full range of services from strategy and design through to implementation and training. Our collective industry expertise is our greatest asset - our professionals have an average of 20+ years’ experience within Financial Services, across Wealth Management, Asset Management, Insurance, and Banking.

Within our Customer Experience practice, we add complementary industry expertise (technology and media) synergizing the most relevant and successful customer trends. We focus wholly on your success by first rigorously assessing your business and technology challenges, and then right-sizing solutions that provide a meaningful ROI.

With our industry experts hitting the ground running and focusing on nimble, quality delivery, we can see rapid, tangible improvements with our clients in productivity and effectiveness.

When it makes sense for your company, we leverage our product partnerships in the areas of CRM, Sales Acceleration, Predictive Analytics, Digital Knowledge Management, and Cloud Transformation.

Vertical Relevance is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Job Requirements

  • Professional experience architecting/operating Data / DevOps solutions built on AWS and Azure.
  • Experience in software/technology customer facing experience.
  • Sample Activities You’ll Do
  • AWS Data Architecture and Data Lake Implementation.
  • Assist Customer in building out a framework for data collection, data ingestion and catalog, data storage and data serving designed to optimize the efficiency in which information is accessed, curated, served and analyzed from up to two on-premises data sources.
  • Assist Customer with implementing Amazon Virtual Private Cloud (Amazon VPC), account, Amazon Simple Storage Service (Amazon S3) bucket strategy and capture impact for introducing critical data for a data lake.
  • Assist Customer with achieving modern big data lambda architecture, providing an environment for consumption and utilization of data coming from either batch or streaming sources.
  • Assist Customer with defining detailed data architecture including raw data, conformed, structured, enriched, and aggregated.
  • Provide Customer general best practices in building production quality data pipeline for ingestion, transformation and consumption to downstream applications through a serving layer.
  • Assist Customer with defining details to data catalog and data serving layer through application program interfaces (APIs) if required.
  • Provide Customer general best practices for Amazon S3 data storage approach.
  • Build Ingestion and Orchestration Ingestion based on Customer’s ingestion requirements provided.
  • Assist Customer with designing and building robust data ingestion solutions using monitoring, logging and alerting service with retry capabilities.
  • Assist Customer with server-less approaches where applicable for the ingestion.
  • Assist Customer with building the framework for managing data updates to data stored in objects on Amazon S3.
  • Advise Customer on leveraging AWS Services tools for data ingestion including Amazon Kinesis, Amazon EMR, AWS Lambda or other tool defined as part of the assessment.
  • Advise Customer on orchestration options on AWS Services including but not limited to AWS Glue, AWS Step Functions, AWS Batch, Amazon EMR, AWS Data Pipeline, AWS Lambda or other AWS native orchestration tooling.
  • Assist Customer with building out the orchestration and state management processes to support data processing without data loss and exception and identify error handling.
  • Advise Customer on how the orchestration tooling will provide operational feedback to the support organizations in the event of a failure.
  • Relevant Technical Tools
  • Primary Languages - Python
  • Tooling, Services & Libraries – Airflow, Kafka, Parquet, Spark, Metaflow, Git, Hadoop
  • Relevant AWS Services
  • AWS Infrastructure Scripting – CloudFormation, AWS CLI, AWS CDK
  • AWS Storage Services – S3
  • AWS Compute Services – Lambda, Batch
  • AWS Database Services – RDS, DynamoDB, Redshift, Aurora, Neptune
  • AWS Networking Services – VPC
  • AWS Management and Governance Services – CloudTrail, Service Catalog
  • AWS Analytics Services – Athena, EMR, Kinesis, Glue, Lake Formation, Data Pipeline
  • AWS Security, Identity, Compliance Services – IAM
  • AWS Application Integration Services – Step Functions

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Jobgether

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Data Engineer23 hours ago
Full TimeRemote

This role is ideal for a hands-on data engineering professional who thrives on building and maintaining complex data platforms that power analytics and AI initiatives across multiple business functions. You will work with a modern stack including Snowflake, dbt, Airflow, and AWS ...

United States
$154.9K - $196.4K / year

Data Integrations Supervisor

State of Washington

The Office of Civil Legal Aid (OCLA) is an independent judicial branch state agency, created with the understanding that the provision of legal aid services to indigent persons is an important component of the state’s responsibility to provide for the proper and effective administration of justice. The mission of the Office of Civil Legal Aid is to secure, invest and oversee the use of public funding for civil legal aid to low-income people in Washington State and to ensure accountability for public funds dedicated to the purpose. Since 2005, OCLA has administered and overseen general civil legal aid in Washington. The agency supports numerous other programs including legal aid to victims of crime and domestic violence, children in foster care, kinship caregivers, indigent tenants facing eviction, and individuals reentering society following completion of their terms of incarceration.

Data Engineer23 hours ago
Full TimeRemote

This position serves as the agency’s lead authority on how systems connect and transmit data across the Health Care Authority (HCA). The incumbent independently maps system-to-system integrations, identifies weaknesses or gaps in how platforms communicate, and sets the technica...

United States
$92.8K - $124.8K / year

Data Engineer I

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer1 day ago
Full TimeRemoteTeam 10,001+Since 1984H1B No Sponsor

The role involves developing and operationalizing data pipelines for data ingestion, transformation, validation, and optimization to support reporting and advanced analytics consumption. This includes designing and implementing standardized data management procedures and developing high-performance data structures for business intelligence.

United States
$27 - $49 / hour

Microsoft Fabric Data Engineer

Jobgether

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Data Engineer1 day ago
Full TimeRemote

We are looking for a skilled Microsoft Fabric Data Engineer to design, build, and optimize enterprise-scale data solutions that enable data-driven decision-making. In this role, you will: Develop scalable data pipelines. Implement Lakehouse architectures. Integrate diverse data s...

United States