Quantiphi

Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.

Technical Architect – Data, Azure

Backend EngineerSoftware EngineerFull TimeRemoteTeam 1,001-5,000Since 2013H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

39 days ago

Salary

Not specified

Bachelor Degree7 yrs expEnglishAzureCloudETLJavaNo SQLPy SparkPythonSparkSQLUnity

Job Description

• Design and implement scalable data architecture on Azure and Databricks based on business and technical requirements. • Develop data integration solutions to ingest data from various structured/unstructured sources into Azure/Databricks, ensuring quality and consistency. • Choose and implement appropriate data storage solutions (ADLS, Synapse, Databricks Delta Lake) optimized for performance and cost. • Implement and optimize data processing pipelines using ADF, Databricks, Synapse, or other Azure-native services. • Plan, execute, and oversee data migration projects, including migrations from on-premises and other cloud environments to Azure. • Establish and enforce data governance and security policies, ensuring compliance with regulatory and industry standards. • Monitor and fine-tune data pipelines for performance, cost optimization, and scalability. • Create data models aligned to client solution requirements. • Prepare detailed architecture documents, solution blueprints, and provide training/knowledge transfer to team members. • Collaborate with cross-functional teams—data engineers, architects, analysts, SMEs—to ensure alignment with business needs. • Manage project scoping, planning, execution, risk tracking, and ensure on-time delivery of data initiatives. • Communicate effectively with non-technical stakeholders, explaining migration strategies, architectural decisions, and business benefits.

Job Requirements

  • 7+ years of experience in data migration and modernization
  • Profound knowledge and expertise in Microsoft Azure, including Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Databricks, Azure Data Factory, Azure Functions, and Event Hub
  • Strong hands-on expertise with Databricks Lakehouse, including Delta Lake, Unity Catalog, Medallion architecture, Spark optimization, notebook development, and CI/CD integration
  • Strong skills in data modeling, data warehousing, dimensional modeling, and designing scalable data architectures
  • Proficiency in ETL/ELT pipeline development using ADF, Synapse, Databricks, or similar Azure-native services
  • In-depth understanding of data governance, cataloging, lineage, data security, and compliance frameworks (Azure Purview / Unity Catalog)
  • Experience with relational and NoSQL database systems and the ability to choose appropriate storage solutions
  • Proficiency in SQL and working knowledge of NoSQL systems
  • Strong programming experience in Python, PySpark, Java, or C# for automation and data manipulation
  • Extensive experience in data migration, including movement from on-premises and/or other cloud platforms into Azure and Databricks
  • Strong understanding of data quality frameworks, validation techniques, and pipeline reliability
  • Excellent documentation skills for architectural artifacts, migration playbooks, and solution guides
  • Excellent communication skills for conveying complex technical concepts to non-technical stakeholders.
  • Traveling to client location as needed.
  • Ability to manage data-related projects, collaborate with cross-functional teams, and deliver within defined timelines.

Benefits

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
  • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

Related Job Pages