Quantiphi
Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.
Technical Architect – Data, Azure
Backend EngineerSoftware EngineerFull TimeRemoteTeam 1,001-5,000Since 2013H1B SponsorCompany SiteLinkedIn
Location
United States
Posted
39 days ago
Salary
Not specified
Bachelor Degree7 yrs expEnglishAzureCloudETLJavaNo SQLPy SparkPythonSparkSQLUnity
Job Description
• Design and implement scalable data architecture on Azure and Databricks based on business and technical requirements.
• Develop data integration solutions to ingest data from various structured/unstructured sources into Azure/Databricks, ensuring quality and consistency.
• Choose and implement appropriate data storage solutions (ADLS, Synapse, Databricks Delta Lake) optimized for performance and cost.
• Implement and optimize data processing pipelines using ADF, Databricks, Synapse, or other Azure-native services.
• Plan, execute, and oversee data migration projects, including migrations from on-premises and other cloud environments to Azure.
• Establish and enforce data governance and security policies, ensuring compliance with regulatory and industry standards.
• Monitor and fine-tune data pipelines for performance, cost optimization, and scalability.
• Create data models aligned to client solution requirements.
• Prepare detailed architecture documents, solution blueprints, and provide training/knowledge transfer to team members.
• Collaborate with cross-functional teams—data engineers, architects, analysts, SMEs—to ensure alignment with business needs.
• Manage project scoping, planning, execution, risk tracking, and ensure on-time delivery of data initiatives.
• Communicate effectively with non-technical stakeholders, explaining migration strategies, architectural decisions, and business benefits.
Job Requirements
- 7+ years of experience in data migration and modernization
- Profound knowledge and expertise in Microsoft Azure, including Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Databricks, Azure Data Factory, Azure Functions, and Event Hub
- Strong hands-on expertise with Databricks Lakehouse, including Delta Lake, Unity Catalog, Medallion architecture, Spark optimization, notebook development, and CI/CD integration
- Strong skills in data modeling, data warehousing, dimensional modeling, and designing scalable data architectures
- Proficiency in ETL/ELT pipeline development using ADF, Synapse, Databricks, or similar Azure-native services
- In-depth understanding of data governance, cataloging, lineage, data security, and compliance frameworks (Azure Purview / Unity Catalog)
- Experience with relational and NoSQL database systems and the ability to choose appropriate storage solutions
- Proficiency in SQL and working knowledge of NoSQL systems
- Strong programming experience in Python, PySpark, Java, or C# for automation and data manipulation
- Extensive experience in data migration, including movement from on-premises and/or other cloud platforms into Azure and Databricks
- Strong understanding of data quality frameworks, validation techniques, and pipeline reliability
- Excellent documentation skills for architectural artifacts, migration playbooks, and solution guides
- Excellent communication skills for conveying complex technical concepts to non-technical stakeholders.
- Traveling to client location as needed.
- Ability to manage data-related projects, collaborate with cross-functional teams, and deliver within defined timelines.
Benefits
- Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
- Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
- Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
- Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.