Data Platform Architect
Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary: We are looking for a highly skilled Senior Databricks Developer with extensive experience in building and managing modern data platforms on Azure using Lakehouse architecture. The ideal candidate will have strong hands-on experience in PySpark, SQL, and Azure Data Services, and a proven track record in developing scalable and efficient data pipelines. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure seamless integration between systems and data models, while also addressing any challenges that arise during the implementation process. You will engage in discussions with stakeholders to gather requirements and provide insights that drive the overall architecture of the data platform, ensuring it meets the needs of the organization effectively. Roles & Responsibilities: - Design, build, and optimize scalable data pipelines using Databricks, PySpark, and SQL on Azure. - Implement Lakehouse architecture for structured data ingestion, processing, and storage. - Build and manage Delta Lake tables and perform schema evolution and versioning. - Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse for data integration and transformation. - Collaborate with data architects, analysts, and business teams to understand requirements and design efficient data solutions. - Optimize performance of large-scale data pipelines and troubleshoot data quality or latency issues. - Contribute to best practices around coding, testing, and data engineering workflows. - Document technical solutions and maintain code repositories. - Expected to be an SME. - Develop and maintain documentation related to the data platform architecture. Professional & Technical Skills: - Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform. - Strong hands-on experience with PySpark and advanced SQL for large-scale data processing. - Deep expertise in Databricks platform including notebooks, jobs, and Delta Lake. - Solid experience with Azure cloud services: ADLS Gen2, ADF, Azure Synapse, Key Vault, etc. - Knowledge of Lakehouse architecture concepts, implementation, and governance. - Experience in version control tools like Git and CI/CD pipelines. - Excellent problem-solving and debugging skills. - Strong communication and collaboration abilities across cross-functional teams. - Strong understanding of data integration techniques and best practices. - Experience with cloud-based data solutions and architectures. - Familiarity with data governance frameworks and compliance requirements. - Ability to design scalable and efficient data pipelines. Good to Have: • Experience in data quality checks and validation frameworks. • Exposure to DevOps and Infrastructure as Code (IaC) in Azure environments. • Familiarity with data governance tools like Unity Catalog or Azure Purview. • Knowledge of Delta Live Tables (DLT) is a plus. Additional Information: - The candidate should have minimum 5 years of experience in Databricks Unified Data Analytics Platform. - This position is based at our Hyderabad office. - A 15 years full time education is required.
Hyderabad
Equal Employment Opportunity Statement
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.
We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at india.fc.check@accenture.com immediately.