Custom Software Engineer
Project Role Description : Design, build and configure applications to meet business process and application requirements.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
Roles & Responsibilities :
Provide operational support for Azure Databricks clusters, jobs, notebooks, and workspaces.
Monitor platform health, job performance, and troubleshoot issues related to pipelines, clusters, and data latency.
Handle incident management, root cause analysis (RCA), and L2/L3 problem resolution for Databricks-related issues.
Support Delta Lake operations including schema evolution, versioning, and data consistency checks.
Manage and troubleshoot connections to ADLS Gen2, Azure SQL, Synapse, ADF, Event Hubs and other external data sources.
Provide support for data sharing concepts including Delta Sharing, Unity Catalog, cross-workspace data access, and data governance.
Troubleshoot cross-tenant/workspace data access via private endpoints, credential passthrough, and security policies.
Support real-time streaming data pipelines and resolve issues with checkpoint corruption, consumer lag, or schema drift.
Manage access controls, permissions, and entitlements for Databricks users, groups, and shared data assets.
Automate monitoring and housekeeping activities using Python, PySpark, or PowerShell scripts.
Maintain runbooks, troubleshooting guides, and operational best practices for recurring issues.
Collaborate with data engineers, architects, and business teams to ensure smooth operations of the data platform.
Provide operational support for Azure Databricks clusters, jobs, and workspaces.
Monitor platform health, job performance, and proactively resolve issues related to pipelines, clusters, or data latency.
Handle incident management, root cause analysis (RCA), and problem resolution for Databricks-related issues.
Support Delta Lake operations including schema evolution, versioning, and data consistency checks.
Collaborate with Data Engineers and Architects to ensure smooth execution of ETL pipelines and data flows.
Manage and troubleshoot integrations with Azure Data Lake Storage (ADLS), ADF, Key Vault, and Synapse.
Apply performance tuning to PySpark jobs, SQL queries, and cluster configurations.
Maintain access controls, permissions, and security policies for Databricks users and groups.
Develop automation scripts for monitoring, housekeeping, and operational tasks.
Document runbooks, troubleshooting guides, and operational best practices.
Participate in on-call rotation for critical production support.
Professional & Technical Skills:
Must Have Skills :
Hands-on experience with Databricks Unified Data Analytics Platform (administration, job scheduling, troubleshooting).
Strong knowledge of PySpark and SQL for debugging production workloads.
Solid understanding of Delta Lake concepts, schema evolution, and optimization.
Proficiency in Azure cloud services: ADLS Gen2, ADF, Synapse, Key Vault.
Experience in cluster management, autoscaling, job retries, and performance tuning.
Familiarity with monitoring tools (Log Analytics, Azure Monitor, or third-party tools).
Knowledge of CI/CD integration for Databricks (Repos, Git, pipeline triggers).
Good to Have Skills:
Exposure to DataOps practices and automation using PowerShell, Python, or Terraform.
Experience with incident and change management tools (ServiceNow, Jira).
Understanding of Lakehouse architecture governance and security best practices.
Knowledge of networking aspects in Databricks (VNets, private endpoints, firewall rules).
Additional Information:
This position is based at our Hyderabad office.
Requires 15 years of full-time education.
Candidate should have strong problem-solving skills and be comfortable working in a production support environment with cross-functional teams.
Hyderabad
Requesting an Accommodation
Accenture is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.
If you would like to be considered for employment opportunities with Accenture and have accommodation needs such as for a disability or religious observance, please call us toll free at 1 (877) 889-9009 or send us an email or speak with your recruiter.
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
For details, view a copy of the Accenture Equal Opportunity Statement
Accenture is an EEO and Affirmative Action Employer of Veterans/Individuals with Disabilities.
Accenture is committed to providing veteran employment opportunities to our service men and women.
Other Employment Statements
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.
Candidates who are currently employed by a client of Accenture or an affiliated Accenture business may not be eligible for consideration.
Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process. Further, at Accenture a criminal conviction history is not an absolute bar to employment.
The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information.
California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.