Custom Software Engineer
Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.
Must have skills : Data Architecture Principles
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are looking for an experienced Data Architect / Senior Data Engineer with expertise in modern cloud data platforms, data engineering, and emerging AI technologies. The ideal candidate will have strong hands-on experience in AWS, Databricks, PySpark, Python, Snowflake, and AWS Glue, along with exposure to Generative AI, Large Language Models (LLMs), and Agentic AI frameworks.
This role will be responsible for designing scalable data architectures, building enterprise data pipelines, enabling AI-ready data platforms, and providing technical leadership across data engineering initiatives. The candidate should be comfortable working across architecture, development, optimization, and mentoring teams while collaborating with business and technology stakeholders.
Roles & Responsibilities:
Design and implement scalable cloud-based data architectures to support enterprise analytics, reporting, AI, and machine learning workloads.
Develop, optimize, and maintain ETL/ELT pipelines using PySpark, Python, Databricks, AWS Glue, and Snowflake.
Design and implement modern data lake, lakehouse, and data warehouse solutions on AWS.
Build robust ingestion frameworks for structured, semi-structured, and unstructured data from multiple enterprise systems.
Design reusable data engineering frameworks and standards for scalable data processing.
Optimize Spark workloads, SQL queries, and Snowflake objects for performance and cost efficiency.
Implement data quality, governance, lineage, metadata management, and security best practices.
Collaborate with Data Scientists, AI Engineers, Application teams, and Business stakeholders to deliver data solutions for analytics and AI use cases.
Support AI initiatives by preparing high-quality datasets for Generative AI and Machine Learning applications.
Develop and integrate Python-based solutions for AI-enabled data processing and workflow automation.
Contribute to the design and implementation of LLM-powered applications, Agentic AI workflows, Retrieval-Augmented Generation (RAG), and intelligent automation use cases where applicable.
Lead architecture discussions, conduct technical reviews, and establish engineering best practices.
Build and maintain CI/CD pipelines and automate deployment of data engineering solutions.
Monitor production environments, troubleshoot issues, and drive continuous platform improvements.
Mentor data engineers and promote coding standards, performance optimization, and architectural best practices.
Professional & Technical Skills:
8+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms.
Strong hands-on expertise in Python and PySpark.
Extensive experience with Databricks.
Strong experience with AWS services including AWS Glue, S3, Athena, IAM, Lambda, CloudWatch, Step Functions, Lake Formation, and Redshift.
Hands-on experience with Snowflake including data loading, transformation, optimization, and performance tuning.
Strong SQL development and query optimization skills.
Experience designing scalable ETL/ELT frameworks and enterprise data pipelines.
Strong understanding of Data Lake, Lakehouse, and Data Warehouse architectures.
Experience with Git, CI/CD, and DevOps practices.
Knowledge of data modeling, partitioning strategies, metadata management, and data governance.
Experience working in Agile delivery environments.
Preferred Skills
Working knowledge of Generative AI, Large Language Models (LLMs), and Agentic AI concepts.
Experience with AI orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, or similar frameworks.
Exposure to Retrieval-Augmented Generation (RAG), vector databases, embeddings, and prompt engineering.
Experience integrating LLM APIs from platforms such as Azure OpenAI, OpenAI, or Amazon Bedrock into enterprise applications.
Knowledge of MLOps and AI deployment best practices.
Experience with Delta Lake, Apache Iceberg, or similar table formats.
Exposure to streaming technologies such as Kafka or Spark Structured Streaming is an added advantage.
Infrastructure as Code using Terraform or CloudFormation is desirable.
Experience leading technical teams and mentoring engineers.
Additional Information:
Position: Associate Manager (Level 8)
Experience: 8–12 Years
Education: Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Domain experience in Banking, Financial Services, Healthcare, Retail, Manufacturing, Utilities, or Pharma will be an added advantage.
Hyderabad
Requesting an Accommodation
Accenture is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.
If you would like to be considered for employment opportunities with Accenture and have accommodation needs such as for a disability or religious observance, please call us toll free at 1 (877) 889-9009 or send us an email or speak with your recruiter.
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
For details, view a copy of the Accenture Equal Opportunity Statement
Accenture is an EEO and Affirmative Action Employer of Veterans/Individuals with Disabilities.
Accenture is committed to providing veteran employment opportunities to our service men and women.
Other Employment Statements
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.
Candidates who are currently employed by a client of Accenture or an affiliated Accenture business may not be eligible for consideration.
Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process. Further, at Accenture a criminal conviction history is not an absolute bar to employment.
The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information.
California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.