Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : AWS Glue
Good to have skills : Python (Programming Language), PySpark
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Custom Software Engineer, you will engage in the development of custom software solutions that are designed to meet specific business needs. Your typical day will involve collaborating with cross-functional teams to design, code, and enhance various components across systems or applications. You will utilize modern frameworks and agile practices to ensure the delivery of scalable and high-performing solutions, while also addressing any challenges that arise during the development process. Your role will require a proactive approach to problem-solving and a commitment to continuous improvement in software development practices.
Roles & Responsibilities:
Build & Maintain Data Pipelines: Develop scalable, reliable ETL/ELT workflows using Python and AWS Glue (Jobs/Workflows), Lambda, and Step Functions where applicable.
Data Lake Engineering: Design and optimize S3-based data lakes (partitioning, lifecycle policies, storage classes) with robust metadata strategies using AWS Glue Data Catalog.
Security & Governance: Implement AWS IAM policies/roles, fine-grained access controls for S3, KMS-based encryption, and audit-ready logging (CloudTrail/CloudWatch).
Automation & CI/CD: Familiarity with Git, code reviews, and automated testing for data code. Package and deploy jobs/functions, maintain unit/integration tests, and set up CI/CD pipelines.
Serverless & Event-Driven: Build event-driven data processing with S3 events, Lambda triggers optimize for cost, concurrency, and resilience.
Data Quality & Observability: Implement validation, schema enforcement (e.g., Glue schemas), logging/monitoring, and alerting for pipelines and jobs.
Collaboration: Work closely with data platform, analytics, and governance teams to ensure reliability, scalability, and compliance.
(If Databricks): Develop notebooks/jobs, Delta Lake optimization (Z-ordering, OPTIMIZE/VACUUM), cluster/pool usage, and job orchestration.
Professional & Technical Skills:
- Must Have Skills: Proficiency in AWS Glue, Python (Programming Language), PySpark.
- Strong understanding of data integration and ETL processes.
- Experience with cloud computing services and architecture.
- Familiarity with agile methodologies and software development life cycle.
Additional Information:
- The candidate should have minimum 7.5 years of experience in AWS Glue, Python (Programming Language), PySpark.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.
Bengaluru
Equal Employment Opportunity Statement
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.
We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at india.fc.check@accenture.com immediately.