Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Scala
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking an experienced Data Architecture Team Lead to define and drive the architecture of scalable, maintainable data pipelines for real-time banking data products. In this role, you will lead architectural decisions across the end-to-end data platform, including mainframe CDC ingestion, Confluent Kafka, Apache Spark Structured Streaming on Amazon EMR, and MongoDB Atlas. You will play a critical role in onboarding new applications, establishing architecture standards, and ensuring consistency, scalability, and reliability across the applicaiton.
Roles & Responsibilities:
Define and enforce architectural standards for real-time Spark Structured Streaming pipelines across the DDS platform
Lead architectural design for new application onboarding (NewApp KT) including data flow design, collection modeling and CDC subscription definition
Evaluate and propose improvements to existing pipeline architectures for performance, scalability and maintainability
Define MongoDB collection schemas, indexing strategies and write patterns (upsert, bulk write, TTL indexes)
Design Kafka topic structures, partition strategies and CDC subscription configurations in collaboration with IBM CDC and Confluent teams
Collaborate with cross-functional teams including HOST/mainframe, GFT, CDC squad and platform engineering
Produce and maintain architecture documentation — high-level design diagrams, data flow documents and ADRs (Architecture Decision Records)
Review technical designs proposed by development team members and provide architectural guidance
Support production deployments across INT, PRE and PRO environments on Amazon EMR
Technical Skills:
Must have:
Scala and Apache Spark — deep understanding of Structured Streaming internals, execution model and performance tuning
Data architecture — experience designing end-to-end real-time data pipelines
MongoDB — collection design, indexing, aggregation pipelines, Atlas architecture
Kafka — topic design, partition strategy, consumer group management, Confluent Cloud
AWS — EMR, S3, CloudWatch
Good to have:
IBM CDC / Change Data Capture — subscription design, table filtering, multi-table refresh
Delta Lake on S3
Banking domain knowledge — account movements, transaction processing, balance calculation
Jenkins, SonarQube, Bitbucket
Java
Desirable:
Experience with mainframe DB2 data structures
Knowledge of IBAN calculation standards
Experience with MongoDB Atlas cross-cluster architectures
Experience: Minimum 6 years of experience in data engineering with at least 2 years in a technical architecture or lead role.
Bengaluru
Equal Employment Opportunity Statement
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.
We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at india.fc.check@accenture.com immediately.