Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Data Engineering
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a highly experienced Assistant Manager / Manger with strong expertise in ETL, Big Data platforms.The ideal candidate will lead the design, development, and operational support of enterprise-scale data pipelines while also enabling metadata management.
Job Title: Assistant Manager/Manger – Data Engineering
Roles & Responsibilities:
1. Data Architecture & Solution Design
Analyze business requirements and source systems to design scalable, reliable ETL and data integration solutions.
Architect end-to-end data pipelines for batch and near real-time ingestion from heterogeneous sources such as RDBMS, APIs, flat files, and streaming platforms.
Define data mappings, transformation rules, aggregation logic, and reconciliation frameworks.
Design incremental load strategies, CDC pipelines, and large-scale data ingestion frameworks.
ETL Development & Optimization
Lead development of complex ETL pipelines using Informatica Big Data Management (BDM).
Design scalable data ingestion frameworks into enterprise data lakes and warehouses.
Develop and optimize big data workloads on Cloudera Hadoop ecosystem including:
o HDFS
o Hive
o Spark
o Impala
o Sqoop
Write advanced SQL and PL/SQL for large-scale data transformations.
Implement partitioning, indexing, and parallel processing strategies.
Conduct code reviews and enforce reusable ETL development standards.
Continuously optimize performance for high-volume batch workloads.
Professional & Technical Skills:
8+ Years (Minimum 2+ years in Team Lead / Support role)
Production Support & Incident Management
Monitor and support ETL workflows developed in Informatica Big Data Management.
Manage batch scheduling using enterprise tools such as:
o AutoSys
o Control-M
o Stonebranch
o Unix Cron
Investigate and resolve:
o Session failures
o Workflow aborts
o Long-running jobs
o Data mismatches and reconciliation issues
Perform root cause analysis (RCA) and implement preventive solutions.
Coordinate with upstream and downstream application teams for issue resolution.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.
Must-Have Skills
ETL & Data Integration
Strong expertise in Informatica Big Data Management
Deep understanding of enterprise ETL design patterns
Big Data & Hadoop Ecosystem
Hands-on experience with:
o Apache Hive
o Apache Spark
o Apache Impala
o Apache Sqoop
Experience working on Cloudera Data Platform
Additional Information:
- The candidate should have minimum 7.5 years of experience in Data Engineering.
- This position is based at our Chennai office.
- A 15 years full time education is required.
Chennai
Equal Employment Opportunity Statement
All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.
We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at india.fc.check@accenture.com immediately.