Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Data Engineering
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
We are seeking a highly experienced Assistant Manager / Manger with strong expertise in ETL, Big Data platforms.The ideal candidate will lead the design, development, and operational support of enterprise-scale data pipelines while also enabling metadata management.
Job Title: Assistant Manager/Manger – Data Engineering
Roles & Responsibilities:
1. Data Architecture & Solution Design
Analyze business requirements and source systems to design scalable, reliable ETL and data integration solutions.
Architect end-to-end data pipelines for batch and near real-time ingestion from heterogeneous sources such as RDBMS, APIs, flat files, and streaming platforms.
Define data mappings, transformation rules, aggregation logic, and reconciliation frameworks.
Design incremental load strategies, CDC pipelines, and large-scale data ingestion frameworks.
2. ETL Development & Optimization
Lead development of complex ETL pipelines using Informatica Big Data Management (BDM).
Design scalable data ingestion frameworks into enterprise data lakes and warehouses.
Develop and optimize big data workloads on Cloudera Hadoop ecosystem including:
o HDFS
o Hive
o Spark
o Impala
o Sqoop
Write advanced SQL and PL/SQL for large-scale data transformations.
Implement partitioning, indexing, and parallel processing strategies.
Conduct code reviews and enforce reusable ETL development standards.
Continuously optimize performance for high-volume batch workloads.
Professional & Technical Skills:
8+ Years (Minimum 2+ years in Team Lead / Support role)
3. Production Support & Incident Management
Monitor and support ETL workflows developed in Informatica Big Data Management.
Manage batch scheduling using enterprise tools such as:
o AutoSys
o Control-M
o Stonebranch
o Unix Cron
Investigate and resolve:
o Session failures
o Workflow aborts
o Long-running jobs
o Data mismatches and reconciliation issues
Perform root cause analysis (RCA) and implement preventive solutions.
Coordinate with upstream and downstream application teams for issue resolution.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.
4. Must-Have Skills
ETL & Data Integration
o Strong expertise in Informatica Big Data Management
o Deep understanding of enterprise ETL design patterns
Big Data & Hadoop Ecosystem
Hands-on experience with:
o Apache Hive
o Apache Spark
o Apache Impala
o Apache Sqoop
Experience working on Cloudera Data Platform
Additional Information:
- The candidate should have minimum 7.5 years of experience in Data Engineering.
- This position is based at our Chennai office.
- A 15 years full time education is required.
Chennai
Igualdad de oportunidades laborales
Todas las decisiones de empleo se tomarán sin considerar la edad, raza, credo, color, religión, sexo, origen nacional, ascendencia, condición de discapacidad, condición de veterano, orientación sexual, identidad o expresión de género, información genética, estado civil, ciudadanía o cualquier otro criterio protegido por las leyes federales, estatales o locales.
Las personas candidatas no estarán obligadas a revelar antecedentes penales o de arresto que hayan sido sellados o eliminados como parte del proceso de contratación.
Accenture está comprometido con brindar oportunidades laborales a veteranos, incluyendo a hombres y mujeres que han prestado servicio.
Para más información sobre cómo procesamos tus datos durante el proceso de reclutamiento y contratación, por favor consulta la Declaración de Reclutamiento y Contratación de Accenture.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.