Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and deliver solutions that meet organizational needs, while also troubleshooting and optimizing existing data workflows to enhance performance and reliability.

Roles & Responsibilities:
- The Senior Analytics Engineer will work closely with our key stakeholders in both business and IT to help narrate stories with data and visualize insights in a compelling and insightful way that enables business decision-making.
- As a Senior Analytics engineer you are a subject matter expert, who designs & builds analytics solutions and mentors junior engineers.
- You are also the key person to convert the Vison and Data and Analytics Strategies into IT solutions and deliver them.
Key Characteristics Design, build and implement POCs, prototypes and full-fledged UX solutions and strategies
Communicate with key stakeholders to drive clarification of requirements and to promote UX designs and solutions
Support the design, e.g., by analyzing user journeys and drive towards simplification and automation
- Enable high quality & compelling story telling through creation of strong, simple to understand data visualizations Document technical solution design and strategy documentation
- Run a quality assessment of a counterparts' design
- Coach and develop other UX analysts
- Adhere to Shell's Release and Change process
- Pursue knowledge enhancement

Professional & Technical Skills:
- Must To Have Skills: Proficiency in Microsoft Azure Databricks.
- Good To Have Skills: Experience with data warehousing solutions.
- Strong understanding of data modeling concepts and best practices.
- Familiarity with data governance and compliance standards.
- Experience in programming languages such as Python or Scala for data manipulation.

Mandatory skills:
Experience Design Technology - Master
Source Data Procurement Strategies - Master
Agile, Scrum - Master
Data Visualization - Skill
Authoring/Troubleshooting SQL queries - Skill
Security & Performance Config. - Skill
PowerBI, SAC, Azure Analytic Service - Skill
Dimension Modelling - Skill

Optional skills:
Skilled at one of the secondary visualization tools (Power BI and Azure Analysis Services, Spotfire, SAP Analytics Cloud)
Knowledge of cloud data engineering technologies

Additional Information:
- The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.