Project Role : Application Lead
Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.
Must have skills : Apache Spark
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : BTech/ BSc/MSc in Computer Science or related field

Summary: As an Application Lead in Data Engineering, you will be responsible for designing, building, and configuring applications using Apache Spark and Oracle Procedural Language Extensions to SQL (PLSQL). Your typical day will involve leading the effort to deliver high-quality data-driven solutions and acting as the primary point of contact for the project. Good to Have Skills : Strong programming skills in languages like Python, sql ,Knowledge on Big Data tools & Technologies, Hands on Palantir Platform and their services like Data Connection, Code repository, Contour , Data lineage & Health checks. Job Requirements :Key Responsibilities : a)Should be responsible for developing and maintaining applications with PySpark. b)Good Knowledge on Spark Architecture, Performance Tuning with respect to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.. c)Work with stakeholders including the product owner, data and design teams to assist with data-related technical issues and support their data infrastructure needs. d)Interact with business users to understand requirements and troubleshoot issues. Technical Experience : 1) The developer must possess a strong knowledge of Apache Spark and Python programming, along with a solid understanding of core Python concepts such as lists, tuples, dictionaries, sets, and strings. 2)Deep experience in developing data processing tasks using pySpark such as reading data from external sources like API Ingestion, merge data, perform data enrichment and load in to target data destinations. 3)Proficient in managing both structured and unstructured data, with expertise in handling various file formats such as CSV, Excel, Parquet, and ORC. 4)Familiarity with cloud platforms (e.g., AWS, Azure, Palantir) and their data services. 5) In-depth understanding of SQL, with the ability to write complex queries, subqueries, and joins. 6)The candidate should excel in managing comprehensive datasets using full load. methodologies and adeptly implement strategies for capturing and processing incremental changes in data. 7)Experience in version control tools like GIT. 8)Implementing code best practices involves adhering to guidelines that enhance code readability, maintainability, and overall quality. Professional Attributes : 1)Must have Good Communication skill Capable of Client facing 2)Ability to work creatively and analytically in a problem-solving 3)Excellent communication skills; 4)flexibility 5)responsiveness Educational Qualification:15 years of full term education Additional Information: - The candidate should have a minimum of 5 years of experience in Apache Spark. - The ideal candidate will possess a strong educational background in computer science, software engineering, or a related field, along with a proven track record of delivering impactful data-driven solutions.