Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.
Define best practices for product development, engineering, and coding as part of a world class engineering team in PepsiCo.
Work with the product team leveraging our core technology platforms, which include Direct Commerce, Supply Chain, Marketing Automation, Mobile, and Data. Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms.
Lead feature development in collaboration with other engineers; validate requirements / stories, assess current system capabilities, and decompose feature requirements into engineering tasks
Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers
Develop software in short iterations to quickly add business value
Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers
Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues
Extremely comfortable working with data, including managing large number of data sources, analysing data quality, and pro-actively working with client\xe2\x80\x99s data/ IT teams to resolve issues
Qualifications:
6+ years of experience in designing and building systems for collecting, storing, and analysing data at scale
5+ years of experience managing mid/large level size team and delegating project specific responsibility for seamless delivery
Required skills: Python, PySpark, SQL,Airflow , Big Data \xe2\x80\x93 Hadoop (Hive/Impala), AWS, Azure
Strong interpersonal skills to effectively interact with client/onshore personnel to understand specific Enterprise Information Management requirement and develop solutions based on those requirement
Experience in Retail, E-commerce or Financial Services domain is preferred.
Master\xe2\x80\x99s or Bachelor\'s degree in computer engineering or related analytics field from a premier/Tier1 institute of India
Very strong analytical skills with the demonstrated ability to research and make decisions based on the day-to-day and complex customer problems required
Hands on experience of handling large data sets and use of python/PySpark/SQL/Hive/Impala for data analysis
Strong record of achievement, solid analytical ability, and an entrepreneurial hands-on approach to work.
Outstanding written and verbal communication skills
Deep understanding of database design and engineering
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.