Job Description

Posted on: August 04, 2024ROLES & RESPONSIBILITIESCore Skills\xc2\xb7 Build pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources.\xc2\xb7 Collaborate with cross functional teams to source data and make it available for downstream consumption.\xc2\xb7 Work with the team to provide an effective solution design to meet business needs.\xc2\xb7 Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed.\xc2\xb7 Ensure dependencies and challenges (risks) are escalated and managed. Escalate critical issues to the Sponsor and/or Head of Data Engineering.\xc2\xb7 Ensure timelines (milestones, decisions and delivery) are managed and value of initiative is achieved, without compromising quality and within budget.\xc2\xb7 Ensure an appropriate and coordinated communications plan is in place for initiative execution and delivery, both internal and external.\xc2\xb7 Ensure final handover of initiative to business as usual processes, carry out a post implementation review (as necessary) to ensure initiative objectives have been delivered, and any lessons learned are fed into future initiative management processes.Who we are looking for:Competencies & Personal Traits\xc2\xb7 Work as a team player\xc2\xb7 Excellent problem analysis skills\xc2\xb7 Experience with at least one Cloud Infra provider (Azure/AWS)\xc2\xb7 Experience in building data pipelines using batch processing with Apache Spark (Spark SQL, Dataframe API) or Hive query language (HQL)\xc2\xb7 Experience in building streaming data pipeline using Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake\xc2\xb7 Knowledge of NOSQL databases. Good to have experience in Cosmos DB and GraphQL\xc2\xb7 Knowledge of Big data ETL processing tools\xc2\xb7 Experience with Hive and Hadoop file formats (Avro / Parquet / ORC)\xc2\xb7 Basic knowledge of scripting (shell / bash)\xc2\xb7 Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat files\xc2\xb7 Basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.\xc2\xb7 Basic understanding of DevOps practices using Git version control\xc2\xb7 Ability to debug, fine tune and optimize large scale data processing jobsWorking Experience\xc2\xb7 1-3 years of broad experience of working with Enterprise IT applications in cloud platform and big data environments.Professional Qualifications\xc2\xb7 Certifications related to Data and Analytics would be an added advantageEducation\xc2\xb7 Master/bachelor\'s degree in STEM (Science, Technology, Engineering, Mathematics)Language\xc2\xb7 Fluency in written and spoken EnglishEXPERIENCE

• 3-4.5 Years

SKILLS

• Primary Skill: Data Engineering
• Sub Skill(s): Data Engineering
• Additional Skill(s): synapse, databricks, Azure Data Factory

ABOUT THE COMPANYInfogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Krak\xc3\xb3w, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.

Infogain