Data Engineer - (Mid/Sr) - Chennai and Pune
REF31533L
YOU\'LL BUILD TECH THAT EMPOWERS GLOBAL BUSINESSES
Our Connect Technology teams are working on our new Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on Connect data and insights to innovate and grow.
As a Software Engineer, you\'ll be part of a team of smart, highly skilled technologists who are passionate about learning and supporting cutting-edge technologies such as Spark, Scala, Databricks, Docker, Kubernetes, Kafka and other Data engineering tools. These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, Jenkins and Bitbucket/Git.
WHAT YOU\'LL DO:
Develop, test, troubleshoot, debug, and make application enhancements leveraging Pyspark, Pandas, Databricks, Scala, Airflow, Spark, SQL, Data Science as the core development technologies.
Deploy application components using CI/CD pipelines
Build utilities for monitoring and automating repetitive functions
Collaborate with Agile cross-functional teams - internal and external clients including Operations, Infrastructure, Tech Ops
Participate in a rotational support schedule to provide responses to customer queries and deploy bug fixes in a timely and accurate manner
Qualifications
3 - 10 years of applicable experience working with Bigdata, Spark, Pyspark, Pandas, Scala and DevOps Technologies including support functions
Must have Airflow and Databricks knowledge.
Must have good Azure cloud knowledge
Must have docker and SQL/NoSQL knowledge
Must have Kubernetes, Jenkins and Bitbucket/Git knowledge.
Good to have Data Science and modeling knowledge
Strong analytical, problem-solving skills and ability to learn and apply new technologies quickly
Excellent English communication skills, with the ability to effectively interface across cross-functional technology teams and the business
Minimum B.S. degree in Computer Science, Computer Engineering or related field
Additional Information
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.