Job Description

:Job Title: Big Data EngineerLocation: Trivandrum, Cochin, Bangalore, Chennai, Hyderabad, Pune, Noida:We are seeking a talented Big Data Engineer to join our dynamic team. The ideal candidate will be proficient in Apache Spark, Hadoop ecosystem technologies, Azure Cosmos DB, shell scripting, and building robust data pipelines. You will play a crucial role in designing, developing, and maintaining scalable data solutions that meet our business needs.Key Responsibilities:- Data Pipeline Design: Design and implement scalable data pipelines using Apache Spark and Hadoop ecosystem technologies.- ETL Processes: Develop and optimize data integration and ETL processes.- NoSQL Databases: Build and maintain NoSQL databases using Azure Cosmos DB.- Shell Scripting: Write efficient shell scripts for automation of data workflows and system monitoring.- Collaboration: Work with cross-functional teams to understand data requirements and implement solutions.- Performance Tuning: Perform performance tuning, troubleshooting, and optimization of data solutions.- Data Quality: Ensure data quality and reliability throughout all stages of data pipelines.Qualifications:- Proficiency in Apache Spark and Hadoop ecosystem technologies.- Experience with Azure Cosmos DB.- Skilled in shell scripting for automation and system monitoring.- Proven ability to design and maintain scalable data pipelines.- Strong problem-solving and troubleshooting skills.- Ability to collaborate effectively with cross-functional teams.Preferred Qualifications:- Additional experience with other big data technologies is a plus.Sourcing Keywords:- Big Data Technologies: Apache Spark, Hadoop ecosystem- Database: Azure Cosmos DB, NoSQL databases- Data Pipelines: Design, implement, and maintain scalable data pipelines- ETL Processes: Develop and optimize- Shell Scripting: Automation, data workflows, system monitoring- Collaboration: Cross-functional teams, data requirements- Performance Tuning: Optimization, troubleshooting- Data Quality: Ensure reliability throughout data pipelinesSkills:Spark,Hadoop,Cosmos DbAbout Company:UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact touching billions of lives in the process.

UST