Job Description

:Job Title: Senior Big Data EngineerExperience Range: 5 to 10 yearsHiring Location: PuneNotice Period: 0-30 Days:We are seeking a Big Data Engineer with 5+ years of experience to play a key role in building, managing, and optimizing our big data pipelines. This role involves working with cutting-edge technologies to enhance product capabilities while collaborating with cross-functional teams.Key Responsibilities:

• Work closely with Technical Leaders to design and implement robust Big Data solutions.
• Participate in design discussions and brainstorming sessions to evaluate tools and frameworks for Big Data processing.
• Develop and maintain data processing pipelines using distributed frameworks like Apache Spark and Hadoop.
• Implement ETL processes and optimize data workflows using Apache Airflow, dbt, and related tools.
• Ensure data quality, security, and performance in large-scale data processing environments.
• Collaborate with multi-region software and support teams to ensure seamless data integration.
• Stay up to date with the latest advancements in Big Data technologies and contribute to continuous improvements.

Must-Have Skills:

• 4+ years of experience in Data Engineering.
• Strong understanding of Big Data ecosystems, including Spark and Hadoop.
• Proficiency in ETL processes and data pipeline orchestration using Apache Airflow, dbt, or similar tools.
• Strong programming skills in Python, Java, or Scala, along with SQL expertise.
• Experience with version control tools (Git) and build tools like Gradle, Maven, or SBT.
• Experience in cloud-based data platforms (AWS, GCP, or Azure).
• Strong understanding of object-oriented programming, data structures, algorithms, and performance optimization.
• Excellent problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience with data warehouse platforms (Snowflake, Redshift, BigQuery).
• Familiarity with streaming data processing frameworks (Kafka, Flink).
• Knowledge of containerization and orchestration tools (Docker, Kubernetes).
• Exposure to DevOps practices and CI/CD pipelines.

Qualifications:

• Bachelorxe2x80x99s/Masterxe2x80x99s degree in Computer Science, Information Technology, or a related field.
• 5-7 years of professional experience in Big Data Engineering.

Skills:java,Microservices,Python,Big DataAbout Company:UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worldxe2x80x99s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clientsxe2x80x99 organizations. With over 30,000 employees in 30 countries, UST builds for boundless impactxe2x80x94touching billions of lives in the process.

UST