Senior Big Data Engineer

Year    Pune, Maharashtra, India

Job Description


What We\'ll Bring: About TransUnion:TransUnion is a global information and insights company which provides solutions that help create economic opportunity, great experiences and personal empowerment for hundreds of millions of people in more than 30 countries. We call this Information for Good\xc2\xae.TransUnion is a leading credit reference agency and we offer specialist services in fraud, identity and risk management, automated decisioning and demographics. We support organizations across a wide variety of sectors including finance, retail, telecommunications, utilities, gaming, government and insurance.What You\'ll Bring:What youll bring:Were looking for a Senior Big Data Engineer to join our growing Data Engineering and Analytics Practice who will drive building next generation suite of products and platform by designing, coding, building and deploying highly scalable and robust solutions. You will be based both from our offices in Pune and working remotely as part of our flex together approach. In this fast-paced role youll work with Business Stakeholders to achieve business goals. This exciting role will offer a host of development opportunities as part of a growing global business.Key Responsibilities:

  • Passion for Technology in the field of Data Engineering and Analytics
  • Design, build, test and deploy cutting edge Big Data solutions at scale
  • Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources
  • Build data pipelines and API integrations with various internal systems
  • Work Across all stages of Data Lifecycle
  • Implement best practices across all Data Analytics Processes
  • Estimate effort, identify risks and plan execution
  • Proactively monitor, identify, and escalate issues or root causes of systemic issues
  • Enable data scientists, business and product partners to fully leverage our platform
  • Engage with business stakeholders to understand client requirements and build technical solutions and delivery plans
  • Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality
  • Provide end to end Big data solution and design details to data engineering teams
  • Good analytical & problem-solving skills
  • Good communication and presentation skills
Skills & Experience:
  • 5-8 years of Total IT Experience
  • 5+ years of experience in Big Data technologies (e.g. Spark, Hive, Hadoop)
  • Strong SQL knowledge & experience
  • R & Sparklyr experience
  • Experience designing and implementing data pipelines
  • Hadoop Distributions - Cloudera/Hortonworks/Mapr
  • Big Data Technologies - Hadoop HDFS, Hive, Spark, Kafka, Sqoop
  • Cloud - AWS, Azure, GCP
  • Cloud Big data - AWS EMR, AWS Glue, AWS Kinesis, Azure Data Lake
  • Experience in designing solution using batch data processing methods, real-time streams, ETL processes and Business Intelligence tools
  • Designing Logical Data Model and Physical Data Models including data warehouse and data mart designs.
  • Expertise in writing complex, highly-optimized queries across large data sets to write data pipelines and data processing layers.
  • Excellent communication skills and presentation skills
  • Experience with Airflow is a plus
Impact You\'ll Make:TransUnion - a place to grow:We know that its unrealistic to expect candidates to have each and every aspect of the essential and/or desirable skills listed above - if theres something you cant tick off right now - good, you can learn here!Impact youll make:Enable Decision Making across the organization using data driven cultureWhats In It for you?At TransUnion you will be joining a friendly, forward thinking global business.As well as a competitive salary & bonus scheme our benefits package includes up 26 days annual leave (plus bank holidays) a generous contributory pension scheme, private health care and a host of other employee lifestyle benefits.Thats in addition to a variety of physical, mental and financial fitness wellbeing programmes such as lunchtime yoga, boxing classes, mindfulness app access, daily dedicated away from keyboard time to ensure colleagues take a break and our diversity forums and networking groups.This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.TransUnion Job TitleSpecialist IV, Data Science and Analytics

TransUnion

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3343336
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year