Lead Data Engineer, Data Factory

Year    KA, IN, India

Job Description

The Core AI & Data Platforms Team has been established to create, operate and run the Enterprise AI, BI and Data that facilitate the time to market for reporting, analytics and data science teams to run experiments, train models and generate insights.



The Data Factory team ingests data from various sources into the Enterprise Data Lake and performs content agnostic transformations to provide end-users with clean datasets, guidance, and oversight of content specific transformations. At Thomson Reuters, we are recruiting a team of motivated data professionals to transform how we manage and leverage our commercial data assets.


Join our dynamic team as a Lead Data Engineer and take a pivotal role in shaping the future of our data ingestion solutions into Enterprise Data Lake. You will ideate & lead the solution design and implementation of data ingestions from various source systems using frameworks on cloud-based infrastructure, ensuring the efficiency, scalability, and reliability of our systems.

About the Role


In this opportunity as the Lead Data Engineer, you will:

• Design Solutions to Ingest data into Data Lake from various source systems by performing source data analysis.
• Work with data subject experts to build the solution, data pipelines and document the data transformations.
• Collaborate with multiple teams and business teams starting from business analysts, data architects.
• Mentor and lead team members in implementation of advanced technology solutions for the data lake ingestions and surrounding functionality keeping teams accountable for high quality deliveries. Innovate with new approaches for source ingestion, ELT data pipelines, AWS-based frameworks, documentation, and usability by stakeholders.
• Effectively communicate and liaise with other data management teams embedded across the organization and data consumers in data science and business analytics teams.
• Contribute to improving the customer experience.
• Relational and Non-Relational Databases,
• Semi-structured and Unstructured Data
• Snowflake Database
• AWS services (S3, EC2, lambda, IAM, VPC, Load Balancer, Glue, RDS)
• Programming in Python/Spark
• Informatica Data Analysis and Data processing technologies

About You


You're a fit for the role of Lead Data Engineer if you have demonstrated expertise of 9+ years experience in:

• Expert in Data Pipeline Development - ETL/ELT tooling for on-prem and cloud environments
• Expertise in any ETL tool, preferably Informatica
• Highly proficient in SQL
• Highly Experienced in working on Relational and Non-Relational Databases like Snowflake
• Expertise in Semi-structured and Unstructured Data
• Proficient in AWS services (S3, EC2, lambda, IAM, VPC, Load Balancer, Glue, RDS)
• Proficient in programming languages like Python/Spark
• Basic knowledge of Ingesting from API
• Working experience in creating sustainable data pipelines to Data Lakes/Datawarehouse/Data Marts
• End to End deployment of Data pipelines using the CICD process
• Good written and oral communication skills
• Information systems design
• Stakeholder management
• Understanding of Data modeling 3NF and dimensional, including conceptual, logical and physical
• Master and Reference data management
• Experience or knowledge of Terraform deployment
• Basic understanding of shell scripting
• Developing ETL pipelines using PySpark and DBT
• Awareness of Data Governance Standards
• Agile Method of working
• Solution Design experience building use case diagrams, architectural workflows, etc.
• Big Data Experience
• Global teaming and remote collaboration
• Business Analysis


#LI-NP1

What's in it For You?



You will join our inclusive culture of world-class talent, where we are committed to your personal and professional growth through:

• Hybrid Work Model: We've adopted a flexible hybrid working environment (2-3 days a week in the office depending on the role) for our office-based roles while delivering a seamless experience that is digitally and physically connected
• Wellbeing: Comprehensive benefit plans; flexible and supportive benefits for work-life balance: flexible vacation, two company-wide Mental Health Days Off; work from another location for up to a total of 8 weeks in a year, 4 of those weeks can be out of the country and the remaining in the country, Headspace app subscription; retirement, savings, tuition reimbursement, and employee incentive programs; resources for mental, physical, and financial wellbeing.
• Culture: Globally recognized and award-winning reputation for equality, diversity and inclusion, flexibility, work-life balance, and more.
• Learning & Development: LinkedIn Learning access; internal Talent Marketplace with opportunities to work on projects cross-company; Ten Thousand Coffees Thomson Reuters cafe networking.
• Social Impact: Ten employee-driven Business Resource Groups; two paid volunteer days annually; Environmental, Social and Governance (ESG) initiatives for local and global impact.
• Purpose Driven Work: We have a superpower that we've never talked about with as much pride as we should - we are one of the only companies on the planet that helps its customers pursue justice, truth and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.


Do you want to be part of a team helping re-invent the way knowledge professionals work? How about a team that works every day to create a more transparent, just and inclusive future? At Thomson Reuters, we've been doing just that for almost 160 years. Our industry-leading products and services include highly specialized information-enabled software and tools for legal, tax, accounting and compliance professionals combined with the world's most global news services - Reuters. We help these professionals do their jobs better, creating more time for them to focus on the things that matter most: advising, advocating, negotiating, governing and informing.


We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments that celebrate diversity and inclusion. At a time when objectivity, accuracy, fairness and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward.

Accessibility


As a global business, we rely on diversity of culture and thought to deliver on our goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity/Affirmative Action Employer providing a drug-free workplace.


We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law.

•Protect yourself from fraudulent job postings • •click here • •to know more. •


More information about Thomson Reuters can be found on https://thomsonreuters.com.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3409009
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Contract
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    KA, IN, India
  • Education
    Not mentioned
  • Experience
    Year