Lead Consultant Data Engineer

Year    Hyderabad, Telangana, India

Job Description


Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose \xe2\x80\x93 the relentless pursuit of a world that works better for people \xe2\x80\x93 we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.Inviting applications for the role of Lead Consultant - Data Engineer!Design and develop data warehouses and data marts to support data analysis and reporting.Responsibilities

  • Overall experience on Apache Spark, SQL, DBT, Databricks, Hive, HDFS, Airflow, Kafka required.
  • Develop SQL based data processing pipelines which includes, but not limited, SQL
functions, tables, and views.
  • Implement defined technology best practices and guidelines.
  • Create data validation rules on source data to confirm the data has correct and/or
expected values.
  • Perform data profiling of source data to identify data quality issues and anomalies,
business knowledge embedded in data, gathering of natural keys, and metadatainformation.
  • Leverage Databricks to optimize and accelerate processing and analytics tasks.
  • Collaborate with Databricks Administrators and Platform engineers to ensure optimal
performance of data processing pipelines executed on Databricks.
  • Implement data quality rules and data governance policies to ensure data accuracy and
consistency.
  • Develop Azure Databricks data engineering tasks.
Qualifications we seek!Minimum Qualifications
  • Bachelor\xe2\x80\x99s degree in computer science or related field.
  • Relevant professional experience.
  • Strong SQL skills for data manipulation and query optimization
  • Experience in data integration and data quality
  • Knowledge of data warehouse architectures, design patterns, and performance tuning
techniques
  • Hands on experience on unified data analytics platform with Azure Databricks,
Databricks Workspace user interface, managing Notebooks which use Delta Lake.
  • Basic experience with version control \xe2\x80\x93 git system.
  • Knowledge and experience of Data Build Tool (dbt) or Databricks Delta Live Table is a
huge plus.
  • Knowledge on Azure cloud platform.
  • Knowledge of Visual Studio Code development is a huge plus.
  • Experience with Power BI or other BI reporting tools is a plus.
Preferred Qualification/skillsProfessional Competencies
  • Customer/Stakeholder Focus
  • Functional/Technical skills
  • Written/Oral Communication
  • Ability to adapt to different priorities and assignments quickly
  • Team player with strong Communication skills
  • Excellent analytical and problem-solving skill
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at and on , , , and .Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a \'starter kit,\' paying to apply, or purchasing equipment or training

Genpact

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3300882
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Hyderabad, Telangana, India
  • Education
    Not mentioned
  • Experience
    Year