Lead Consultant –it Data Engineer
Year Bengaluru, Karnataka, India
Job Description
b'
Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.
Inviting applications for the role of Lead Consultant -IT Data Engineer!
An IT Data Engineer is a professional who designs, develops, and manages data infrastructure and pipelines to enable efficient data storage, retrieval, and analysis. They play a crucial role in ensuring that an organization's data is accessible, reliable, and well-structured for use in various data-driven applications. Here is a typical job description for an IT Data Engineer:
Responsibilities:
Data Architecture: Design and implement data architectures and databases, including data warehouses, data lakes, and data marts, to support the organization's data needs.
Data Integration: Develop data pipelines to collect, transform, and load (ETL) data from various sources into centralized storage systems. Ensure data quality and consistency.
Data Modeling: Create and maintain data models, data dictionaries, and schema definitions to standardize and structure data for optimal use in analytics and reporting.
Database Management: Administer and optimize databases, ensuring performance, security, and data integrity. Implement indexing and data partitioning strategies.
Data Transformation: Implement data transformation processes to convert raw data into usable formats for analysis and reporting.
Data Quality and Governance: Establish and enforce data quality standards, data lineage, and governance policies to ensure data accuracy, compliance, and consistency.
Data Security: Implement data security measures, including access controls, encryption, and auditing, to protect sensitive data and ensure compliance with data protection regulations.
Big Data Technologies: Work with big data technologies such as Hadoop, Spark, and NoSQL databases to handle large volumes of structured and unstructured data.
Cloud Computing: Utilize cloud platforms like AWS, Azure, or Google Cloud to develop scalable and cost-effective data solutions.
ETL Tools: Work with ETL tools like Apache Nifi, Talend, or commercial solutions to streamline data integration and transformation processes.
Automation: Develop automated data pipelines and workflows to reduce manual intervention and increase efficiency.
Documentation: Create comprehensive documentation for data engineering processes, data pipelines, and database schemas.
Collaboration: Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and ensure data engineering solutions meet their needs.
Performance Optimization: Continuously monitor and optimize data infrastructure and pipelines to improve data retrieval and processing speeds.
Qualifications we seek in you!
Minimum Qualifications
Educational Background: A bachelor's degree in computer science, information technology, data engineering, or a related field is typically preferred.
Must have experience in Palantir.
Database Expertise: Proficiency in database management systems (SQL and NoSQL), data modeling, and database optimization techniques.
ETL Skills: Strong knowledge of ETL processes and tools to extract, transform, and load data.
Big Data Technologies: Familiarity with big data technologies and distributed computing, such as Hadoop, Spark, and related ecosystem components.
Programming: Proficiency in programming languages such as Python, Java, Scala, or similar languages commonly used in data engineering.
Data Warehousing: Experience in data warehousing concepts and technologies, including data warehousing design and development.
Cloud Services: Knowledge of cloud computing platforms and services, such as AWS, Azure, or Google Cloud.
Data Governance: Understanding of data governance principles and compliance with data protection regulations.
Automation and Scripting: Skills in scripting and automation tools for managing data pipelines.
Communication Skills: Effective communication and collaboration skills to work with cross-functional teams and explain complex technical concepts to non-technical stakeholders.
IT Data Engineers are essential in enabling organizations to make informed decisions and gain insights from their data assets. They ensure that data is properly collected, stored, and made available for analysis, supporting a wide range of data-driven applications and business processes.
Preferred Qualifications
Good to have:
Need experience with AWS and cloud technologies. experience working in manufacturing and timeseries data. engineering background. experience handling large datasets and Palantir
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at www.genpact.com and on X, Facebook, LinkedIn, and YouTube.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,\' paying to apply, or purchasing equipment or training.
JobLead Consultant Primary LocationIndia-Bangalore ScheduleFull-time Education LevelBachelor's / Graduation / Equivalent Job PostingJun 14, 2024, 4:35:21 PM Unposting DateOngoing Master Skills ListDigital Job CategoryFull Time
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD3332450
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationBengaluru, Karnataka, India
-
EducationNot mentioned
-
ExperienceYear