Job Description

Description:data lake, Azuredata Dactory, Data BricksRequirements:Bachelor\xe2\x80\x99s degree in Computer Science, Engineering or related field
8+ years of overall work experience working on Data first systems
4+ years of experience on Data Lake/Data Platform projects on Azure
Proficiency in Azure cloud services essential for data lake development, such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.
Experience with Azure SQL Database and other Azure storage solutions like Cosmos DB for managing structured and unstructured data.
Deep understanding of building and managing data lake solutions on Azure, including data ingestion, storage, management, and consumption layers.
Expertise in designing and implementing ETL (Extract, Transform, Load) processes using Azure Data Factory or similar tools to ingest and transform data from various business systems into the data lake.
Skills in data cleansing and enrichment to ensure data quality and usability for downstream processing and analytics.
Ability to manage schema evolution and metadata for the data lake. Experience with tools like Azure Purview for data discovery and cataloging.
Strong database skills, including SQL for managing and querying data. Experience with relational databases and an understanding of NoSQL databases for handling various data formats and structures.
Proficiency in creating and managing APIs for data access, preferably with experience in JDBC/ODBC to enable SQL query access to the data catalogs.
Knowledge of data governance practices to ensure data privacy, security, and compliance with regulatory requirements, such as GDPR for data protection.
Experience with implementing security measures in the data lake, including data encryption, access controls, and audit logs.
Ability to support analytical queries by optimizing data storage and retrieval, and understanding of indexing, partitioning, and performance tuning.
Strong programming skills in languages like Python, Scala, or SQL that are commonly used in data engineering.
Experience with automation and orchestration tools to streamline data operations. Familiarity with CI/CD practices, particularly in an Azure environment.
Strong teamwork skills to collaborate effectively with the Principal Data Architect and other team members, ensuring that the data solutions align with the broader architectural and business goals.
Advanced problem-solving skills to address technical challenges and implement effective solutions within the data lake framework.Job Responsibilities:Responsibilities
Data Integration & Management:
Design and implement data ingestion pipelines to collect data from various business systems into the data platform, ensuring data is accurate, timely, and consistent.
Develop processes to cleanse data for accuracy and enrich it for added value, ensuring that the data is usable and reliable for business operations and analytics.
Data Platform Implementation:
Manage the storage and organization of data within the data platform, implementing best practices for data partitioning, compression, and formatting to optimize storage efficiency and query performance.
Oversee the schema definitions and evolution in the data platform, ensuring that data structures are optimized for access and analysis.
Implement and maintain a system for data cataloging to enable data discovery and governance, ensuring that data assets are easily accessible and well-documented.
API Development & Data Access:
Develop and maintain JDBC/ODBC-based SQL query APIs to allow seamless access to data catalogs, ensuring they are robust, secure, and perform efficiently under various load conditions.
Optimize and support the execution of simple analytical queries through the data platform, ensuring that performance metrics meet user expectations and business needs.
Security & Compliance:
Implement and monitor security protocols within the data platform environment, including access controls, encryption, and activity logging to safeguard sensitive information.
Ensure that the data handling and processing practices comply with relevant industry regulations and company policies, particularly around data privacy and protection.
Collaboration & Teamwork:
Work closely with the Principal Data Architect and other team members to align the data platform development with the overall data strategy and architectural frameworks.
Interface with various business stakeholders to gather requirements and feedback, and to ensure that the data platform services meet business needs.
Mentor less experienced team members and share expert knowledge on best practices in data engineering, helping to uplift the team\xe2\x80\x99s overall skill level.
Continuous Innovation:
Continuously evaluate new tools, technologies, and processes that can improve the functionality, efficiency, and cost-effectiveness of the data platform.
Identify and implement improvements in data processing and management workflows to enhance productivity and reduce operational costs.
Platform Monitoring & Maintenance:
Monitor the data platform\xe2\x80\x99s performance and health, identifying and resolving issues proactively to minimize downtime and performance degradation.
Implement and oversee mechanisms to continually assess and ensure high data quality throughout the data lifecycle.What We OfferExciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment - or even abroad in one of our global centers or client facilities!Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!About GlobalLogic GlobalLogic is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise-we help our clients imagine what\'s possible, and accelerate their transition into tomorrow\'s digital businesses. Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries. GlobalLogic is a Hitachi Group Company operating under Hitachi, Ltd. (TSE: 6501) which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.

GlobalLogic