Description:Title: Data Engineer
JD: Require an experienced Data Engineer who can design, develop and maintain complex data engineering pipelines for structured & semi structured data
Experience: 5+ yrs of experienceRequirements:a. Implement and maintain distributed database systems using Citus to extend PostgreSQL for large-scale data handling.
b. Integrate and manage data services and tools using REST APIs, enhancing system interoperability and data exchange.
c. Utilize Azure Kubernetes Service (AKS) for orchestrating containerized data applications, ensuring scalability and reliability.
d. Strong understanding of Git and CI/CD practices is crucial for this role.
e. Employ best practices in continuous integration and delivery with an understanding of Azure DevOps tools (if applicable).
f. Troubleshoot and resolve data processing issues and perform root cause analysis to prevent future occurrences.
g. Collaborate with cross-functional teams to integrate systems and ensure consistent data flow.
h. Document all processes, models, and activities to ensure clarity and compliance with company standards.Job Responsibilities:Key Responsibilities:a. Develop, build, and sustain scalable and high-performance data pipelines utilizing Spark, Scala, and Python.
b. Develop and manage Databricks workflows, with a focus on performance optimization and efficient cluster utilization.
c. Manage and utilize Delta tables for improved data storage.
d. Efficiently handle various Big Data file formats including Parquet, ORC, and JSON to ensure compatibility and performance across different data storage solutions.What We OfferExciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment - or even abroad in one of our global centers or client facilities!Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!About GlobalLogic GlobalLogic is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise-we help our clients imagine what\'s possible, and accelerate their transition into tomorrow\'s digital businesses. Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries. GlobalLogic is a Hitachi Group Company operating under Hitachi, Ltd. (TSE: 6501) which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.