Job Description

OBJECTIVE OF ROLEWe are seeking a skilled Databricks Data Engineer with Azure to join our dynamic team. The ideal candidate will have a deep understanding of Databricks, Azure Data Services, and Big Data processing to design, develop, and optimize scalable data solutions. This role requires expertise in Spark, Python/Scala, SQL, and cloud-based data architectures to support our business intelligence and analytics initiatives.KEY RESPONSIBILITIES

• Design, develop, and implement scalable data pipelines and ETL processes using Azure Databricks, Apache Spark, and Delta Lake.
• Optimize and maintain large-scale data solutions within Azure Synapse, Azure Data Lake, and Azure SQL.
• Collaborate with data scientists, analysts, and business teams to ensure data availability, quality, and governance.
• Develop and manage CI/CD pipelines for automated data workflows using Azure DevOps.
• Monitor and troubleshoot Databricks clusters, performance tuning Spark jobs, and resolving data processing issues.
• Implement data security best practices such as encryption, access control, and compliance with regulatory standards.
• Design and implement data models, schema structures, and indexing strategies to enhance query performance.
• Leverage Azure Functions, Logic Apps, and Event-driven architectures for data integration and automation.

EXPERIENCE

• 3+ years of experience in Databricks and Apache Spark development.
• Strong proficiency in Python, Scala, and SQL for data processing and analytics.
• Hands-on experience with Azure Data Services (Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, Azure Blob Storage, etc.).
• Experience with data warehousing, ETL frameworks, and Big Data processing architectures.
• Knowledge of Delta Lake, Medallion Architecture, and Data Lakehouse concepts.
• Experience with Azure DevOps, CI/CD Pipelines, Infrastructure as Code (Terraform or ARM templates).
• Familiarity with streaming technologies such as Azure Stream Analytics, Kafka, or Event Hubs is a plus.
• Strong problem-solving, analytical, and communication skills.

QUALIFICATION

• BE/B Tech
• Azure Data Engineer Associate or Databricks Certified Developer certification.
• Experience with Machine Learning pipelines and MLflow in Databricks.

ABILITIESABOUT USIGT Solutions (IGT) is committed to simplifying complex customer interactions while delivering a seamless experience. It provides integrated BPM, Technology and Digital Services & Solutions for clients across industries. IGT Solutions is a next-gen customer experience (CX) company, defining and delivering transformative experiences for the global and most innovative brands using digital technologies. With the combination of Digital and Human Intelligence, IGT becomes the preferred partner for managing (end-to-end) CX journeys across Travel and Hi-tech industries.Established in 1998, with 100% focus on customer experience, IGT employs more than 20,000+ customer experience and technology specialists providing services to 75+ marquee customers globally. IGT's global footprint consists of 23 delivery centers in China, Philippines, Malaysia, India, UAE, Romania, Indonesia, Spain, Colombia and the USAEQUAL OPPORTUNITY DISCLAIMERIt is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.ADDRESS & LOCATIONIndia, Maharashtra, Weikfield IT-Citi Infopark, 6th Floor, Unit No. 601 & 602, Survey No. 30/3, 31/1 & 2A, Village Vadgaonsheri, Nagar Road, Viman Nagar, Taluka Haveli, Pune - 411014, India

IGT Solutions