Job Description

Company OverviewHiring for a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data.Job OverviewWe are seeking a mid-level Software Engineer for a full-time position located in Chennai, Bangalore, Hyderabad, Pune, Kolkata, Gurgaon, and Delhi. You will be integral to our client projects, leveraging advanced technical skills to drive innovation and solutions. The ideal candidate will have a strong background in Azure Datafactory and Snowflake, as well as proficiency in Spark, Pyspark, Python, and SQL.Qualifications and Skills

• Proficiency in Azure Datafactory (Mandatory skill) to design, deploy, and manage data flow efficiently.
• Experience with Snowflake (Mandatory skill) for building scalable data solutions and managing large datasets.
• Strong programming skills in Python with the ability to write efficient, scalable, and maintainable code.
• Deep understanding of SQL for data extraction, analysis, and reporting across complex datasets.
• Hands-on experience with Spark for processing large volumes of data quickly and effectively.
• Knowledge of Pyspark to enhance the capabilities of Spark with easy integration and accessibility.
• Solid problem-solving skills with the ability to troubleshoot and optimize data workflows and processes.
• Excellent communication and teamwork abilities for collaborating with multi-disciplinary engineering teams.

• Design and implement data architectures and pipelines using Azure Datafactory to meet business requirements.
• Develop robust data solutions on Snowflake ensuring data is accessible and consumable by data teams.
• Collaborate with cross-functional teams to integrate data systems and support business intelligence initiatives.
• Optimize data processing frameworks using Spark and Pyspark for performance and scalability.
• Write efficient and maintainable Python scripts to automate data processing and transformation tasks.
• Conduct comprehensive data validation and quality checks to ensure data integrity and accuracy.
• Participate in code reviews to ensure code quality and adherence to best practices in data engineering.
• Contribute to the continuous improvement of processes and methodologies within the engineering team.

Expertia AI Technologies