Job Description

We are 3PILLAR GLOBALWe build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset\'s core values - Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond.In 2024, 3Pillar Global India was named as a \xe2\x80\x9cGreat Place to Work\xe2\x80\x9d for the seventh year in a row based on how our employees feel about our company, collaborative culture, and work/life balance - come join our growing teamSummary:As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering!Responsibilities & Skill Set:

• Design and development of systems for the maintenance of the Azure Lakehouse, ETL processes, business intelligence and data ingestion pipelines for AI/ML use cases.
• Create and support ETL pipelines and tables schemas in order to facilitate the accommodation of new and existing data sources for the Lakehouse on Databricks.
• Maintain data governance and data privacy standards.
• Proven leadership skills, a strategic mindset, and a passion for driving innovation in data engineering and modern data architecture.
• Advanced working SQL knowledge and experience working with relational and NoSQL databases, query authoring (SQL) as well as working familiarity with a variety of databases (e.g. SQL Server, Neo4J, Elastic, Cosmos).
• Experience building and optimizing data pipelines on Azure Databricks.
• In depth knowledge and hands-on experience with Data Engineering, Data Warehousing and Delta Lake on Databricks.
• Highly proficient in Spark, Python, SQL

3Pillar Global