Job Title: Databricks Engineer
: We are searching for a seasoned Databricks Engineer to pioneer advanced Databricks solutions. The Databricks Engineer will serve as a central figure in our data engineering team, delivering highly sophisticated technological solutions using Databricks, Delta Live Tables, Snowflake, and Medallion Architecture.
Key Responsibilities: Designing, building, and maintaining medallion architecture-based data pipelines in Databricks platforms. Handling raw data ingestion through Delta Live Tables while ensuring data quality and access latency. Manage enterprise-level complex data and metadata changes in Databricks environment using delta live tables. Utilizing knowledge of Snowflake to offer insight into data warehousing and management. Collaborate with data architects to provide Databricks solutions that align with company objectives. Work in conjunction with data science teams to implement complex statistical models. Ensuring data security and compliance in Databricks and Snowflake environments. Developing and deploying ETL job workflows with an emphasis on automation and scalability. Keeping up-to-date with industry best practices and emerging trends in Databricks technology.