Job Description

Job Title: Senior Data Engineer

Job Location: Remote

Skills : MS Fabrics Datalake, Power Bi, Microsoft portals, ServiceNow, PowerApps, REST APIs,

Job Type: Part Time

Experience : 7+ Years

Time: 6 PM IST to 2 AM IST (5 Hours In This Time Slot)

Role Overview: As a Data Engineer, you will play a critical role in setting up and optimizing our data infrastructure. You will work on importing data from various sources, transforming and correlating this data, and making it accessible for analysis and visualization in PowerBI. Your primary focus will be on ensuring data integrity and optimizing the data pipeline for efficient and effective insights generation.

Key Responsibilities:

MS Fabrics Datalake Setup and Management:

• Design, implement, and manage data imports from diverse sources including Microsoft portals, ServiceNow, PowerApps, and REST APIs.
• Develop processes to transform and join data optimally for analysis and reporting.
• Ensure data retention over time by appending data at set intervals to maintain time progression.

Data Transformation and Correlation:

• Transform ingested data into the correct formats and organize them into appropriate tables.
• Establish correlations between different datasets to enhance data analysis and insights generation.

PowerBI Integration and Development:

• Set up and configure PowerBI to connect seamlessly with MS Fabrics Datalake, ensuring the latest data is always available.
• Maintain PowerBI editing capabilities while integrating it with the data lake.
• Develop and design appropriate graphs and dashboards in PowerBI to visualize key insights and metrics.

Project Planning and Roadmapping:

• Collaborate with cross-functional teams to define and prioritize project goals and milestones.
• Develop a roadmap for implementing and enhancing the cyber dashboard and related metrics.

Continuous Improvement:

• Monitor and optimize data ingestion, transformation, and correlation processes for efficiency and scalability.
• Stay updated with the latest industry trends and technologies to continuously improve the data infrastructure.

Qualifications:

Technical Skills:

• Proficiency in MS Fabrics Datalake, including data ingestion and transformation.
• Experience with data integration from Microsoft portals, ServiceNow, PowerApps, and REST APIs.
• Strong knowledge of PowerBI, including setting up data connections and developing visualizations.

Experience:

• Proven experience of more than 7 years as a Data Engineer or in a similar role.
• Experience with data correlation and building data pipelines.
• Experience in developing and implementing KPIs, metrics, and dashboards.

Job Types: Part-time, Temporary
Contract length: 12 months

Pay: From ?30,000.00 per month

Expected hours: 20 - 25 per week

Schedule:

• Monday to Friday

Experience:

• MS Fabrics Datalake: 6 years (Required)
• Data engineer: 7 years (Required)
• Power BI: 4 years (Required)

Work Location: Remote