Azure Data Engineer|bangalore

Year    Bangalore, Karnataka, India

Job Description


Line of Service AdvisoryIndustry/Sector Not ApplicableSpecialism Data, Analytics & AIManagement Level Senior Associate & Summary A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.1. 4+ years of working with Spark, Python2. 4+ years of working with SQL, handling complex windowing functions and joins
3. 2+ years of deployment and maintenance of data pipelines on cloud clusters (AWS/Azure)
4. Unit Testing expertise (Experience with Pytest preferred but, manual is also okay)
5. Good knowledge of version control systems (Git/Bitbucket)Good to have:
1. Exposure to Airflow/Astronomer2. Experience deploying Spark data pipelines on Databricks clusters
3. Working knowledge of Jira and Confluence
4. Flair for automationMandatory skill sets-Minimum 3yrs with Pyspark experience, 1yr of azure data bricks experience, hands on experience with small, large & complex data sets
Preferred skill sets- Minimum 3yrs with Pyspark experience, 1yr of azure data bricks experience, hands on experience with small, large & complex data sets
Year of experience required- 4 to 7 years
Qualifications- Graduate Engineer or Management GraduateEducation (if blank, degree and/or field of study not specified) Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications (if blank, certifications not specified)Required Skills Microsoft Azure Databricks, PySparkOptional SkillsDesired Languages (If blank, desired languages not specified)Travel RequirementsAvailable for Work Visa Sponsorship?Government Clearance Required?Job Posting End Date

PwC

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3367687
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year