Job Description

Line of Service AdvisoryIndustry/Sector FS X-SectorSpecialism Data, Analytics & AIManagement Level Senior Associate & Summary A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.JOB DESCRIPTION
JOB TITLE: Big Data Engineer
JOB TYPE: Full Time
LOCATION: Bangalore/Hyderabad
Skills:
\xef\x82\xb7 Bachelor\xe2\x80\x99s degree in computer science, Applied Mathematics, Data Science, or Machine
Learning.
\xef\x82\xb7 Looking for Candidates with 5-10 years of experience.
\xef\x82\xb7 Hands on experience of implementing data pipelines using traditional DWH, Big data &
Cloud ecosystem.
\xef\x82\xb7 Good exposure to Platform design, cost and size estimation.
\xef\x82\xb7 Good understanding of handling real-time/streaming pipelines.
\xef\x82\xb7 Exposure of managing and leading teams.
Responsibilities
\xef\x82\xb7 Design and develop the data platform to efficiently and cost effectively address various data
needs across the business.
\xef\x82\xb7 Build software across our entire cutting-edge data platform, including event driven and batch
data processing, storage, and serving through various data integration techniques such as
APIs, Lambda, File Feeds etc.
\xef\x82\xb7 Think of new ways to help make our data platform more scalable, resilient, and reliable and
then work across our team to put your ideas into action.
\xef\x82\xb7 Help us stay ahead of the curve by working closely with data architects, stream processing
specialists, API developers, our DevOps team, and analysts to design systems which can
scale elastically.
\xef\x82\xb7 Ensure data quality by implementing re-usable data quality frameworks.
\xef\x82\xb7 Develop and enforce data engineering, security, data quality standards through automation.
\xef\x82\xb7 Expertise in building and managing large volume data processing (both streaming and batch)
platform is a must.
\xef\x82\xb7 Expertise in OLAP databases such as Snowflake or Redshift or similar.
\xef\x82\xb7 Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
\xef\x82\xb7 Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
\xef\x82\xb7 No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus.
\xef\x82\xb7 Expert knowledge of best security practices for cloud apps
\xef\x82\xb7 Expert with CI/CD pipelines, preferably GitHub Actions Workflows.
\xef\x82\xb7 Terraform development experience.
\xef\x82\xb7 Proficient with Python/PySpark.
\xef\x82\xb7 Experience working with containerization platforms, such as Docker, EKS.
\xef\x82\xb7 Databases/Storage knowledge: Snowflake, PostgreSQL, Elasticsearch.
\xef\x82\xb7 Git/GitHub experienceMandatory Skill Set-Proficient with Python/PySpark, Hands on experience of implementing data pipelines using traditional DWH, Big data & Cloud ecosystem
Preferred Skill Set-Proficient with Python/PySpark, Hands on experience of implementing data pipelines using traditional DWH, Big data & Cloud ecosystem
Year of experience required-5 to 10 years
Qualifications-Bachelor\xe2\x80\x99s degree in computer science, Applied Mathematics, Data Science, or Machine LearningEducation (if blank, degree and/or field of study not specified) Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications (if blank, certifications not specified)Required Skills Python (Programming Language)Optional SkillsDesired Languages (If blank, desired languages not specified)Travel RequirementsAvailable for Work Visa Sponsorship?Government Clearance Required?Job Posting End Date

PwC