Job Description

Line of Service

Advisory
Industry/Sector

FS X-Sector
Specialism

Data, Analytics & AI
Management Level

Senior Associate
& Summary

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.




Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.
JOB DESCRIPTION


JOB TITLE: Big Data Engineer


JOB TYPE: Full Time


LOCATION: Bangalore/Hyderabad


Skills:
?

Bachelor's degree in computer science, Applied Mathematics, Data Science, or Machine


Learning.
?

Looking for Candidates with 5-10 years of experience.
?

Hands on experience of implementing data pipelines using traditional DWH, Big data &


Cloud ecosystem.
?

Good exposure to Platform design, cost and size estimation.
?

Good understanding of handling real-time/streaming pipelines.
?

Exposure of managing and leading teams.


Responsibilities
?

Design and develop the data platform to efficiently and cost effectively address various data


needs across the business.
?

Build software across our entire cutting-edge data platform, including event driven and batch


data processing, storage, and serving through various data integration techniques such as


APIs, Lambda, File Feeds etc.
?

Think of new ways to help make our data platform more scalable, resilient, and reliable and


then work across our team to put your ideas into action.
?

Help us stay ahead of the curve by working closely with data architects, stream processing


specialists, API developers, our DevOps team, and analysts to design systems which can


scale elastically.
?

Ensure data quality by implementing re-usable data quality frameworks.
?

Develop and enforce data engineering, security, data quality standards through automation.
?

Expertise in building and managing large volume data processing (both streaming and batch)


platform is a must.
?

Expertise in OLAP databases such as Snowflake or Redshift or similar.
?

Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
?

Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
?

No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus.
?

Expert knowledge of best security practices for cloud apps
?

Expert with CI/CD pipelines, preferably GitHub Actions Workflows.
?

Terraform development experience.
?

Proficient with Python/PySpark.
?

Experience working with containerization platforms, such as Docker, EKS.
?

Databases/Storage knowledge: Snowflake, PostgreSQL, Elasticsearch.
?

Git/GitHub experience


Mandatory Skill Set- Proficient with Python/PySpark, Hands on experience of implementing data pipelines using traditional DWH, Big data & Cloud ecosystem


Preferred Skill Set- Proficient with Python/PySpark, Hands on experience of implementing data pipelines using traditional DWH, Big data & Cloud ecosystem


Year of experience required- 5 to 10 years


Qualifications- Bachelor's degree in computer science, Applied Mathematics, Data Science, or Machine Learning


Education •(if blank, degree and/or field of study not specified)•

Degrees/Field of Study required:
Degrees/Field of Study preferred:
Certifications •(if blank, certifications not specified)•

Required Skills

Python (Programming Language)
Optional Skills

Desired Languages •(If blank, desired languages not specified)•

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date