Job Description

Job Title: Data Engineer
Job Type: Remote/Contractual
Experience: 5.0 to 8.0 yrs
Core Skill: Data Engineer
Salary : INR60,000-80,000K
Education: B.Tech
Mandatory Skill: ETL pipelines, Apache Spark, Big Data (Hadoop/Kafka/Spark), Programing Language (JAVA/Python/Scala),

Location: Remote

Description:

Position Overview:

We are looking for a ETL/Data Engineer with a strong background in big data

technologies and real-time data processing. The candidate will build and maintain

scalable ETL pipelines and optimize data processing workflows using Spark, Airflow,

and other modern tools. The role focuses on robust, fault-tolerant systems and cost effective resource utilization.

Key Responsibilities:

• Design, build, and maintain scalable ETL pipelines for data processing.
• Implement real-time data streaming using Apache Spark Streaming or equivalent

tools.

• Develop batch processing workflows using Spark and integrate them with

storage solutions.

• Leverage orchestration tools like Apache Airflow to manage and monitor data

pipelines.

• Optimize resource usage for efficient data processing and minimize costs.
• Collaborate with the Data Warehouse Engineer to ensure seamless integration

between processing and storage layers.

• Troubleshoot pipeline failures and implement solutions to improve reliability and

performance.

Required Skills and Qualifications:

• Proficiency in Apache Spark, including batch and streaming data processing.
• Strong knowledge of orchestration tools like Apache Airflow.
• Experience with big data frameworks and technologies (e.g., Hadoop)
• Familiarity with AWS data services like Glue, Athena, and Kinesis.
• Knowledge of event-driven architectures and ETL best practices.
• Hands-on experience with Python, Scala, or Java for data engineering .
• Strong problem-solving skills and the ability to work in an agile environment.
• 5+ years of experience in data engineering or related fields.

Job Type: Contractual / Temporary
Contract length: 6 months

Pay: ?60,000.00 - ?80,000.00 per month

Experience:

• Java/Python/Scala: 5 years (Required)
• ETL Pipelines: 4 years (Required)
• Big DATA: 3 years (Required)

Work Location: Remote