Job Description

:

Amantya Technologies is seeking a skilled Python PySpark Developer to join our dynamic team in Bangalore. As a PySpark Developer, you will be responsible for developing scalable data pipelines and efficient data processing solutions leveraging the Apache Spark

framework.

Key Responsibilities:

• Designing and developing robust PySpark applications for large-scale data processing.
• Building and optimizing data ingestion, transformation, and storage processes.
• Implementing efficient algorithms and data structures for distributed computing.
• Collaborating with cross-functional teams to integrate data-driven solutions into business processes.
• Troubleshooting performance bottlenecks and ensuring high availability and reliability of data pipelines.
• Writing and optimizing SQL queries for data extraction and manipulation.

Required Skills and Qualifications:

• Bachelor's/Master's degree in Computer Science, Engineering, or a related field.

o Proven experience (3-10 years) in Python development with a focus on PySpark.

• Strong understanding of distributed computing principles and experience with Apache Spark.
• Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, etc.) .
• Experience with data serialization formats such as JSON, Parquet, Avro .
• Familiarity with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) is a plus .
• Excellent problem-solving skills and ability to work independently or as part of a team.
• Good communication skills with the ability to effectively collaborate with stakeholders.

Preferred Qualifications:

o Certification in Apache Spark or related technologies.

• Experience with stream processing frameworks like Apache Kafka .
• Knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis.

Additional Information

Required Qualification

Master of Computer Applications (M.C.A.) ,Bachelor of Engineering - Bachelor of Technology (B.E./B.Tech.) ,

Job Type: Full-time

Pay: ?1,600,000.00 - ?3,000,000.00 per year

Jadwal:

• Day shift
• Rotational shift

Tipe Lokasi:

• In-person

Experience:

• total work: 1 year (Preferred)

Work Location: In person

Speak with the employer
+91 9289640609