Python Data Engineer
Year Bengaluru, Karnataka, India
Job Description
b'
Key Responsibilities: Data Engineer Web Scraping:
- Utilize Scrapy tool and Python for efficient web scraping to extract structured data from various sources.
- Implement robust and scalable scraping solutions to gather relevant information.
- Develop and maintain ETL processes to extract, transform, and load data into the desired formats.
- Ensure data quality and integrity throughout the extraction and transformation phases.
- Manage and optimize databases to store and organize scraped data effectively.
- Implement data storage solutions compatible with the organization\'s requirements.
- Create automated scripts and workflows to streamline the data collection and transformation processes.
- Explore opportunities for process automation to enhance efficiency.
- Work closely with cross-functional teams, including data scientists and analysts, to understand data requirements.
- Collaborate on designing and implementing effective data models.
- Implement testing procedures to ensure the accuracy and reliability of scraped data.
- Monitor and address any issues related to data quality.
- Bachelor\'s degree in Computer Science, Information Technology, or related field.
- Proven experience in data engineering with a focus on web scraping using Scrapy and Python.
- Strong understanding of ETL processes and data management.
- Proficient in database management systems.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration abilities.
- Health insurance
- Paid sick time
- Paid time off
- Provident Fund
- Work from home
- Monday to Friday
- What is your notice period?
- Bachelor\'s (Preferred)
- Python: 1 year (Preferred)
- total work: 1 year (Preferred)
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD3259622
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationBengaluru, Karnataka, India
-
EducationNot mentioned
-
ExperienceYear