Job Description

:

Responsibilities:

• Develop and maintain data scraping scripts and tools to extract job-related data from various job portals, including but not limited to Naukri, Indeed, Monster, LinkedIn, and other region-specific platforms.
• Implement robust and efficient web scraping techniques to gather structured and unstructured data from multiple sources.
• Ensure data accuracy, consistency, and completeness by implementing data validation and cleaning procedures.
• Collaborate with the data analytics and engineering teams to integrate scraped data into databases and data pipelines.
• Monitor and optimize scraping processes to ensure minimal disruption and compliance with website terms of service.
• Stay up-to-date with the latest industry trends, tools, and best practices in web scraping and data extraction.
• Troubleshoot and resolve issues related to data scraping, including website structure changes and blocking mechanisms.
• Create and maintain documentation for data scraping processes, including code, configurations, and workflows.
• Conduct regular quality checks and audits on scraped data to ensure its reliability and relevance.
• Provide insights and recommendations based on the analysis of scraped data to support business decision-making.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
• Minimum of 5 years of hands-on experience in data scraping, web crawling, and data extraction from job portals in India and the USA, including LinkedIn.
• Proficiency in programming languages such as Python, Java, or similar for web scraping purposes.
• Strong understanding of HTML, CSS, JavaScript, and web technologies.
• Experience with web scraping frameworks and libraries such as BeautifulSoup, Scrapy, Selenium, or similar.
• Knowledge of database systems (SQL and NoSQL) and data storage solutions.
• Familiarity with APIs and data integration techniques.
• Ability to work independently and manage multiple tasks simultaneously.
• Strong analytical and problem-solving skills with a keen attention to detail.
• Excellent communication skills and the ability to work collaboratively with cross-functional teams.
• Understanding of ethical considerations and legal implications of web scraping.

Preferred Qualifications:

• Experience with cloud-based data storage and processing solutions such as AWS, Google Cloud, or Azure.
• Knowledge of machine learning and data analysis techniques.
• Familiarity with version control systems such as Git.

Job Type: Full-time

Pay: ?25,000.00 - ?45,000.00 per month

Jadwal:

• Day shift
• Night shift
• US shift

Tunjangan:

• Provident Fund

Upah Tambahan:

• Yearly bonus

Experience:

• total work: 4 years (Preferred)

Work Location: In person

Application Deadline: 08/08/2024
Expected Start Date: 13/08/2024