Python Web Developer

Job Description

Python Developer with Web scraping scrapy

Alpharetta GA onsite Role

Contract Role

• Develop and maintain web scraping scripts using Python and Scrapy framework.
• Identify and analyze target websites for data extraction.
• Optimize scraping performance to ensure timely and reliable data retrieval.
• Handle and troubleshoot issues related to website structure changes, anti-scraping mechanisms, and data quality.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.

Implement data processing pipelines to clean, validate, and store scraped data.

Stay updated with industry trends and best practices in web scraping and data extraction.

Requirements

• Proven experience in web scraping using Scrapy or similar tools/frameworks.
• Proficiency in Python programming language.
• Solid understanding of web technologies (HTML, CSS, XPath, etc.).

Familiarity with database systems (SQL, NOSQL) and data processing techniques. Strong analytical and problem-solving skills.

Additional Skills

• Excellent communication and teamwork abilities
• Experience with deploying and scaling web scraping solutions in production environments.
• Knowledge of distributed computing frameworks (e.g., Apache Spark) for large-scale data processing.
• Familiarity with containerization technologies (Docker, Kubernetes).
• Understanding of ethical considerations and legal constraints related to web scraping.

Job Details

• Dice Id: 10430747
• Position Id: 8218683