20 of 20 Scrapy Jobs in England

/or anti-bot mechanisms/countermeasures Ability to mentor engineers, review code and improve team workflows Strong knowledge of Python and relevant libraries (Scrapy, Spash, Puppeteer, Requests, JSON, lxml, re, Pandas) Understanding of ETL pipelines, data normalisation and data processing workflows Strong familiarity with HTTP methods, web networking, API More ❯

years of experience as a Data Engineer or in a similar role Proficiency in Python for web crawling (e.g., using libraries like Scrapy, BeautifulSoup, or Selenium). Strong knowledge of data cleaning, standardization, and normalization techniques Experience with data analysis and modeling using libraries such as Pandas, NumPy, Scikit-learn More ❯

SQL). Hands on data preparation activities using the Azure technology stack especially Azure, Databricks, Snowflake is strongly preferred. Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar). Familiarity with cloud data platforms (e.g., AWS, Azure, Google Cloud) is a plus. Hands on experience required with Airflow More ❯

Science, Engineering, Physics, Math or other field with strong software programming curriculum Nice to have: Web scraping and data analysis experience with Python tools (Scrapy, pandas, NumPy) Some experience in machine learning Contribution to open source projects Position: Freelance Position: Freelance Work Schedule: Full-time Remote: No Relocation: Yes Salary More ❯

a related field, or have programming experience Comfortable writing clean, documented code in Python, Go, or TypeScript Familiar with web-scraping tools (e.g., BeautifulSoup, Scrapy, OCR libraries, REST/SOAP APIs) Eager to learn Postgres database design and querying Curious about generative AI, prompt engineering, or data visualisation A collaborative More ❯

a related field, or have programming experience Comfortable writing clean, documented code in Python, Go, or TypeScript Familiar with web-scraping tools (e.g., BeautifulSoup, Scrapy, OCR libraries, REST/SOAP APIs) Eager to learn Postgres database design and querying Curious about generative AI, prompt engineering, or data visualisation A collaborative More ❯

a related field, or have programming experience Comfortable writing clean, documented code in Python, Go, or TypeScript Familiar with web-scraping tools (e.g., BeautifulSoup, Scrapy, OCR libraries, REST/SOAP APIs) Eager to learn Postgres database design and querying Curious about generative AI, prompt engineering, or data visualisation A collaborative More ❯

science, and automation. Required Skills: Strong knowledge of TypeScript, React, and Node.js for full-stack development. Familiarity with web scraping frameworks (e.g., Puppeteer, BeautifulSoup, Scrapy). Strong problem-solving, analytical, and debugging skills. Excellent communication and leadership skills, with the ability to influence both technical and non-technical stakeholders. Ability More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

Professional experience as a Python developer in a software engineering context Strong knowledge of web scraping techniques and tools (e.g. BeautifulSoup, Requests, Selenium, or Scrapy) Understanding of website structures, and how to extract data Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks. Experience with Databricks and More ❯

and cron automation - Optionally integrate a simple frontend with React or Next.js - Output search results as JSON or API response Tech Stack (Preferred): - Python (Scrapy, Playwright, or Requests + BeautifulSoup) - PostgreSQL (Amazon RDS) - FastAPI or Flask for API - AWS (EC2, S3, RDS) - OpenAI/GPT for text search matching (via More ❯

analytics that will directly influence business strategy and client delivery. Key responsibilities Design, deploy, and maintain Python-based web crawlers using tools such as Scrapy, BeautifulSoup, or Selenium Implement scalable and reliable web scraping frameworks for high-volume data extraction across websites and social media platforms Perform data cleaning, standardization … experience and skills 3-5 years of experience in a data engineering or similar role Proficiency in Python for web crawling using libraries like Scrapy, BeautifulSoup, or Selenium Strong understanding of data cleaning, standardization, and normalization techniques Experience building ETL/ELT pipelines and working with large-scale data workflows More ❯

analytics that will directly influence business strategy and client delivery. Key responsibilities Design, deploy, and maintain Python-based web crawlers using tools such as Scrapy, BeautifulSoup, or Selenium Implement scalable and reliable web scraping frameworks for high-volume data extraction across websites and social media platforms Perform data cleaning, standardization … experience and skills 3-5 years of experience in a data engineering or similar role Proficiency in Python for web crawling using libraries like Scrapy, BeautifulSoup, or Selenium Strong understanding of data cleaning, standardization, and normalization techniques Experience building ETL/ELT pipelines and working with large-scale data workflows More ❯

a contract basis asap. Skillset: Python Development Selenium and/or Playwright for browser automation and end to end testing of web applications Web Scrapy requests Beautiful Soup Cloud experience Excellent communication skills Please send me your cv and I can you through more details on the role More ❯