Issues

• boilerpipe3 is not being installed

  divkakwani/webcorpus#20 · Filter by author saikat2901 opened on Feb 27, 2023

• Distributed Setup

  divkakwani/webcorpus#14 · Filter by author divkakwani opened on Dec 23, 2019
  3

• Consolidate Data Sources

  divkakwani/webcorpus#13 · Filter by author divkakwani opened on Dec 23, 2019
  

• Record Crawl Events in a File

  divkakwani/webcorpus#12 · Filter by author divkakwani opened on Dec 22, 2019 · Dashboard
  

• Create a Dashboard

  divkakwani/webcorpus#11 · Filter by author divkakwani opened on Dec 22, 2019 · Dashboard

• Use metadata derived from the sitemap

  divkakwani/webcorpus#9 · Filter by author GokulNC opened on Oct 24, 2019
  1

• Handle recursive sitemaps

  divkakwani/webcorpus#7 · Filter by author GokulNC opened on Oct 24, 2019
  4

• Unit tests

  divkakwani/webcorpus#4 · Filter by author GokulNC opened on Oct 23, 2019
  1

• Move all scrapy global settings to settings.py

  usability
  divkakwani/webcorpus#2 · Filter by author GokulNC opened on Oct 23, 2019
  2