Skip to content

Support single-url scraping #11

@eob

Description

@eob

Add a new command to support scraping a single url and all its comments. E.g.,

./bin/scrape-url <URL> <Workspace> <ThemeName> <PageName>

This will:

  • create directory Workspace/ThemeName if it doesn't already exist.
  • Save URL to PageName
  • Save all the assets of URL to the ThemeName directory, and
  • Rewrite html to point to them

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions