Scrapyd: where do I get to see the output of my crawler once i schedule it using scrapyd Scrapyd: where do I get to see the output of my crawler once i schedule it using scrapyd curl curl

Scrapyd: where do I get to see the output of my crawler once i schedule it using scrapyd


When using the feed exports you define where to store the feed using a URI (through the FEED_URI setting). The feed exports supports multiple storage backend types which are defined by the URI scheme.

curl http://localhost:6800/schedule.json -d project=tutorial -d spider=dmoz_spider -d setting=FEED_URI=file:///path/to/output.json