reger 510f11d374 Implement surrogate import from Warc archives (as first option handle ...

warc = Web ARChive File Format.
Warc files with extension .warc or compressed warc.gz can be placed in the
DATA/surrogate/in and contained responses are imported to the index.
The used library is stream based so we can easily extend it later to use
and load warc's from the net.

2017-03-31 00:58:11 +02:00

71 KiB

Raw History

View Raw