yacy_search_server/source/net/yacy/search
Michael Peter Christen 97f6089a41 YaCy can now create web page snapshots as pdf documents which can later
be transcoded into jpg for image previews. To create such pdfs you must
do:

Add wkhtmltopdf and imagemagick to your OS, which you can do:
On a Mac download wkhtmltox-0.12.1_osx-cocoa-x86-64.pkg from
http://wkhtmltopdf.org/downloads.html and downloadh
ttp://cactuslab.com/imagemagick/assets/ImageMagick-6.8.9-9.pkg.zip
In Debian do "apt-get install wkhtmltopdf imagemagick"

Then check in /Settings_p.html?page=ProxyAccess: "Transparent Proxy" and
"Always Fresh" - this is used by wkhtmltopdf to fetch web pages using
the YaCy proxy. Using "Always Fresh" it is possible to get all pages
from the proxy cache.

Finally, you will see a new option when starting an expert web crawl.
You can set a maximum depth for crawling which should cause a pdf
generation. The resulting pdfs are then available in
DATA/HTCACHE/SNAPSHOTS/<host>.<port>/<depth>/<shard>/<urlhash>.<date>.pdf
2014-12-01 15:03:09 +01:00
..
index do not cache search requests to Solr if the result is used for 2014-11-20 18:45:27 +01:00
query ignore url errors during search 2014-11-27 20:50:55 +01:00
ranking refactore URIMetadataNode to further unify interaction with index 2014-04-20 01:41:30 +02:00
schema do not cache search requests to Solr if the result is used for 2014-11-20 18:45:27 +01:00
snippet skip unused call parameter for hashSentence() 2014-11-30 19:42:33 +01:00
EventTracker.java fix for long periods in timeline 2014-07-02 11:29:50 +02:00
IndexingQueueEntry.java refactoring 2012-09-21 15:48:16 +02:00
MemoryTracker.java added missing @Override annotation 2014-03-28 13:48:37 +01:00
ResourceObserver.java NPE fix for postprocessing without term index 2014-06-04 12:28:28 +02:00
Shutdown.java Added 'final' for all exception blocks as this helps the Java compiler 2013-07-17 18:31:30 +02:00
Switchboard.java YaCy can now create web page snapshots as pdf documents which can later 2014-12-01 15:03:09 +01:00
SwitchboardConstants.java added high-precision scheduler for API processes. This allows also to 2014-11-14 10:02:50 +01:00