6 Commits

Author	SHA1	Message	Date
karlchenofhell	c016fcb10f	- added streaming-support to CrawlURLFetchStack_p servlet ... - bug for NPE in list.java - use more constants git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3373 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-19 12:47:46 +00:00
karlchenofhell	d114a0136e	- crawl profile: don't add null-values ... - added some settings and statistics for url-fetcher 'server'-mode - added own stack for fetchable URLs - added possibility to fill stack via shift from peer's queues, via POST (addurls=$count and url$num=$url) or via file-upload - added "htroot" to classpath of linux start-script git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3370 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-17 19:16:53 +00:00
karlchenofhell	e6ddf135bb	- enabled fetching new crawls via /yacy/list.html?list=queueUrls for testing purposes ... - sent URLs are taken off the limit-stack (of the global crawl trigger) (may be moved somewhere else in future versions) - added option to set the requested chunk-size git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3367 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-14 14:50:55 +00:00
karlchenofhell	67d96249b4	- fix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3366 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-13 21:17:43 +00:00
karlchenofhell	c5a2ba3a23	- prepared URL fetch from other peers ... - more feedback for user git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3365 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-13 20:18:12 +00:00
karlchenofhell	50b59e312f	- added experimental CrawlURLFetch_p-Servlet to fetch new URLs from a specified location (\n-seperated list). Requested by Theli. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3361 6c8d7289-2bf4-0310-a012-ef5d649a1542	2007-02-10 20:20:00 +00:00