yacy_search_server/source/de/anomic/http
theli f17ce28b6d *) plasmaHTCache:
- method loadResourceContent defined as deprecated. 
     Please do not use this function to avoid OutOfMemory Exceptions 
     when loading large files
   - new function getResourceContentStream to get an inputstream of a cache file
   - new function getResourceContentLength to get the size of a cached file
*) httpc.java:
   - Bugfix: resource content was loaded into memory even if this was not requested
*) Crawler:
   - new option to hold loaded resource content in memory
   - adding option to use the worker class without the worker pool 
     (needed by the snippet fetcher)
*) plasmaSnippetCache
   - snippet loader does not use a crawl-worker from pool but uses
     a newly created instance to avoid blocking by normal crawling
     activity.
   - now operates on streams instead of byte arrays to avoid OutOfMemory 
     Exceptions when operating on large files 
   - snippet loader now forces the crawl-worker to keep the loaded
     resource in memory to avoid IO 
*) plasmaCondenser: adding new function getWords that can directly operate on input streams
*) Parsers
   - keep resource in memory whenever possible (to avoid IO)
   - when parsing from stream the content length must be passed to the parser function now.
     this length value is needed by the parsers to decide if the parsed resource content is to large
     to hold it in memory and must be stored to file 
   - AbstractParser.java: new function to pass the contentLength of a resource to the parsers
   


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2701 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-03 11:05:48 +00:00
..
httpc.java *) plasmaHTCache: 2006-10-03 11:05:48 +00:00
httpChunkedInputStream.java * applied many compiler warning recommendations 2006-08-16 19:49:31 +00:00
httpChunkedOutputStream.java *) Adding X-Forwarded-For Header 2005-09-05 08:01:54 +00:00
httpContentLengthInputStream.java *) adding httpContentLengthInputStream.java class to allow reading of http response bodies 2006-09-18 10:00:28 +00:00
httpd.java *) Better handling of large files during parsing 2006-09-30 09:31:53 +00:00
httpdAbstractHandler.java minor changes 2005-08-03 02:02:39 +00:00
httpdBoundedSizeOutputStream.java *) better handling of maximum file size limit in crawler 2006-09-11 08:26:39 +00:00
httpdByteCountInputStream.java *) adding httpContentLengthInputStream.java class to allow reading of http response bodies 2006-09-18 10:00:28 +00:00
httpdByteCountOutputStream.java *) better handling of maximum file size limit in crawler 2006-09-11 08:26:39 +00:00
httpdFileHandler.java *) UTF-8 Bug solved (hopefully) 2006-09-13 14:48:58 +00:00
httpdHandler.java replaced indexing ram-queue by file-based stack-queue 2005-07-06 14:48:41 +00:00
httpdLimitExceededException.java added option to see ranking scores in surftipps 2006-09-30 23:28:03 +00:00
httpdProxyHandler.java *) plasmaHTCache: 2006-10-03 11:05:48 +00:00
httpdSwitchboard.java code cleanup 2005-12-06 23:51:29 +00:00
httpHeader.java - code cleanup 2006-09-29 22:27:20 +00:00
httpRemoteProxyConfig.java *) Disabling RemoteProxy if remoteProxyName is null or empty 2005-10-23 09:03:40 +00:00
httpTemplate.java first version of surftipps 2006-09-18 20:14:21 +00:00