yacy_search_server/source/net/yacy/document/parser/html
orbiter 0c1b29f3c9 - applied many small performance hacks
- added a memory limitation in the zip parser and the pdf parser
- added a search throttling: if there are too many search queries are still to be computed, then new requests are not accepted for some time. if after a one second still no space is there to perform another search, the search terminates with no results. this case should only happen in case of DoS-like situations and in case of strong load on a peer like if it is integrated in metager.
- added a search cache deletion process that removes search requests in case that throttling happens

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7766 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-06-01 19:31:56 +00:00
..
AbstractScraper.java *) cleaning up the code a little bit 2010-12-27 17:07:21 +00:00
AbstractTransformer.java removed finalize methods because of a hint in 2010-04-23 09:32:29 +00:00
CharacterCoding.java performance hacks for better search performance 2010-10-08 23:50:28 +00:00
ContentScraper.java - applied many small performance hacks 2011-06-01 19:31:56 +00:00
ContentTransformer.java hack to reduce resource contention caused by massive UTF8 decodings which use java.nio resources: 2011-05-27 08:24:54 +00:00
Evaluation.java - applied many small performance hacks 2011-06-01 19:31:56 +00:00
ImageEntry.java added more attributes for html parser and enhanced data structures 2011-04-28 13:09:01 +00:00
Scraper.java added more attributes for html parser and enhanced data structures 2011-04-28 13:09:01 +00:00
ScraperInputStream.java - added new protocol loader for 'file'-type URLs 2010-05-25 12:54:57 +00:00
ScraperListener.java
Transformer.java
TransformerWriter.java - applied many small performance hacks 2011-06-01 19:31:56 +00:00