Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,777 Commits 1 Branch 20 Tags 836 MiB
1af0e3bd84
Commit Graph

2420 Commits

Author SHA1 Message Date
orbiter
1af0e3bd84 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4031 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-06 00:56:56 +00:00
orbiter
5605887571 refactoring of search processes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4030 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-05 23:57:25 +00:00
orbiter
62347b50f4 added security layer for ViewImage: 
- images may be requested by localhost and authorized users only, if the request is done using a clear-text URL
- the image may be requested also using a code that can be a license to retrieve a URL for everyone
- some servelets produce URL licenses for ViewImage, like image search results


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4027 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 23:06:53 +00:00
orbiter
9a860cf397 bugfix for wrong record tracker message 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4026 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 12:24:52 +00:00
orbiter
69d640b041 added missing synchronization in crawl balancer 
to avoid that the synchronization is triggered during many-time-used size() operation
a notEmpty method was added that can avoid the synchronization many times

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4025 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 12:21:46 +00:00
orbiter
9628db6cdc enhanced memory allocation during database access: 
- refactoring of kelondroRecords; this class is now divided into
  kelondroAbstractRecords, kelondroRecords, kelondroCachedRecords, kelondroHandle and kelondroNode
- better abstraction of kelondroNodes, such nodes may now be crated by different classes
- a new Node defining class kelondroEcoRecords defines Nodes that do not need so much allocation and System.arraycopy
- there is less memory transfer on the bus, especially for collection index
- now half of memory needed for web index access


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 11:44:58 +00:00
orbiter
57a5b6fa71 some generalization of remote proxy configuration and setting handling in httpc 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4023 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-02 00:42:37 +00:00
orbiter
367fc28928 corrected Brausse->Brausze 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-01 22:15:51 +00:00
low012
ea05c7d463 *) characters are saved in ASCII-safe notation in language data files now ('\u0063' instead of 'a'), this hopefully avoids lots of problems 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 21:27:28 +00:00
orbiter
757703a938 synchronization of access tracker to avoid java-internal loop in TreeMap during shutdown 
see http://forum.yacy-websuche.de/viewtopic.php?p=1178#p1178

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:42:11 +00:00
orbiter
beb2e062a7 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=192&p=1129#p1129 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:17:39 +00:00
orbiter
e76fe1c078 - replaced unicode characters in copyright holder name ('Brausse') 
- more logging for bootstrap seedlist loading
- larger DHT chunks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:00:17 +00:00
orbiter
31023dbc7a added package declaration for language package 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 22:53:51 +00:00
low012
255e754257 *) Removed unnecessary condition (always true). 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4013 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 21:03:07 +00:00
low012
a42d233944 *) Filename for output file is created from language code + .ldf now (e.g. en-GB.ldf) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4012 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 21:00:42 +00:00
low012
ffc607d65d *) Fixed a small bug found by Lotus. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4011 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 13:03:10 +00:00
low012
33e2423bde *) Tool to find out the percentage of letters in a text. First step to build a tool which detects the language a text is written in. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-29 22:05:20 +00:00
orbiter
8d6aa7a66d replaced detailed search page by ranking definition page (this is what it essentially is) 
the ranking definition there will influence the normal web search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-25 14:04:36 +00:00
orbiter
7ff4357184 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=206&hilit=&p=1130#p1130 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4004 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 18:11:30 +00:00
orbiter
75d1437340 fix for http://forum.yacy-websuche.de/viewtopic.php?p=1123#p1123 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 13:39:53 +00:00
orbiter
9ca46a8c69 indexing of local (intranet) urls enabled 
To do this, one must create a separate YaCy network that has a local URL domain
A description how to do this is here: http://www.yacy-websuche.de/wiki/index.php/De:Netzdefinition

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4001 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 00:46:17 +00:00
orbiter
c48c9735cb bugfix for property table loader (did not exclude comment lines) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4000 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 13:38:17 +00:00
orbiter
6758beae9c fix for http://forum.yacy-websuche.de/viewtopic.php?p=1092#p1092 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 09:54:12 +00:00
orbiter
511dcbb172 fixed encoding bug made in SVN 3993 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3998 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 00:50:57 +00:00
orbiter
ec817a2ff5 removed JAR command from ftpc - produces warnings and is not used by YaCy 
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=193&hilit=

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-22 20:08:09 +00:00
orbiter
f5a4efb76e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=192&hilit=&p=1034#p1034 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3996 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-20 08:06:21 +00:00
orbiter
bf6f6820ec fix for another BMP parser problem. This is not a bug, I guess it was caused by a corrupted graphics file. 
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=180&hilit=&p=1017#p1017

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3995 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-19 22:11:48 +00:00
orbiter
40b0547611 - documentaton changes (removed old forum links) 
- different handling of link quotation
- different handling of link normalization
- enhanced html/unicode en/de-coding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3993 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-19 15:32:10 +00:00
orbiter
dcb8687904 fix to update cycle 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 22:45:29 +00:00
orbiter
cff019464e fix for BMP/ICO magic detection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 13:08:24 +00:00
orbiter
557f8d80e4 - better logging 
- fixed bugs in auto-update

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 13:03:20 +00:00
orbiter
f323e1813d added commons.logging again (is used by mimeTypeParser) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3989 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 11:47:19 +00:00
michitux
a695c93662 Fix of the Status-page for IE: 
- reverted revision 3982 and 3979
- added a real fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=163


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3988 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-17 22:06:06 +00:00
orbiter
b6d9cca67e - fixed problem with yacyVersion and own version generation 
- within this context: generalized date format handling
- extended Update interface:
 * a version lookup can be triggered manually
 * a complete lookup + download + re-boot process can be triggered with one click

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3986 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 23:47:21 +00:00
orbiter
b1630e73c8 addition to fix 3983 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3985 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 14:43:40 +00:00
orbiter
6071668c3b better error message in case that a mime type cannot be found. 
see also http://forum.yacy-websuche.de/viewtopic.php?f=6&t=132&p=587#p587

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3984 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 14:40:19 +00:00
orbiter
d477773fa3 fix for b/w color mode in BMP parserhttp://forum.yacy-websuche.de/viewtopic.php?f=6&t=180&hilit=&p=942#p942 
see also 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3983 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 14:27:37 +00:00
orbiter
e7a99d765e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=171 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3977 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 12:53:14 +00:00
orbiter
03847bebc1 removed unused libs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3971 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 10:34:39 +00:00
orbiter
9da0e53fe8 repaired rss feed reader 
- removed old rss parser
- removed unused rss parser libraries
- added new rss reader
- added previously removed FeedReader_p.java and adopted it to new rss parser
- adopted parser interface for rss indexing to new rss parser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3970 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 10:07:48 +00:00
orbiter
26ddf797eb added bmp and ico image format to all parser/viewing methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3969 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-15 12:55:41 +00:00
orbiter
5444b07674 fixed bug with decompression of index abstracts 
this fixes a problem that occurred when searching for several words

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3968 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-15 12:39:16 +00:00
orbiter
924ae39170 replaced old map loading method with new implementation which is more robust against change of line termination methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3967 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-15 11:45:41 +00:00
orbiter
ac7b6b9c10 added a default favicon for search results from domains that do not have a favicon 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3966 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-15 01:37:43 +00:00
orbiter
89e1848db6 fixed problem with favicons: 
target servers had been able to see search words from the referrer of the favicon fetch.
This has been removed by using the getImage - servlet for favicon fetch.
Since java does not support loading of bmp and ico-Images, such parsers had been added.
The image parser had been coded from their original microsoft documentation.
This influences also the image-search functionality: there can now be a preview
of found bmp-images. Another benefit: favicons for search results are now cached with the HTCACHE.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3965 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-15 01:34:01 +00:00
low012
d95a06e2e4 *) cosmetics: fixed a typo 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3964 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-14 12:49:11 +00:00
orbiter
7c5c814a47 - simplified code (removed exception handling where not necessary) 
- added confirmation dialog for shutdown and restart

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3962 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-13 14:54:01 +00:00
orbiter
a4e8ad95ab enhancements to news and switchboard queue processing 
removed direct access and replaced by iteration

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-13 13:00:18 +00:00
orbiter
a45216b479 fix to prevent bad-formed news messages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-13 09:41:55 +00:00
orbiter
bec4dbc753 added options and execution methods for automated updates 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-12 16:23:33 +00:00