Commit Graph

1273 Commits

Author SHA1 Message Date
orbiter
3e31820c3d - corrections to PerformanceMemory display of object cache
- configuration of object cache size in kelondroTree initializer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-10 09:08:42 +00:00
orbiter
fd7c17e624 added virtual host support:
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 13:11:00 +00:00
orbiter
461548698c configuration of index transfer chunk size
see http://www.yacy-forum.de/viewtopic.php?p=20951#20951
new properties in yacy.init:
indexDistribution.minChunkSize = 5
indexDistribution.maxChunkSize = 1000
indexDistribution.startChunkSize = 50

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2073 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 11:43:10 +00:00
orbiter
29b1b0823c added monitoring of new object cache to performanceMemory page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-09 10:03:12 +00:00
orbiter
23ced30e83 fixed a bug in new caching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2071 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 21:29:28 +00:00
low012
35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2070 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 14:23:22 +00:00
orbiter
bab9ee38e7 added very experimental object cache for all kelondroTree
databases. This cache now takes up 10% of all cache sizes,
90% goes to the node routing cache we had so far.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2069 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 13:37:27 +00:00
theli
9104001e7c *) Better error handling for assortment import
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2067 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-08 07:58:22 +00:00
low012
d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2066 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 22:53:17 +00:00
low012
adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2065 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 18:15:00 +00:00
hermens
51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2064 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-07 17:44:33 +00:00
low012
152745b145 *) Added some characters and their HTML-codes.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2060 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-06 00:23:29 +00:00
hermens
a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2059 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-05 13:17:00 +00:00
hermens
0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex
when deleting transferred indexes



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2058 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-05 12:48:17 +00:00
orbiter
fe4ad214f1 configuration of time-out for fetching seed-lists during bootstraping
(weil das beim linuxtag nur auf meinem Notebook nicht funtioniert)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2054 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-05-03 21:27:30 +00:00
allo
1179c9ffff fix for the bookmark error.
fixes: http://www.yacy-forum.de/viewtopic.php?t=2274

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2043 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-28 17:50:05 +00:00
orbiter
d6213f8a85 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2042 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-25 15:35:25 +00:00
orbiter
e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2041 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-25 15:21:17 +00:00
theli
727aac4768 *) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem
See: http://www.yacy-forum.de/viewtopic.php?p=20358

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2039 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-25 05:29:20 +00:00
theli
cd4aeffea2 *) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly
See: http://www.yacy-forum.de/viewtopic.php?t=2265

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2036 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-23 11:01:31 +00:00
theli
a10072b5c0 *) Adding timeout to ftpc.java
See: http://www.yacy-forum.de/viewtopic.php?t=2268
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2035 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-23 10:35:46 +00:00
theli
76ea16a6cb *) Removing Keep-Alive header (is also a hopByHop header)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2034 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-22 15:00:35 +00:00
orbiter
b0036249c1 added some attributes to network picture
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-21 21:21:35 +00:00
hermens
cbcf7418ef Cleanup synchronization in plasmaWordIndex
-  only synchronize when changing data in more than one database
see: http://www.yacy-forum.de/viewtopic.php?t=2167



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2031 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-20 14:00:47 +00:00
orbiter
60e5aff9fc some enhancements to the remote crawl trigger
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2030 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-20 11:53:15 +00:00
orbiter
dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-20 10:15:00 +00:00
rramthun
0604203bce Updated and corrected German language file
Changed Italian language file for an Italian/English interface and not Italian/German

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2024 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-18 11:37:03 +00:00
low012
4639c0ac6d *) cleaned up code
*) fixed a bug where a line like <pre><pre>text</pre></pre><pre>text</pre> caused an exception
*) fixed a bug where a line like [=[=text=]=][=text=] caused an exception


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2023 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-17 19:37:09 +00:00
orbiter
00a5d435e2 - fixed some bugs with domain filter
- added new ranking filter "prefermask": urls that match the filter are ranked better


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-13 23:19:36 +00:00
orbiter
14d6e476c9 tried to solve some problems with new picture viewer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-10 22:34:47 +00:00
low012
23cdf319be *) cleaning up code
*) fixed a bug concerning [= =] and <pre></pre> in tables


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2018 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-10 22:04:52 +00:00
orbiter
9324425165 fix for remote crawl reject
see http://www.yacy-forum.de/viewtopic.php?p=20075#20075

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2017 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-10 21:34:17 +00:00
borg-0300
30e4fc39a5 HTCache extended
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2015 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-08 13:05:04 +00:00
orbiter
d0dd8b14d2 fixed picture tag and presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-07 22:09:59 +00:00
borg-0300
da6a8bafa2 rename currCacheSize -> curCacheSize;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2010 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-07 13:15:15 +00:00
borg-0300
92110aea32 nullpointer fix for profile(); other minor change;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2009 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-07 12:43:59 +00:00
orbiter
f0833b0328 introduced simple search interface
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-06 21:48:24 +00:00
orbiter
bd283b8443 fixed bugs:
- null pointer exception during startup of a robinson-configured peer
- wrong time calculation of default value of re-crawl option

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-06 16:28:28 +00:00
orbiter
47b541b2d1 added better option handling in yacysearch
added depth option for image presentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-05 10:34:24 +00:00
orbiter
c9e16bfd48 first try to insert image search (does not work yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-04 23:12:10 +00:00
orbiter
f77775220b fixed parser error
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1999 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-04 22:28:46 +00:00
auron_x
0bf2eb4813 *) fixed Blog updating timestamp on edit (now always keeps creation-date)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-04 15:10:59 +00:00
orbiter
22de954a57 added some log output to parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1996 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-04 15:01:21 +00:00
orbiter
83e0e765ec redesigned some parts of the html scanner & parser
to better support image tags

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-04 14:36:01 +00:00
orbiter
ac114d69c0 tried to fix some problems with time-outs during search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1994 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-03 23:26:08 +00:00
orbiter
e2e8d0c188 some kind of refactoring of yacysearch:
made 'room' for new picture search result presentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-03 22:47:59 +00:00
orbiter
6b63e26cbb - removed search function from index.html/java, only imput left
- added media fetcher/crawler class (not ready yet)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-03 15:36:53 +00:00
orbiter
bc3e80fe42 quickfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1990 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-02 23:03:17 +00:00
orbiter
d8d0ac29c3 added image-viewer servlet that can do:
- each image that is requested is stored in the cache
- the image is taken from the cache if exists there
- the image can be scaled
The purpose of creation a scaled image is because of copyright problems
In a further stept the retrieval of not-shrinked images is restricted
to either access from localhost or with given authentication
This servlet can be used for image-preview purpose after an image search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-02 22:59:53 +00:00
orbiter
ddc6394d9b fixed bug about auto-depth 0
see http://www.yacy-forum.de/viewtopic.php?p=19751#19751

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1988 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-02 21:30:04 +00:00