Commit Graph

3816 Commits

Author SHA1 Message Date
orbiter
5009695537 fix for double-entries of crawl tasks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3920 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-25 14:16:32 +00:00
orbiter
0e57a8062b added network definition for different YaCy networks
(needs much more work)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3919 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-22 14:29:14 +00:00
auron_x
1d41ebf489 *) made age for deletion of too old seeds configurable
*) changed naming-scheme of seed-deletion-properties

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3918 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-22 10:42:29 +00:00
auron_x
52cb3208d0 *) old (lastseen > 7d) peers are now automatically removed from passive and potential seed-dbs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3917 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-22 09:16:25 +00:00
rramthun
4c7644b713 *) Updater update to r4 with first changes toward new naming scheme. For the moment consider only pro-->pro upgrades as stable.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3915 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-18 19:56:07 +00:00
orbiter
5135fefcef - release 0.53
- documentation update
- set default search time back to 6 seconds

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3914 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-18 13:04:32 +00:00
orbiter
815e3da62f fix for http://www.yacy-forum.de/viewtopic.php?p=37353#37353
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3913 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-18 11:34:30 +00:00
daburna
ca83ec8a7b #update for German translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3912 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-18 09:06:31 +00:00
orbiter
1d0cce8f3a documentation update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3911 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 22:35:16 +00:00
low012
93a898f1f0 *) skripts are compatible with Sun Solaris 10 now, OpenSolaris has not been tested yet (http://www.yacy-forum.de/viewtopic.php?p=37345#37345)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3910 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 21:19:00 +00:00
michitux
25529290ca - 2 small changes in documentation
- hopefully fixed logging of GCs (in order to avoid things like "performed necessary GC, freed 18014398509481565 KB (requested/available/average: 4096 / 1631 / 2957 KB)") with the help of KoH


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3909 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 19:32:38 +00:00
low012
c59a7ce5c2 *) hopefully fixed a stupid bug (my fault of course) that sometimes messed up the marking of search words in the snippets (see http://www.yacy-forum.de/viewtopic.php?p=37329#37329)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3908 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 16:29:04 +00:00
orbiter
2c70228f5f bugfix for display problem in index administration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3907 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 16:12:33 +00:00
orbiter
c6ee6f88aa fix for display error in Safari:
safari is obviously sensitive against spaces in 'x --'; 'x--' worked.
see http://www.yacy-forum.de/viewtopic.php?p=37306#37306

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3906 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 15:52:25 +00:00
daburna
43053d125c #next update for German translation
- still not finished yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3905 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 13:25:05 +00:00
michitux
184ba22ce9 New image - search HTML/JavaScript - frontend:
- <noscript> - area for non-JS - Browsers
- progressbar for the loading - process (may be used in other searches too)
- the image that is available first ist displayed first, so the images aren't moved around when new results arrive
- the correct number of results is displayed
- successfully tested in IE 5.5 and 6, Opera, Firefox and Konqueror (recent versions)



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3904 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-16 21:55:15 +00:00
orbiter
4ea8ccb71e fix for http://www.yacy-forum.de/viewtopic.php?p=37300#37300
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3903 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-16 21:23:04 +00:00
orbiter
6518bb6c08 changed release strategy:
we will provide two different releases in the future, one standard release and one 'pro'-release.
the 'pro'-release contains all additional parsers AND has different default performance values.
The pro-version differs therefore from the previous 'all'-version by this default values.
The pro-configuration is automatically choosen if the libx-folder exists. If a version is once initialized, its configuration stays independently from an existing libx folder.
The ant targets had been changed. There are now 3 different targets to create standard and pro-releases, and one target to upgrade:
- dist: creates a standard release (only, no libx target any more)
- distPro: creates a pro-release (includes the libx)
- distExt: creates a libx-release which includes the libx-folder only. It may be used to upgrade from standard to pro
Furthermore, the naming of 'dev'-releases had been removed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3902 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-16 14:11:52 +00:00
daburna
d8ab7a4710 #some updates for German translation
- not ready yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3901 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-16 13:21:53 +00:00
orbiter
069562a14d fixed problem with re-crawl; replaced error file-db with ram-db
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3900 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-15 23:47:08 +00:00
orbiter
c7a614830a several bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3899 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-15 17:45:49 +00:00
allo
465145cb6f revert to insecure, but dau-proof defaults
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3898 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-15 12:56:52 +00:00
allo
7ad11ceaaa security fix for peers without password. allow access only from localhost
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-15 00:03:44 +00:00
orbiter
104669bd48 fix for http://www.yacy-forum.de/viewtopic.php?p=37177#37177
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3896 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 22:35:47 +00:00
(no author)
2784820ee3 *) moving sleep to a better place
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3895 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 16:53:22 +00:00
theli
7a1b811d18 *) bugfix for SocketException:
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 15:58:10 +00:00
orbiter
71fd972ac0 - reduced default search time
- catched case when web structure cannot be painted because of too less data
- better logging when balance fails


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 15:21:01 +00:00
orbiter
506a5a44de added supporter page; personal home pages are removed from the surftips, they appear now separately on the supporter page, but only if the peer is also online
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3891 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 12:57:55 +00:00
orbiter
2b937abef1 slighlty different behavior in shutdown sequence for http server threads:
- first close streams
- make pause (that one that was made in httpdFileHandler)
- close sockets

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3890 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 11:58:20 +00:00
orbiter
e4aa8f2a08 disabled more sleep(200)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3889 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 11:02:28 +00:00
orbiter
cb38e57622 reduced httpd final waiting time
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3888 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 10:28:37 +00:00
orbiter
b4585ad67d im Sommer 2005 wurden die ersten pings zwischen YaCy-Peers ausgetauscht.
Das klappte aber merkwürdigerweise nicht immer. Um das Protokoll zu testen schrieb ich eine einfache message-Funktion, so wie sie heute noch in YaCy drin ist.
Aber auch die Messages funktionierten nicht richtig. Alex und ich haben lange Zeit gesucht, und den Fehler nie gefunden. Es stellte sich heraus das ein Timing-Detail das Problem lösen konnte, die Ursache haben wir bis heute nicht gefunden.
Die Lösung des Problems bestand aus einem kurzen sleep, kurz bevor der httpd Daten zum client zurück geschrieben hat. Das ist natürlich eine fürchterlich schlechte Lösung.
Bis heute war diese Sache im httpd. Mit diesem Commit habe ich den sleep auskommentiert, und es steht zu befürchten das wieder irgendwas nicht geht.
Wenn jetzt das Netz zusammenbricht, keine pings mehr ankommen oder so, war es dieses sleep, das es verhinderte.
Vorschläge willkommen.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3887 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 08:18:10 +00:00
orbiter
07b4e5066b bugfix in messages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3886 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-14 08:08:35 +00:00
orbiter
f64d9f1c6c removed forced termination in case that a previous bad termination is detected
this will cause many users to be unsure what to do next an leave them helpless
to simply delete the control file is the same thinig that the user is othervise forced to do

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 20:55:48 +00:00
orbiter
3c19fcf519 harmonisation of servlet naming, headlines and menu entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3884 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 20:53:52 +00:00
michitux
4f1f280abd Fixed Status - page for IE (http://www.yacy-forum.de/viewtopic.php?t=4113), added new Stylesheets in conditional comments for different IE - versions, added hiding of favicons (as proposed by allo).
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 20:27:51 +00:00
karlchenofhell
e1d809d5f1 - more detailed logging of MEMORY messages
- forced GCs don't contribute to heuristics anymore

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 15:03:56 +00:00
orbiter
f04add6cb4 limitation of remote search result number
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3880 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 13:47:58 +00:00
orbiter
9f7765863b bugfix for seed length control routine
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3879 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 13:21:19 +00:00
orbiter
0b10ef64ba better server access tracking
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3878 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-13 13:05:51 +00:00
orbiter
4f5496062c protection against too large seeds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3877 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 22:08:33 +00:00
orbiter
684ded0e09 added new news types
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3876 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 15:15:24 +00:00
karlchenofhell
669f840eab - added ViewProfile / Impressum (default on) to local peer's robots.txt
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3874 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 13:48:27 +00:00
orbiter
9470090f08 added description text to web structure picture
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3873 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 11:34:59 +00:00
orbiter
45c6bdac1e fix for http://www.yacy-forum.de/viewtopic.php?p=36880#36880
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3872 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 10:36:28 +00:00
auron_x
3860987c84 *) some code-cleanup
*) link-/wordcount on statuspage is now displayed with thousands separator

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3871 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 09:10:32 +00:00
orbiter
d7de0938a6 fix for http://www.yacy-forum.de/viewtopic.php?p=36587#36587
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3870 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-12 08:47:34 +00:00
karlchenofhell
b4bb48132a - fixed -UNRESOLVED_PATTERN- in ViewFile for Link List
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3869 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-11 23:54:59 +00:00
karlchenofhell
22ee85ca02 - specified exceptions thrown by ResourceInfoFactory and plasmaHTCache.loadResourceInfo()
- caught possible NPE in CacheAdmin_p and added more error-cases
- speeded up deletion of entries in the local crawl queue by crawl profile (it has been noted often that this deletion is slow)
- added a bit javadoc

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3868 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-11 23:33:24 +00:00
orbiter
dfd5e823c3 automatic limitation of web structure host count
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3867 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-11 22:08:10 +00:00