theli
e569a84dc0
*) Using the same configuration settings for all indexing threads on server Startup
...
See: http://www.yacy-forum.de/viewtopic.php?p=8349
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@584 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-24 09:34:04 +00:00
theli
17be77a468
*) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
...
See: http://www.yacy-forum.de/viewtopic.php?t=965&highlight=ramdisk
*) Making ACCEPT_LANGUAGE configureable for crawler
See: http://www.yacy-forum.de/viewtopic.php?p=8327
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@583 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-24 07:47:42 +00:00
theli
5f55dff297
*) Bugfix for "Binäre Nullen auf der page: Index Creation: Indexing Queue"
...
See: http://www.yacy-forum.de/viewtopic.php?p=6877#6877
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@577 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-23 08:37:42 +00:00
allo
eb6365c069
local Bootstrapping bug.
...
use yacyDebugMode=true to allow local bootstrapping
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@572 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-22 12:13:19 +00:00
theli
330eae7cf3
*) Normalizing CrawlerStartURL now before crawling is started
...
*) CrawlWorker also does a URL normalization now before following the redirection URL
*) CrawlWorker removes redirection URL correctly from noticeURL stack now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@571 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-21 22:52:46 +00:00
theli
ab894d26bc
*) Bugfix for "plasmaSwitchboard.deQueue: null" Bug (hopefully)
...
See: http://www.yacy-forum.de/viewtopic.php?p=8135#8135
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@570 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-21 22:48:37 +00:00
theli
eaf9f26cc3
*) Bugfix for NULL PROFILE HANDLE 'null' Bug:
...
See: http://www.yacy-forum.de/viewtopic.php?p=7855#7855
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@569 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-21 22:16:19 +00:00
rramthun
4cb382decb
Adding changes by borg-0300 from http://www.yacy-forum.de/viewtopic.php?t=997
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@565 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-20 17:05:01 +00:00
theli
ec4c70d722
*) If there are at most 10 entries left while doing an index transfer, these entries will also be appended
...
to the index list
|> D 2005/08/18 10:00:02 PLASMA Selected partial index (33 from 37 URLs, 0 not bound) for word fSuQM0xAJK1G
See: http://www.yacy-forum.de/viewtopic.php?t=970
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@556 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-18 10:04:45 +00:00
theli
d4a045d7b1
*) Trying to solve "de.anomic.plasma.plasmaSwitchboard.deQueue': null" Bug
...
See: http://www.yacy-forum.de/viewtopic.php?p=7791
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@555 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-18 06:40:26 +00:00
theli
ea9a992f05
*) Before the crawler retries to download a URL it checks if the server is already doing a shutdown
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@554 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-17 11:36:48 +00:00
theli
ea26b84eed
*) Bugfix for http://www.yacy-forum.de/viewtopic.php?t=954
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@553 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-17 10:12:52 +00:00
theli
0c8a48e2cb
*) converting php Session ID to lower case in funktion isCGI
...
See: http://www.yacy-forum.de/viewtopic.php?p=7671#7671
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@552 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-17 05:50:18 +00:00
orbiter
e616395c3b
latest changes and cut for 0.40
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@548 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-16 15:15:19 +00:00
orbiter
c47bb1182d
bugfix for assortment initialization error
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-16 11:43:14 +00:00
theli
4654eae4e2
*) adding php Session ID to argument in funktion isCGI
...
See: http://www.yacy-forum.de/viewtopic.php?p=7671#7671
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-16 11:33:31 +00:00
orbiter
25f632dbd9
more DHT bugfixes and better logging of DHT effects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@542 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-16 00:31:15 +00:00
orbiter
5cb00889d9
enhancements to dht selection, search and search presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@540 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-15 01:12:25 +00:00
orbiter
ba0a486328
moved printStackTrace() to logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@539 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-14 23:35:18 +00:00
orbiter
3094045d34
fix for http://www.yacy-forum.de/viewtopic.php?p=7454#7454
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@536 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-14 16:16:11 +00:00
orbiter
cd10370992
several bugfixes and dht selection / logging improvement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@531 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-14 00:57:30 +00:00
orbiter
3610fe6b3a
see http://www.yacy-forum.de/viewtopic.php?p=7410#7410
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@530 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-13 22:04:18 +00:00
orbiter
c8a7a85ce2
fix for http://www.yacy-forum.de/viewtopic.php?p=7384#7384
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@529 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-13 21:41:22 +00:00
orbiter
6594541ef5
fix for http://www.yacy-forum.de/viewtopic.php?p=7361#7361
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@526 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-12 22:53:49 +00:00
orbiter
7db543a9fa
fixes for several dht misbehaviours
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@524 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-12 22:14:24 +00:00
orbiter
5716f8521d
bug fixes for word ordering and dht index selection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@521 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-12 14:06:47 +00:00
orbiter
f5259f29e8
word cache behaviour fix and other fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@519 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-11 23:33:19 +00:00
orbiter
2c234e1b82
better log output for search result
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@512 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-10 09:52:50 +00:00
theli
89c9faa89e
*) More graceful logging output in crawler
...
See: http://www.yacy-forum.de/viewtopic.php?t=894
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@511 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-10 06:15:47 +00:00
orbiter
248c24b60a
intermission-feature usage in case of local and remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@510 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-09 20:43:37 +00:00
theli
b32e7c516c
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@507 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-09 09:07:19 +00:00
theli
86305f051d
*) Trying to solve "java.net.BindException: Address already in use: JVM_Bind" Problem
...
by retrying Socket bind
See: http://www.yacy-forum.de/viewtopic.php?p=6935
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@497 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-06 14:38:58 +00:00
theli
865b9490a2
*) Making DHT Transfer while Crawling configurable
...
See: http://www.yacy-forum.de/viewtopic.php?p=6904
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@496 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-06 11:40:12 +00:00
theli
1d83d7e4d7
*) httpdFileHandler.java:
...
no stacktrace will be printed into log file for "Connection timed out" Errors now
See: http://www.yacy-forum.de/viewtopic.php?p=6381
*) plasmaCrawlWorker.java:
If a "Read timed out" error occurs while crawling a site, the failed crawl will be
retried.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@493 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-04 11:05:04 +00:00
orbiter
2d8557cb10
minor changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@487 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-03 02:02:39 +00:00
orbiter
91163db52e
fix for more time-related problems in proxy
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@486 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-03 00:52:32 +00:00
orbiter
fb6f238d70
fix for expires-problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@485 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-03 00:28:12 +00:00
rramthun
eacff63eda
Typos...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@482 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 16:09:19 +00:00
orbiter
40da910f41
bugfixes and automatic news-cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@481 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 16:03:35 +00:00
theli
228b04b499
*) Bugfix for "wrong seed-upload timestamp" problem
...
http://www.yacy-forum.de/viewtopic.php?t=817
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@480 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 15:36:10 +00:00
theli
470839a16a
*) Crawler/Session pool settings will now be stored properly into configfile
...
Bugfix for:
- http://www.yacy-forum.de/viewtopic.php?t=502
- http://www.yacy-forum.de/viewtopic.php?t=778
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@477 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 12:20:03 +00:00
orbiter
4377e119f3
bugfix for http://www.yacy-forum.de/viewtopic.php?p=6620#6620
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@476 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 10:41:59 +00:00
orbiter
e84a177c49
many bigfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@475 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-02 02:18:01 +00:00
orbiter
7e3e9ba0de
fix for http://www.yacy-forum.de/viewtopic.php?p=6563#6563
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@472 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-08-01 20:36:27 +00:00
orbiter
1022fbeb65
many YaCyNews fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@461 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-31 01:54:46 +00:00
orbiter
13abd8b6e7
added news-creation at crawl start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@460 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-30 11:57:19 +00:00
rramthun
f555b9d5f2
Translation, spelling...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@459 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-30 11:11:32 +00:00
orbiter
cdbbfd50fb
fixed bad remote crawl behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@453 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-29 06:50:36 +00:00
orbiter
36707586c7
filtering of jsessionid
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@447 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-27 23:20:17 +00:00
rramthun
6f2f54a312
Translation, spelling...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@444 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-27 20:29:35 +00:00