Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
586 Commits 1 Branch 20 Tags 836 MiB
f19c09b227
Commit Graph

368 Commits

Author SHA1 Message Date
theli
f19c09b227 *) Suppress stacktrace on crawler error for "MalformedURLException" 
See: http://www.yacy-forum.de/viewtopic.php?p=8733#8733

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@613 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 20:25:07 +00:00
theli
cc1df08069 *) Adding missing synchronized blocks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@608 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 14:57:32 +00:00
theli
0dfa8b62e2 *) Changing Proxy-Useragent string according to thread http://www.yacy-forum.de/viewtopic.php?p=8183#8183 
A typical useragent string now e.g. looks like: 
   Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.10; YaCy 0.401/00602; yacy.net) Gecko/20050716 Firefox/1.0.6

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@607 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 13:41:47 +00:00
borg-0300
bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing' 
- path now are absolute
*) move path check from plasmaHTCache to plasmaSwitchboard
   - only one path check when starting
*) small other

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@606 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 12:50:30 +00:00
theli
3dfda1c9da *) More verbose output on ftp-seed-upload failure 
See: http://www.yacy-forum.de/viewtopic.php?p=8000#8000

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@605 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 12:18:41 +00:00
theli
e3aa3a2d75 *) Bugfix for ProxyAccess Logger 
URL was accidentally logged without the parameters  

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@604 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 11:37:54 +00:00
theli
9b818b1ce3 *) Pausing Crawlers if there is not enough space on disk 
See: http://www.yacy-forum.de/viewtopic.php?p=8648

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@603 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 09:43:27 +00:00
theli
b33094e925 *) Trying to solve "Too many open files bug" 
*) Temp.Bugfix for "Bug in Index Restore"
   See: http://www.yacy-forum.de/viewtopic.php?p=8647#8647
   Orbiter: Please take a look



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@602 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 09:07:42 +00:00
theli
b67f008eb8 *) Trying to solve "Too many open files bug" 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@601 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 06:45:49 +00:00
theli
34790acf02 *) Bugfix for suppressing of stacktrace in log on crawler error "unknown host" 
See: http://www.yacy-forum.de/viewtopic.php?p=8615#8615

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@600 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 06:24:23 +00:00
theli
a812fb86cc *) Port Forwarding Feature does not detect broken connection properly. 
Therefor a test-request was added to the isConnected function to detect broken connections
   and to keep open connections alive


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@596 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 11:39:10 +00:00
theli
af7b8f75bd *) Making proxyAccessLogging configureable via yacy.logging file 
- logging can be disabled now
   - logging directory / filelimit / rotation count can be configured now
   See: http://www.yacy-forum.de/viewtopic.php?t=965&postdays=0&postorder=asc&start=30#8280

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@595 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 11:31:58 +00:00
theli
8132a44305 *) Better error handling if yacy SOAP extension is not installed 
See: http://www.yacy-forum.de/viewtopic.php?t=1040

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@594 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 08:24:07 +00:00
allo
66ebce1109 use staticIP more often 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@592 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-28 16:55:52 +00:00
theli
2a081c9ee5 *) Adding additional logging message for "NURL.entry() == null" Bug 
See: http://www.yacy-forum.de/viewtopic.php?p=8446

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@591 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-28 05:39:26 +00:00
theli
cb1f11c96b *) Suppress stacktrace on crawler error for "Unknown Host" 
See: http://www.yacy-forum.de/viewtopic.php?p=8431

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@590 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-28 05:08:26 +00:00
theli
e338a13de3 *) Suppress stacktrace on crawler error for "Read timed out" 
See: http://www.yacy-forum.de/viewtopic.php?p=8433

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@589 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-27 18:48:02 +00:00
theli
2e43e744de *) Suppress stacktrace on crawler error for "connect timed out" 
See: http://www.yacy-forum.de/viewtopic.php?p=8420 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@588 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-27 04:53:25 +00:00
theli
36cbe04e3e *) Bugfix for Crawler Redirection Bug 
See: http://www.yacy-forum.de/viewtopic.php?p=8422

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@587 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-27 04:36:13 +00:00
theli
b70de495a0 *) Remembering Crawler-isPaused setting 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@586 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-25 09:51:24 +00:00
theli
e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup 
See: http://www.yacy-forum.de/viewtopic.php?p=8349

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@584 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-24 09:34:04 +00:00
theli
17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed" 
See: http://www.yacy-forum.de/viewtopic.php?t=965&highlight=ramdisk
*) Making ACCEPT_LANGUAGE configureable for crawler
   See: http://www.yacy-forum.de/viewtopic.php?p=8327

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@583 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-24 07:47:42 +00:00
theli
858cb983d7 *) Printout date and system name on proxy error page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@581 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 11:32:36 +00:00
theli
4a2f06053f *) Bugfix for "Gehäuselautsprecher" Bug 
If de.anomic.server.logging.ConsoleOutErrHandler.ignoreCtrlChr is set to true all control chars except 
   space,tab,newline, are replaced with spaces
   See: http://www.yacy-forum.de/viewtopic.php?p=5528

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@579 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 10:48:24 +00:00
theli
dc7c5237fb *) Bugfix for "Gehäuselautsprecher" Bug 
If de.anomic.server.logging.ConsoleOutErrHandler.ignoreCtrlChr is set to true all control chars except 
   space,tab,newline, are replaced with spaces
   See: http://www.yacy-forum.de/viewtopic.php?p=5528

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@578 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 10:45:44 +00:00
theli
5f55dff297 *) Bugfix for "Binäre Nullen auf der page: Index Creation: Indexing Queue" 
See: http://www.yacy-forum.de/viewtopic.php?p=6877#6877

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@577 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 08:37:42 +00:00
theli
cb97d2972e *) Bugfix for "peer not accessible via .yacy name if Transparent Proxy Support is enabled" bug 
See: per Browser nicht erreichbare Peers

*) Proxy Error Page now displays the Peer Name on top

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@575 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 07:27:58 +00:00
allo
60074b4301 more DebugMode(60 Secs Timeout) 
needed for Yacy with tor.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@573 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-22 14:02:34 +00:00
allo
eb6365c069 local Bootstrapping bug. 
use yacyDebugMode=true to allow local bootstrapping


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@572 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-22 12:13:19 +00:00
theli
330eae7cf3 *) Normalizing CrawlerStartURL now before crawling is started 
*) CrawlWorker also does a URL normalization now before following the redirection URL
*) CrawlWorker removes redirection URL correctly from noticeURL stack now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@571 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-21 22:52:46 +00:00
theli
ab894d26bc *) Bugfix for "plasmaSwitchboard.deQueue: null" Bug (hopefully) 
See: http://www.yacy-forum.de/viewtopic.php?p=8135#8135

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@570 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-21 22:48:37 +00:00
theli
eaf9f26cc3 *) Bugfix for NULL PROFILE HANDLE 'null' Bug: 
See: http://www.yacy-forum.de/viewtopic.php?p=7855#7855

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@569 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-21 22:16:19 +00:00
rramthun
0864ea367d Added preformated changelog.txt 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@567 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-21 10:38:22 +00:00
allo
41aa3ae72e provide a virtuell Headerfield IS_ADMIN. 
This allows Serverlets to check Admin Status.
http://www.yacy-forum.de/viewtopic.php?t=1003


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@566 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-20 21:22:05 +00:00
rramthun
4cb382decb Adding changes by borg-0300 from http://www.yacy-forum.de/viewtopic.php?t=997 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@565 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-20 17:05:01 +00:00
low012
ecfdc4928a *) better implementation of definition lists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@564 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-20 12:57:31 +00:00
rramthun
26289e955c Updates of the language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@563 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-20 12:09:27 +00:00
theli
0d0bc02f38 *) Printing stacktrace into log on seed-upload error 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@562 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 22:59:33 +00:00
theli
115c4edfcc *) Adding additional logging statements to help debugging seed-upload problems 
See: http://www.yacy-forum.de/viewtopic.php?t=975&highlight= 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@561 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 09:32:30 +00:00
theli
751a778b54 *) Bugfix for heise newsletter Problem 
See: http://www.yacy-forum.de/viewtopic.php?p=7836#7836

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@560 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 08:28:43 +00:00
theli
7d8af6b41a *) Bugfix for heise newsletter Problem 
See: http://www.yacy-forum.de/viewtopic.php?p=7836#7836

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@559 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 08:23:12 +00:00
theli
4335bfe822 *) Using timeout also to establish a connection 
See: http://www.yacy-forum.de/viewtopic.php?t=979&highlight=

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@558 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 06:47:34 +00:00
low012
36dfb9f686 implemented citings (blockquote) and an early version of definitions (not much of a list yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@557 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 01:38:14 +00:00
theli
ec4c70d722 *) If there are at most 10 entries left while doing an index transfer, these entries will also be appended 
to the index list
   |> D 2005/08/18 10:00:02 PLASMA Selected partial index (33 from 37 URLs, 0 not bound) for word fSuQM0xAJK1G
   See: http://www.yacy-forum.de/viewtopic.php?t=970

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@556 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-18 10:04:45 +00:00
theli
d4a045d7b1 *) Trying to solve "de.anomic.plasma.plasmaSwitchboard.deQueue': null" Bug 
See: http://www.yacy-forum.de/viewtopic.php?p=7791

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@555 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-18 06:40:26 +00:00
theli
ea9a992f05 *) Before the crawler retries to download a URL it checks if the server is already doing a shutdown 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@554 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-17 11:36:48 +00:00
theli
ea26b84eed *) Bugfix for http://www.yacy-forum.de/viewtopic.php?t=954 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@553 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-17 10:12:52 +00:00
theli
0c8a48e2cb *) converting php Session ID to lower case in funktion isCGI 
See: http://www.yacy-forum.de/viewtopic.php?p=7671#7671

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@552 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-17 05:50:18 +00:00
orbiter
e616395c3b latest changes and cut for 0.40 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@548 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 15:15:19 +00:00
orbiter
c47bb1182d bugfix for assortment initialization error 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@547 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 11:43:14 +00:00