Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
651 Commits 1 Branch 20 Tags 836 MiB
e6338b4390
Commit Graph

423 Commits

Author SHA1 Message Date
orbiter
4377e119f3 bugfix for http://www.yacy-forum.de/viewtopic.php?p=6620#6620 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@476 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 10:41:59 +00:00
orbiter
e84a177c49 many bigfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 02:18:01 +00:00
orbiter
9ee8a5ba6c fixed big in yacynews 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 00:50:20 +00:00
orbiter
7e3e9ba0de fix for http://www.yacy-forum.de/viewtopic.php?p=6563#6563 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 20:36:27 +00:00
orbiter
bcc292ad12 added self-news; added news in case of wiki update; added crawl announcement on Network page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@469 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 12:47:47 +00:00
orbiter
cc38c5e77b bugfix for wiki key-length 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 10:56:40 +00:00
orbiter
d34eb23e4e fixed news; added news appearance on Network and IndexCreate page; added intention string to global crawl 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@466 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 01:12:02 +00:00
orbiter
5672709ef3 several bugfixes for YaCyNews 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 14:59:31 +00:00
allo
2013d031e5 better Logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 12:07:34 +00:00
orbiter
e24dbde217 better logging for WRONG seed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@463 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 11:11:29 +00:00
orbiter
1022fbeb65 many YaCyNews fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@461 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 01:54:46 +00:00
orbiter
13abd8b6e7 added news-creation at crawl start 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 11:57:19 +00:00
rramthun
f555b9d5f2 Translation, spelling... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 11:11:32 +00:00
orbiter
849b194149 fixed news receipt and added processing buttons on News page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@458 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 07:15:39 +00:00
orbiter
84b74d40f3 yacyNews bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@457 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 15:29:06 +00:00
orbiter
60117a2073 integrated YaCyNews basis 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@455 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 14:10:19 +00:00
orbiter
b8e294f149 corrected wrong default peer-names 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@454 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 08:48:36 +00:00
orbiter
cdbbfd50fb fixed bad remote crawl behavior 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@453 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 06:50:36 +00:00
orbiter
f32d8bdfa8 fixed DHT cache memory assignment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@452 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-28 18:22:02 +00:00
orbiter
f663f26cfd catch of another IOException 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@451 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-28 17:03:13 +00:00
orbiter
36707586c7 filtering of jsessionid 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@447 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 23:20:17 +00:00
rramthun
6f2f54a312 Translation, spelling... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@444 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 20:29:35 +00:00
allo
0a68aa6999 translate the last file, too 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@443 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 19:03:52 +00:00
orbiter
81e564edb8 faster crawl profile list cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@442 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 14:16:47 +00:00
orbiter
85877413a0 tried to fix principal bug .. not succeeded 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@440 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 13:38:46 +00:00
orbiter
ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 12:51:00 +00:00
orbiter
b9d18d40cb configuration of proxy idle time in performance menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@436 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 15:17:29 +00:00
orbiter
3470a72d48 fixed div by zero, set default delays, fixed release number format and display 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@435 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 11:47:50 +00:00
rramthun
bf7d5d1310 Usage of logging-class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@432 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-25 14:46:36 +00:00
orbiter
af67c633d5 doc-changes and more strict brute-force handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@431 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-25 09:56:54 +00:00
rramthun
fe62a38896 minor fixes to the translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@429 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-24 15:32:27 +00:00
orbiter
be1f324fca performance setting for remote indexing configuration and latest changes for 0.39 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@424 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-22 13:56:19 +00:00
rramthun
69afae514d Updated translations... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@422 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-21 15:42:06 +00:00
orbiter
c64970fa47 re-implemented proxy-busy-check and fixed some other things 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@421 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-21 11:17:04 +00:00
allo
98d22a73ef "File: foo.html" 
and
"File:bar.html"
support


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@420 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 21:23:21 +00:00
orbiter
86d778f7bc default-button in profile menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@419 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 17:08:58 +00:00
orbiter
b73557ed2d better assortment monitoring and enhanced profile menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@416 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 13:03:41 +00:00
orbiter
1f36bf4dae enhanced assortment capacity; added extended WORDS migration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@412 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 00:39:06 +00:00
allo
e6c381a2e2 Translationfile Division for different files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@411 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 21:19:12 +00:00
rramthun
0f11399d16 Some corrections... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@409 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 16:07:13 +00:00
orbiter
9f505af7aa preparations for bulk remote crawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@408 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 00:26:31 +00:00
orbiter
0f663bcebf added global ppm computation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@407 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-18 15:22:14 +00:00
orbiter
9c72b4cdec replaced index dump stack by an dump array and limited url number in assortment ram (prevents too much RAM occupation) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@406 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-18 13:32:44 +00:00
orbiter
51962d55bf added 'PPM', page-per-minute statistics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@405 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-18 00:44:51 +00:00
orbiter
159f795f65 bugfix (null pointer exception in assortments) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@404 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-17 22:25:50 +00:00
orbiter
1d2155675b changed assortment memory cache flush 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@403 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-17 21:22:18 +00:00
orbiter
19dbed7cc8 code clean-up 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@401 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 15:09:35 +00:00
orbiter
00f63ea00d fail-save patch for pattern matching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@400 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 00:31:35 +00:00
orbiter
0a6be961ea added pattern organization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@399 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 00:21:46 +00:00
orbiter
40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 00:07:09 +00:00
orbiter
311e627363 blocking of blacklisted urls in indexReceive and small changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-11 15:36:10 +00:00
orbiter
2f0d7ea8d3 removed htcache stati (superfluous now) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@396 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-09 00:33:34 +00:00
orbiter
277048501e bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@395 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-08 16:24:07 +00:00
orbiter
8b89c46afe fixed problem with cache write 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@394 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-08 16:06:35 +00:00
orbiter
455ae9f55f fixed htcache-store problem and due-time for remote crawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@393 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-08 15:17:50 +00:00
theli
55d10b864c *) further improvements in shutdown behaviour 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@392 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 22:03:52 +00:00
theli
96386d6fc6 *) further improvements in shutdown behaviour 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@391 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 21:44:31 +00:00
theli
0b95c9c434 *) Bugfix for Thread.getID() usagage + PeerPing-Shutdown Deadlock 
See:
   - http://www.yacy-forum.de/viewtopic.php?p=4937
   - http://www.yacy-forum.de/viewtopic.php?p=4939

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@390 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 21:00:11 +00:00
theli
13eeaa08f3 *) httpc.java: 
- Now it's possible to interrupt pending httpc-actions on server shutdown  
   - this is possible because of a newly introduced registration mechanism for
     open sockets
*) yacyCore.java
   - blocking peerPing threads can now be interrupted on server shutdown
*) serverCore.java
   - restructuring shutdown code 
*) error.html
   - port number is now set correctly if port forwarding was enabled


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@389 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 13:58:54 +00:00
theli
f57b60cd60 *) Correcting Problems with htmlFilterContentScraper.java 
Tag name comparison was case sensitive, therefore e.g.
      <A href="test.txt>test</A>
   was not parsed correctly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@387 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 13:32:49 +00:00
orbiter
b79070b471 fixed proxy/scraper 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@385 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 13:25:41 +00:00
orbiter
419f8fb398 fixed bugs/missing code regarding new crawl stack 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 01:38:49 +00:00
orbiter
112c5d3332 the new file-based indexing queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@382 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-06 14:50:01 +00:00
orbiter
858cd94299 replaced indexing ram-queue by file-based stack-queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-06 14:48:41 +00:00
allo
a31029c5de == as separator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@374 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 17:40:44 +00:00
allo
9f0f45bcae Warning: this is untested. 
I will need this for recursive Translation, and check it while extending the Translator.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@373 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 15:53:45 +00:00
theli
57c30f1d78 *) bugfix for usage of httpc without gzip content encoding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@369 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 11:25:25 +00:00
theli
0e2c33ee55 *) Network.html/Network.java: 
- Adding function to manually force peer ping to remote yacy peer
  See:Network.html?page=4
- for debugging purpose only!

*) serverAbstractThread.java:
- Adding posibility to notify a server thread via a synchronization object
- this is needed e.g. by the port forwarding feature to send a notification
  to the peerPing thread to redo peer-ping with the new ip/port Settings_p.html

*) Port Forwarding Feature (it should work now)
- adding a serverThread which is responsible to detect broken port forwarding 
  connections and to do reconnect if needed
- serverCore.java: moving port forwarding initialization into a separate function
- adding positility to configure the ssh port 
- moving configuration section on the gui into a separate fieldset
- hello.java: only trying to do a second connect to the clientIp address during
  peer handshake if either remote port forwarding is not enabled locally or
  the clientIP is not equal to any local ip

*) httpdFileHandler.java:
- printout a more verbose errormessage

*) httpc.java
- allowing to deactivate content encoding from outside


 

*) plasmaCrawlWorker.java
- the crawler worker now tries to refetch the content of a website without
  gzip content encoding if a gzip error occured



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@368 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 11:09:48 +00:00
orbiter
5159a090b0 fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@367 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 23:33:25 +00:00
orbiter
7f7cbc5019 fixed bug with snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@365 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 13:37:20 +00:00
orbiter
3607159a9a fixed connection of out-dated peers 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@364 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 13:08:49 +00:00
orbiter
fbef7fed81 adopted latestVersion to float handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@363 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 12:40:36 +00:00
orbiter
eb74fa0c82 fixed a bug with snippet-length 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-01 23:35:36 +00:00
orbiter
ec8a5ad060 fixed base implementation (verified with www.burningboard.net/archive/index.html) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@356 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 23:49:32 +00:00
orbiter
1d3cfb380a experimental implementation of base parsing in html parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@355 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 23:28:35 +00:00
orbiter
86f2aa8478 fixed seed-load date bug (evaluating server date for age computation) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@354 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 23:19:08 +00:00
orbiter
664bceced5 removed debug-lines 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@351 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 18:56:01 +00:00
orbiter
75ebdbc852 enhanced snippet-generation (case where snippet is too long) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 18:54:00 +00:00
allo
bef3aaec38 better Translationsystem. 
You only need to escape Chars, which have special meanings in regexps.
some you have to escape: ()[]{}


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 15:28:40 +00:00
orbiter
8a4f297324 fixed/enhanced snippet error-handling; suppression of results where no snippet exists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@347 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 00:01:53 +00:00
orbiter
712fe9ef18 bugfixed utf-8 decoding and parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@346 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 22:55:37 +00:00
allo
82d78fdab7 new Implementation and basic bbCode(Ok, opnly one Command ...) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@343 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 21:01:12 +00:00
allo
a60f5efcd6 rename 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 20:59:56 +00:00
theli
6e97f70549 *) httpd.java: improved errorhandling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@333 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 10:05:38 +00:00
theli
9d8c66fb5e *) adding possibility to forward received yacy-messages (htroot/yacy/message.java) 
via a command-line email program (e.g. sendmail) to a configured email address
   - the configuration dialog is reachable via Settings_p.html#messageForwarding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 09:50:48 +00:00
theli
08e4334c1d *) Status.java: showing amount of time since last upload of seed-file 
*) hello.java: adding additional output for principal-downgrade bug
*) httpd.java, httpdFileHandler.java, httpdProxyHandler.java: improved errorhandling
*) yacyCore.java: trying to fix principal-downgrade bug
*) yacySeed.java: adding some constants

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 11:27:31 +00:00
theli
eee6322aaf *) Adding redirection support to plasmaCrawlWorker.java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 08:07:41 +00:00
theli
cd279907c0 *) Adding redirection support to plasmaCrawlWorker.java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@327 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 08:01:26 +00:00
theli
6697d5e52e *) correcting fkt. mediaExtContains 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@326 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 06:44:31 +00:00
low012
a333715ffd This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@325 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-27 19:52:40 +00:00
orbiter
abba8fe61b fixed utf-8 decoding in htmlFilterAbstractScraper and removed httpd timing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@323 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-26 22:40:50 +00:00
orbiter
3addf58046 enhanced snippet-loading with threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-24 07:41:07 +00:00
orbiter
4afcf10158 added kelondroHashtable (not finished yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@321 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 14:41:59 +00:00
orbiter
56d28a16f0 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 14:40:39 +00:00
orbiter
d6c85228a6 enhanced snippet computation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@319 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 12:12:12 +00:00
theli
d53b2393e5 *) autoconfig.java: ip address was not reported correctly when port-forwardin is on 
*) hello.java: reportedip my be empty at peer startup
*) httpc.java: adding method to determine if the connection was already closed or is broken
*) httpdProxyHandler.java: trying to do a better errorhandling
*) server/serverCore.java
- setting myseed ip-address and port correctly if port-forwarding is on
- doing a more failsafe close and adding some debugging output
*) yacyClient.java: adding some logging statements to allow a better detection of 
   "degraded to senior"-bug
*) yacyCore.java: restructuring publishMySeed
   (@Orbiter: pleas take a look)
- to avoid buzy waiting
- to allow a gracefull shutdown on server shutdown
- new seed count was not calculated correctly in the previous version
*) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding
   was activated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@318 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 11:00:26 +00:00
theli
fafda068f9 *) allowing crawler to process resources with statuscode 203 
- this is needed if yacy is behind a second proxy 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@316 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 10:00:31 +00:00
theli
aae9a433a6 *) correcting usage of supportedFileExt-List 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@315 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 07:43:59 +00:00
orbiter
1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 02:07:45 +00:00
orbiter
68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@311 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-21 01:17:25 +00:00
orbiter
5728cdf8b5 bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 16:53:22 +00:00
orbiter
a19541e563 code-enhancements after analysis with AppPerfect 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@307 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 16:36:31 +00:00
theli
0e48177ad8 *) Bugfix of NullPointerException when sending Error Respond 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@305 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 15:57:03 +00:00
theli
bf78e0a6a4 *) Bugfix of Socket closed Exception 
See: http://www.yacy-forum.de/viewtopic.php?p=4437

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@304 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 13:33:23 +00:00
orbiter
85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@303 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 00:46:23 +00:00
orbiter
e3c92818db avoiding OutOfMemoryError routines 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@302 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-19 13:37:17 +00:00
orbiter
3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@301 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-19 05:27:42 +00:00
orbiter
3be98f194d tried to find the socket bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@300 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-18 01:48:11 +00:00
theli
dff937a9a3 *) Adding some logging statements to detect problems with seed upload functionality 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@297 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 08:38:22 +00:00
theli
98230a67f0 *) correcting version number for remote port forwarding feature check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@296 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 08:16:43 +00:00
theli
9f5d239051 *) correcting version number for remote port forwarding feature check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@295 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 08:06:23 +00:00
theli
0405de7635 *) Avoiding NullpointerException while testing exception test 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@294 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 08:04:53 +00:00
theli
db3ed75728 *) closing stream correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@293 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 07:58:02 +00:00
theli
aea355c03c *) adding test for connection status of port forwarding feature 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@292 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 07:57:00 +00:00
theli
bf66c6d6ec *) Bugfix for java.lang.NoClassDefFoundError: de/anomic/yacy/seedUpload/sshc:de/anomic/yacy/seedUpload/sshc 
See: http://www.yacy-forum.de/viewtopic.php?p=4345

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@291 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 07:54:51 +00:00
orbiter
5d06ded005 enhanced html parser speed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@290 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 01:26:51 +00:00
orbiter
5a490aa065 fixed html parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@289 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 21:49:56 +00:00
orbiter
a25b5b4986 fixed possible memory leak in htmlScraper: be aware that now links can get lost; further work necessary 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@288 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 18:31:28 +00:00
orbiter
dbda6e1e85 corrections to port forwarding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@286 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 11:40:36 +00:00
theli
822c9fa276 *) forgotten to add new classes for server port forwarding under version control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 10:36:23 +00:00
theli
9e47ba5ad6 *) adding missing calls for function close() to avoid "too many open file" bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@282 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 08:34:52 +00:00
theli
9a98988c3c *) Bugfix for SSL/NIO Bug 
See: http://www.yacy-forum.de/viewtopic.php?t=516
   - removing NIO from server/serverCore.java because of massive problems
     with socket close issues
*) Adding support for remote port forwarding via sch
   @Orbiter: Please take a look into
   - hello.java
   - server/serverCore.java.publicIP()
   - yacy/yacyClient.java.publishMySeed(...)
*) Making startup loading of additional content parsers more failsafe


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@281 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 07:28:07 +00:00
orbiter
a1ffc27041 preparations for image/movie/music indexing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@280 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 00:31:13 +00:00
orbiter
a5b40923b6 added word migration to assortments (start with 'java -classpath classes yacy -migratewords') 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-15 01:22:07 +00:00
theli
33e992cc8b *) unsing println instead of print 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@277 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 13:53:15 +00:00
theli
890e3f4d4a *) adding missing calls for function close() to avoid "too many open file" bug*) adding 
*) bugfix in plasma/plasmaParser.java:
   - parsers with missing dependencies wehre not ignored correctly
*) passing a logger instance to the parsers modules which can be used 
   for logging purposes by the parsers (not done yet)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 13:49:17 +00:00
orbiter
beb652847e added run-target for ant (needed for NetBeans4) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 12:01:58 +00:00
theli
c7d294d8d4 *) Bugfix for: 
- 302 redirection Problem on Amazon Server
   - Wrong References in proxymsg/error.html
   See: http://www.yacy-forum.de/viewtopic.php?t=515

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 07:50:35 +00:00
theli
6dd3ec0dc4 *) Adding debug="true" debuglevel="lines,vars,source" to ant build files 
See: http://www.yacy-forum.de/viewtopic.php?p=4099


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-12 05:22:06 +00:00
orbiter
4f9c30ef49 using mime-type instead of file extension for doctype 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@269 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-10 12:34:18 +00:00
theli
8b89f433b1 *) Changing loglevel to debug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@268 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-10 09:39:52 +00:00
theli
bbc46f037f *) avoid exception throwing on already catched exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-10 09:38:38 +00:00
theli
f0440911e8 *) removing unnecessary stacktrace printout 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@266 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-10 09:34:50 +00:00
theli
ee9e110366 *) removing old logging configuration properties from yacy.init 
*) serverLog.java logging functions now also accept exceptions als
   additional parameters.
   The Stacktrace of this ecceptions will then be appended to the 
   logging message and can e.g. be viewed on the gui logging page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-10 09:19:24 +00:00
orbiter
878ff0ae7b corrections 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 16:39:25 +00:00
theli
361ba50056 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 11:15:36 +00:00
theli
7b4778b4b9 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 11:02:54 +00:00
(no author)
dedadd1067 *) remove old serverLog class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@259 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:59:48 +00:00
theli
e5ee4198af *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:58:54 +00:00
theli
49a23bb89c *) adding reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:57:42 +00:00
theli
02d43a7bd4 *) adding additional methods that should be implemented by all 
serverHandler classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:54:03 +00:00
theli
652a19cf13 *) adding a method to read and zip a file (needed by the filehandler) 
for doing gzip encoding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:52:59 +00:00
theli
af9cd67334 *) migration to Java NIO 
- to avoid buzy waiting and
   - make socket blocking interruptable
*) changing reference to logger
*) introduce commandObjMethodCache to improve performance
*) doing a stream shutdown before closing the connection
   to aviod problems when using persistent connections
*) calling method UNKNOWN of the server-handler class when 
   receiving an unknown command
*) calling method EMPTY of the server-handler class when
   receiving an empty command

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:51:56 +00:00
theli
1eff96f471 *) removing buzy waiting 
*) changing reference to logger

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:47:50 +00:00
theli
c1a4e0dc28 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@252 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:44:55 +00:00
theli
d0083f845f *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:39:09 +00:00
theli
1b5ae054f8 *) changing reference to logger 
*) parser will not be returned into pool if the parser was deactivated
   via gui

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:38:00 +00:00
theli
68f30811fa *) changing reference to logger 
*) bugfix in function getCachePath

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:36:39 +00:00
theli
fbbea813c5 *) changing references to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:34:20 +00:00
theli
451ca6b818 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@247 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:25:39 +00:00
theli
4d7540e679 *) adding new constants 
*) adding a list of default error messages which belong to each
   http status code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@246 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:23:03 +00:00
theli
cb17ff4aa2 *) adding support of proxy access logging (much similar to squids 
access.log) file
*) splitting doGet function in separate functions for fulfilling
   requests from cache and from web to make error handling easier
*) using connection property and httpHeader constants instead of
   hardcoded strings whenever possible
*) sending back a proxy error message as body of every respond
   containing a http error code
*) correcting problems of messages received from other proxies
   containing 204, 304 status codes.
*) using chunked transfer encoding if the server has not set the
   content length (e.g. because of gzip content encoding) but 
   the client has established a persistent connection to yacy.
   This is only possible for http/1.1 clients. For http/1.0 clients
   the connection will simply be closed on the end of the message.   
*) removing unneeded functions (e.g. respondError) because of newly
   introduced functions of httpd.java
*) removing hop by hop headers (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:22:05 +00:00
theli
f157181086 *) starting implementation of Content-MD5 header 
which should help to detect transfer errors on yacy to yacy
   communication
   - not finished yet
*) removing unneeded functions (e.g. respondHeader) because newly
   introduced functions in class httpd.java
*) httpdFileHandler.java now always sends back a proxy error message
   as body of a response with an error code
*) adding support of gzip content encoding 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@244 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:12:07 +00:00
theli
d2042ec8fa *) adding constants for all needed connection properties 
*) adding hashset for file-extensions that should not be transfered
   using gzip content encoding
*) doing bugfixes on old keep-alive implementation
*) doing some additional http header validation according to rfc
*) doing all persistent connection detection in separate function now
*) doing server authentication in separate function now
*) doing proxy authentication in separate function now
*) simplifying GET, POST, HEAD functions because of new introduced 
   functions listed above
*) adding new function to handle empty request lines (which could
   occure after post requests send via a persistent connection; 
   this depends on the used browser)
*) adding new function to handle unknown request methods by sending
   a correct error message back to the client
*) setting correct content-length when sending back error messages
   to the client
*) adding new functions that must be used by all http-Handler classes
   to send 
   - a proxy error message
   - a http header
   back to the client
*) adding new function: shallTransportZipped
   moved here from httpc

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@243 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 10:07:02 +00:00
theli
06b0db2cac *) adding toString method to 
- httpc
   - response
*) simplifying gzip encoding
*) remembering http version of contacted server
   (neede for later support of keep alive by httpc)
*) moving function shallTransportZipped to httpd.java
   because this function is used multiple times

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@242 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:56:41 +00:00
theli
7b0b72dd23 *) adding new streams for 
- implementation of outgoing chunked transfer encoding (httpChunkedOutputStream.java)
- byte counting for proxy access logging / global traffic count
  (httpdByteCount(In|Out)putStream.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:47:56 +00:00
theli
aae3e3b7ab *) reusing buffer instead of creating a new one 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@239 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:45:58 +00:00
theli
829b65c1c8 *) adding additional classes needed for new logging 
- ConsoleOutErrHandler.java used to log warnings/errors to stderr 
  and all other messages to stdout
- GuiHandler.java
  used to keep logging messages in memory that can then be viewed
  via the http gui
- serverSimpleLogFormatter.java
  needed to format logging messages for FileHandler, ConsoleOutErrHandler
  and GuiHandler
- serverMiniLogFormatter.java
  needed for proxy access logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@233 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:25:08 +00:00
low012
8c2789b22a to catch is an irregular verb 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@225 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 00:07:25 +00:00
orbiter
4574fa4ce7 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@224 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 15:28:29 +00:00
theli
83b41ef2f7 *) Adding timeouts for shutdown 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@223 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 13:44:25 +00:00
theli
ef6851798b *) changing thread priority while parsing a pdf file to avoid 100% CPU usage. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@222 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 13:23:35 +00:00
orbiter
33f9315e58 implemented multithreading of indexing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@221 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 13:19:05 +00:00
orbiter
ca3b4ccaf4 added snippet-routines (not yet finished) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@218 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 00:52:24 +00:00
orbiter
ee0758fe4d bugfixes/empty-dir-deletion/snippet-test-activation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-07 01:05:55 +00:00
orbiter
594c591223 changes towards 0.38 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-03 02:43:35 +00:00
orbiter
d8fdc2526e added experimental snipplet-generation (to be disabled for 0.38) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@206 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-02 01:33:10 +00:00
orbiter
3771b10b89 implemented automated migration indexCache 0.37 -> indexAssortmentCluster 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-01 14:24:25 +00:00
orbiter
e89ded9e41 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@204 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 22:12:43 +00:00
orbiter
650ca3955a added flush-thread for index cache and added language-name mapping in Language_p 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@203 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 17:39:14 +00:00
mkossin
3dd3431c58 Fixes a Problem with mySeed.txt. If this file is accessible but has no content it will be recreated: http://www.yacy-forum.de/viewtopic.php?p=3657#3657 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@202 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 13:58:30 +00:00
orbiter
3d8a2ff937 enhanced parallelization of local/global/remote crawling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@197 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-29 11:56:40 +00:00
orbiter
a05d738ea4 enhanced caching, removed bug causing outOfMemory 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@195 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-29 00:34:01 +00:00
allo
f57d280afd serverLog instead of System.out.println 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@179 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 19:45:19 +00:00
allo
a8b2dccc7a New Translation System. 
Use Wordlists like these:
de.lng
Network\ Overview=Netzwerk-Übersicht


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 10:26:32 +00:00
orbiter
21110dcd5e fixed bugs with open files and caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-25 13:48:48 +00:00
orbiter
f8f8dd05db fixed "Too many open files" - bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@174 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-25 11:35:01 +00:00
theli
74eb21f62e *) adding image tag into rss template 
*) adding a xslt stylesheet so that the rss document can be viewed in a normal webbrowser
*) adding pubDate tag to each search item

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@173 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-25 08:47:34 +00:00
orbiter
5f90daa265 implemented localization environment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@171 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-24 14:23:04 +00:00
theli
84f9d8f7f0 *) migrating ant build files to generate a single extension tar per default 
This is buildconfigureable by changing the extensionTarget Property in the build.properties file
*) Trying to solve "yacy.java template replacement / ant build failed" bug

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@169 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-24 09:02:04 +00:00
orbiter
fdd606c8c8 fixed bugs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@168 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 23:50:35 +00:00
theli
8bd49ba535 *) setting root dir for all tar files properly 
*) automatically adding SVN Revision number to tar file name
*) introducing build.properties file that can be used to set the build version number and date

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@164 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 15:47:08 +00:00
orbiter
0c35171c85 assortment fine-tuning 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 15:07:16 +00:00
orbiter
76dc892017 refined assortment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 13:15:28 +00:00
theli
0e1d9e9722 *) shrinking httpc linebuffer when httpc is returned to pool. This is done to free memory 
*) Making Seed-Upload configuration more verbose.
*) Some Changes in SOAP Search API (not finished yet).

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@158 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 10:10:51 +00:00
theli
0484c41a84 *) replacing system.xxx.println with logging statements 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@156 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 09:08:36 +00:00
theli
c2378a968f *) setting thread name for search threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@155 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 09:07:16 +00:00
theli
7994c485f1 *) Trying to set the document title properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@154 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 08:32:22 +00:00
theli
285936d778 *) trying to set document title properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@153 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 08:24:15 +00:00
theli
573a8e8047 *) setting document title properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@152 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 08:21:35 +00:00
orbiter
4b01ff7548 activated assortments, removed write-queues 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@151 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-22 23:59:52 +00:00
orbiter
e26ac60c3e modified assortment data structures 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@148 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-22 13:27:54 +00:00
allo
ced07e3aec javadoc comment added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@146 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-21 18:50:12 +00:00
orbiter
79be6f003d enhanced Assortment class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@141 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-19 16:41:08 +00:00
theli
9ee3e69021 *) Solving "Warning: You did not close the PDF Document" problem when an OutOfMemory Exception occured ... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@140 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-19 11:16:02 +00:00
orbiter
5c6147a54c introduced assortment structure (generalization of singletons) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@139 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 21:52:17 +00:00
theli
05ab7c4d68 *) Correcting Problems with "transparent proxy" mode. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@134 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 09:45:27 +00:00
theli
73e297f30f *) adding proper default values for RealtimeParsableMimeTypes if something goes wrong with the configuration file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@132 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 07:40:48 +00:00
theli
0db0619204 *) Correcting wrong path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@128 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-17 09:29:02 +00:00
theli
893a662329 *) Adding missing cast statement 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@127 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-17 08:40:27 +00:00