Commit Graph

391 Commits

Author SHA1 Message Date
allo
e16e4ba32b staticIP/DynDns Settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@414 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-20 08:53:47 +00:00
orbiter
a2cf76ea7c bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@413 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-20 01:36:28 +00:00
orbiter
1f36bf4dae enhanced assortment capacity; added extended WORDS migration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@412 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-20 00:39:06 +00:00
allo
e6c381a2e2 Translationfile Division for different files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@411 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-19 21:19:12 +00:00
rramthun
25a7d4c982 Finished translation of status.html into german. I hope I forgot nothing...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@410 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-19 19:26:57 +00:00
rramthun
0f11399d16 Some corrections...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@409 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-19 16:07:13 +00:00
orbiter
9f505af7aa preparations for bulk remote crawls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@408 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-19 00:26:31 +00:00
orbiter
0f663bcebf added global ppm computation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@407 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-18 15:22:14 +00:00
orbiter
9c72b4cdec replaced index dump stack by an dump array and limited url number in assortment ram (prevents too much RAM occupation)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@406 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-18 13:32:44 +00:00
orbiter
51962d55bf added 'PPM', page-per-minute statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@405 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-18 00:44:51 +00:00
orbiter
159f795f65 bugfix (null pointer exception in assortments)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@404 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-17 22:25:50 +00:00
orbiter
1d2155675b changed assortment memory cache flush
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@403 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-17 21:22:18 +00:00
orbiter
c47736a158 configuration of number of output lines in IndexMonitor
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@402 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-12 15:55:25 +00:00
orbiter
19dbed7cc8 code clean-up
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@401 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-12 15:09:35 +00:00
orbiter
00f63ea00d fail-save patch for pattern matching
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@400 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-12 00:31:35 +00:00
orbiter
0a6be961ea added pattern organization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@399 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-12 00:21:46 +00:00
orbiter
40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-12 00:07:09 +00:00
orbiter
311e627363 blocking of blacklisted urls in indexReceive and small changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-11 15:36:10 +00:00
orbiter
2f0d7ea8d3 removed htcache stati (superfluous now)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@396 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-09 00:33:34 +00:00
orbiter
277048501e bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@395 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-08 16:24:07 +00:00
orbiter
8b89c46afe fixed problem with cache write
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@394 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-08 16:06:35 +00:00
orbiter
455ae9f55f fixed htcache-store problem and due-time for remote crawls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@393 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-08 15:17:50 +00:00
theli
55d10b864c *) further improvements in shutdown behaviour
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@392 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 22:03:52 +00:00
theli
96386d6fc6 *) further improvements in shutdown behaviour
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@391 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 21:44:31 +00:00
theli
0b95c9c434 *) Bugfix for Thread.getID() usagage + PeerPing-Shutdown Deadlock
See:
   - http://www.yacy-forum.de/viewtopic.php?p=4937
   - http://www.yacy-forum.de/viewtopic.php?p=4939

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@390 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 21:00:11 +00:00
theli
13eeaa08f3 *) httpc.java:
- Now it's possible to interrupt pending httpc-actions on server shutdown  
   - this is possible because of a newly introduced registration mechanism for
     open sockets
*) yacyCore.java
   - blocking peerPing threads can now be interrupted on server shutdown
*) serverCore.java
   - restructuring shutdown code 
*) error.html
   - port number is now set correctly if port forwarding was enabled


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@389 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 13:58:54 +00:00
theli
5c3822d5f4 *) adding experimental support for parsing of bookmarksfiles
See: http://www.yacy-forum.de/viewtopic.php?t=177

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@388 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 13:41:56 +00:00
theli
f57b60cd60 *) Correcting Problems with htmlFilterContentScraper.java
Tag name comparison was case sensitive, therefore e.g.
      <A href="test.txt>test</A>
   was not parsed correctly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@387 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 13:32:49 +00:00
orbiter
50d4c302c7 removed yacy.blue (not part of release)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@386 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 13:26:35 +00:00
orbiter
b79070b471 fixed proxy/scraper
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@385 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 13:25:41 +00:00
orbiter
419f8fb398 fixed bugs/missing code regarding new crawl stack
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-07 01:38:49 +00:00
rramthun
9a7c4080d5 Fix for libx compression.
See http://www.yacy-forum.de/viewtopic.php?p=4922#4922

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@383 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-06 17:46:52 +00:00
orbiter
112c5d3332 the new file-based indexing queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@382 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-06 14:50:01 +00:00
orbiter
858cd94299 replaced indexing ram-queue by file-based stack-queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-06 14:48:41 +00:00
allo
4851b432e1 nice Version display(without svn rev added)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@380 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-05 13:43:48 +00:00
theli
2d1ccae406 *) bugfix for svn revision number detection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@379 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-05 09:31:23 +00:00
theli
b90f8e128a *) bugfix for svn revision number detection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@378 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-05 09:24:14 +00:00
allo
4e3a5db25b http://www.yacy-forum.de/viewtopic.php?p=4889#4889
Be carefull with short Strings...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@377 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-05 09:09:38 +00:00
theli
3cd9a1f4bd *) correcting problems with wrong svn revision number
- if the .svn directory exists, the entries file will be
  parsed to determine the revision number of the corrent
  working copy
- then the revision number in the build.properties file
  will be overwritten with this value
- if the .svn directory does not exists the value from
  the build.properties file will be used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@376 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-05 09:00:35 +00:00
rramthun
ea716b5010 more translation...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@375 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 19:02:29 +00:00
allo
a31029c5de == as separator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@374 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 17:40:44 +00:00
allo
9f0f45bcae Warning: this is untested.
I will need this for recursive Translation, and check it while extending the Translator.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@373 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 15:53:45 +00:00
orbiter
252c6e4869 added crawl queue monitor for global crawls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@372 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 15:07:33 +00:00
rramthun
e2d8766fa7 Nearly finished translation of Status.html...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@371 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 13:08:17 +00:00
orbiter
9a3f80403e redesigned IndexCreate menu -- introduced submenues to enable more crawl queue control pages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@370 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 12:42:29 +00:00
theli
57c30f1d78 *) bugfix for usage of httpc without gzip content encoding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@369 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 11:25:25 +00:00
theli
0e2c33ee55 *) Network.html/Network.java:
- Adding function to manually force peer ping to remote yacy peer
  See:Network.html?page=4
- for debugging purpose only!

*) serverAbstractThread.java:
- Adding posibility to notify a server thread via a synchronization object
- this is needed e.g. by the port forwarding feature to send a notification
  to the peerPing thread to redo peer-ping with the new ip/port Settings_p.html

*) Port Forwarding Feature (it should work now)
- adding a serverThread which is responsible to detect broken port forwarding 
  connections and to do reconnect if needed
- serverCore.java: moving port forwarding initialization into a separate function
- adding positility to configure the ssh port 
- moving configuration section on the gui into a separate fieldset
- hello.java: only trying to do a second connect to the clientIp address during
  peer handshake if either remote port forwarding is not enabled locally or
  the clientIP is not equal to any local ip

*) httpdFileHandler.java:
- printout a more verbose errormessage

*) httpc.java
- allowing to deactivate content encoding from outside


 

*) plasmaCrawlWorker.java
- the crawler worker now tries to refetch the content of a website without
  gzip content encoding if a gzip error occured



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@368 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-04 11:09:48 +00:00
orbiter
5159a090b0 fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@367 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-03 23:33:25 +00:00
rramthun
377e94f30e The usual stuff...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@366 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-03 19:47:53 +00:00
orbiter
7f7cbc5019 fixed bug with snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@365 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-07-03 13:37:20 +00:00