Commit Graph

508 Commits

Author SHA1 Message Date
theli
6697d5e52e *) correcting fkt. mediaExtContains
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@326 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-28 06:44:31 +00:00
low012
a333715ffd This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@325 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-27 19:52:40 +00:00
theli
aad2268751 *) adding menue to top of configuration pages
- IndexCreate_p.html
- Settings_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@324 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-27 09:59:58 +00:00
orbiter
abba8fe61b fixed utf-8 decoding in htmlFilterAbstractScraper and removed httpd timing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@323 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-26 22:40:50 +00:00
orbiter
3addf58046 enhanced snippet-loading with threads
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@322 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-24 07:41:07 +00:00
orbiter
4afcf10158 added kelondroHashtable (not finished yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@321 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 14:41:59 +00:00
orbiter
56d28a16f0 bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@320 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 14:40:39 +00:00
orbiter
d6c85228a6 enhanced snippet computation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@319 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 12:12:12 +00:00
theli
d53b2393e5 *) autoconfig.java: ip address was not reported correctly when port-forwardin is on
*) hello.java: reportedip my be empty at peer startup
*) httpc.java: adding method to determine if the connection was already closed or is broken
*) httpdProxyHandler.java: trying to do a better errorhandling
*) server/serverCore.java
- setting myseed ip-address and port correctly if port-forwarding is on
- doing a more failsafe close and adding some debugging output
*) yacyClient.java: adding some logging statements to allow a better detection of 
   "degraded to senior"-bug
*) yacyCore.java: restructuring publishMySeed
   (@Orbiter: pleas take a look)
- to avoid buzy waiting
- to allow a gracefull shutdown on server shutdown
- new seed count was not calculated correctly in the previous version
*) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding
   was activated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@318 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 11:00:26 +00:00
theli
933256bbfc *) adding href's to allow direct access to the currently crawled website
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@317 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 10:11:26 +00:00
theli
fafda068f9 *) allowing crawler to process resources with statuscode 203
- this is needed if yacy is behind a second proxy 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@316 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 10:00:31 +00:00
theli
aae9a433a6 *) correcting usage of supportedFileExt-List
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@315 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 07:43:59 +00:00
theli
83ceec3a63 *) Bugfix for wrong "Statusanzeige"
See: http://www.yacy-forum.de/viewtopic.php?p=4560

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@314 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 07:23:40 +00:00
orbiter
1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-23 02:07:45 +00:00
theli
dc1d707eb2 *) Deactivating "Port Forwarding Feature" for a while because of too many problems at the moment
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@312 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-21 08:22:03 +00:00
orbiter
68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@311 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-21 01:17:25 +00:00
low012
afe7cbe4de just a typo...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@310 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-21 00:53:04 +00:00
low012
10f6f19c08 Fixed one typo and added a few options to handle messages when messages get displayed.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@309 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 23:35:42 +00:00
orbiter
5728cdf8b5 bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@308 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 16:53:22 +00:00
orbiter
a19541e563 code-enhancements after analysis with AppPerfect
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@307 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 16:36:31 +00:00
rramthun
cf171ca35d Some corrections to the webinterface...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@306 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 16:19:13 +00:00
theli
0e48177ad8 *) Bugfix of NullPointerException when sending Error Respond
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@305 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 15:57:03 +00:00
theli
bf78e0a6a4 *) Bugfix of Socket closed Exception
See: http://www.yacy-forum.de/viewtopic.php?p=4437

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@304 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 13:33:23 +00:00
orbiter
85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@303 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-20 00:46:23 +00:00
orbiter
e3c92818db avoiding OutOfMemoryError routines
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@302 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-19 13:37:17 +00:00
orbiter
3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@301 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-19 05:27:42 +00:00
orbiter
3be98f194d tried to find the socket bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@300 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-18 01:48:11 +00:00
orbiter
10781f36b7 changed performance menu to accept milliseconds; 200 milliseconds may be appropriate for all crawling jobs; indexing should be set to 0
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@299 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 11:52:21 +00:00
theli
3227a9eba5 *) Adding retry function for seed uploading
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@298 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 08:45:44 +00:00
theli
dff937a9a3 *) Adding some logging statements to detect problems with seed upload functionality
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@297 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 08:38:22 +00:00
theli
98230a67f0 *) correcting version number for remote port forwarding feature check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@296 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 08:16:43 +00:00
theli
9f5d239051 *) correcting version number for remote port forwarding feature check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@295 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 08:06:23 +00:00
theli
0405de7635 *) Avoiding NullpointerException while testing exception test
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@294 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 08:04:53 +00:00
theli
db3ed75728 *) closing stream correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@293 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 07:58:02 +00:00
theli
aea355c03c *) adding test for connection status of port forwarding feature
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@292 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 07:57:00 +00:00
theli
bf66c6d6ec *) Bugfix for java.lang.NoClassDefFoundError: de/anomic/yacy/seedUpload/sshc:de/anomic/yacy/seedUpload/sshc
See: http://www.yacy-forum.de/viewtopic.php?p=4345

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@291 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 07:54:51 +00:00
orbiter
5d06ded005 enhanced html parser speed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@290 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-17 01:26:51 +00:00
orbiter
5a490aa065 fixed html parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@289 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 21:49:56 +00:00
orbiter
a25b5b4986 fixed possible memory leak in htmlScraper: be aware that now links can get lost; further work necessary
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@288 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 18:31:28 +00:00
orbiter
38747857c2 correction of correction to port-forwarding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@287 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 11:49:54 +00:00
orbiter
dbda6e1e85 corrections to port forwarding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@286 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 11:40:36 +00:00
theli
d8cb3324a9 *) property "mytime" was not set correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@285 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 11:22:20 +00:00
theli
822c9fa276 *) forgotten to add new classes for server port forwarding under version control
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@284 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 10:36:23 +00:00
theli
b2c5305737 *) Bugfix: Uptime Uptime #minutes (kosmetisch)
See: http://www.yacy-forum.de/viewtopic.php?p=4294

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@283 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 10:09:13 +00:00
theli
9e47ba5ad6 *) adding missing calls for function close() to avoid "too many open file" bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@282 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 08:34:52 +00:00
theli
9a98988c3c *) Bugfix for SSL/NIO Bug
See: http://www.yacy-forum.de/viewtopic.php?t=516
   - removing NIO from server/serverCore.java because of massive problems
     with socket close issues
*) Adding support for remote port forwarding via sch
   @Orbiter: Please take a look into
   - hello.java
   - server/serverCore.java.publicIP()
   - yacy/yacyClient.java.publishMySeed(...)
*) Making startup loading of additional content parsers more failsafe


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@281 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 07:28:07 +00:00
orbiter
a1ffc27041 preparations for image/movie/music indexing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@280 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-16 00:31:13 +00:00
orbiter
f45dc29f35 maintenance
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@279 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-15 14:59:53 +00:00
orbiter
a5b40923b6 added word migration to assortments (start with 'java -classpath classes yacy -migratewords')
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@278 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-15 01:22:07 +00:00
theli
33e992cc8b *) unsing println instead of print
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@277 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-06-13 13:53:15 +00:00