Commit Graph

1453 Commits

Author SHA1 Message Date
theli
c274b56a1b *) adding mimetype for xpi
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1447 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-26 09:38:28 +00:00
theli
f5abfe8d57 *) more failsafe threadpools
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1446 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-26 09:37:43 +00:00
theli
3feeba3d7b *) better handling of urls containing query parameters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1445 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-26 09:34:50 +00:00
orbiter
47344e8df0 removed referrer fake (too many complaints, too less use)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1444 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-25 18:54:46 +00:00
hermens
ad0de69607 Yet another bug fix for svn 1441. It should work now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1443 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-25 13:32:04 +00:00
hermens
58fd40e1c1 Aaargh
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1442 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-25 13:28:03 +00:00
hermens
b08af0c2cb *) Force download of seed file when checking upload success
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1441 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-25 13:25:48 +00:00
hermens
66c889138e *) Bugfix: Principals are reported back as 'principal', so IWasAccessed should also be true
*) make it easier to include legacy peers switching between timezones +0100 and +0200



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1438 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-25 01:50:24 +00:00
low012
d0043b027c *) Fixed a bug where page name was not displayed in URL. (see http://www.yacy-forum.de/viewtopic.php?t=1778)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1436 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 19:26:45 +00:00
orbiter
a56fefe0d3 added missing forced-flush for index cache
see http://www.yacy-forum.de/viewtopic.php?p=15732#15732

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1434 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 16:24:15 +00:00
allo
e575e57918 removed HTML from .java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1431 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 15:32:19 +00:00
hermens
78bcb8014a *) Limit range for selection of indexes for distribution to a DHTDistance of 0.2
(For wider ranges enough suitable targets are not probable)
*) Migrate Indexes from ClassicDB back to AssortmentCluster if transfer fails
*) Remove class iterateFiles from plasmaWordIndex
   (The class iterateFiles from plasmaWordIndexClassicDB is used instead)



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1430 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 14:58:15 +00:00
hermens
861aae678d *) cleanup cacheAge database when cleaning up the HTCache
*) Log directory deletes with level Fine



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1427 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 14:21:01 +00:00
borg-0300
5756b9d5c8 blacklist entries now checked
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1426 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 13:28:50 +00:00
orbiter
b9d73f63e7 replaced String object in loop detection by byte[] to omit String-generation
which could cause locks.
See http://www.yacy-forum.de/viewtopic.php?p=15738#15738

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1425 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 13:12:38 +00:00
low012
927c2c3709 *) Fixed a minor bug in code for tables. {|border"1" did not work, {| border"1" did. Now the space is not needed anymore.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1423 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 11:15:20 +00:00
theli
75aad0fe66 *) Bugfix for URLs containing spaces
See: http://www.yacy-forum.de/viewtopic.php?t=1640

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1422 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 09:30:58 +00:00
theli
754a35877f *) Changing robots parser cxclusion policy
- crawling is now allowed if server returned a 403 statuscode 
     when trying to download the robots.txt
   See: http://www.yacy-forum.de/viewtopic.php?t=1612

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1421 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 08:53:30 +00:00
theli
c69f7a39a3 *) adding a startup-test to avoid running into the unzip bug
See:
   http://www.yacy-forum.de/viewtopic.php?t=1763
   http://www.yacy-forum.de/viewtopic.php?t=715
   http://www.yacy-forum.de/viewtopic.php?t=1674

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1420 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 08:33:52 +00:00
hermens
a2e2d583f9 *) small bugfix regarding peerPingMaxRunning
*) beautify log



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1419 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-24 01:16:22 +00:00
theli
b4e2efef10 *) first test of new iteration function
ATTENTION: please don't use it at the moment

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1418 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 17:20:30 +00:00
rramthun
a4e90c4b11 Fixed spelling bug.
I think this is important for other programmers, who don't make the same mistake as the original author.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1417 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 15:08:39 +00:00
low012
c45517db46 *) replaced code for table with better version (by kane)
*) split replaceHTML into replaceCharacters and replaceHTMLonly, replaceHTML can still be used to ensure compatibility



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1416 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 13:59:40 +00:00
orbiter
eabf4a0386 fix for null pointer exception during shut-down
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1415 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 13:45:14 +00:00
orbiter
47843e69e2 auto-reset for switchboard queue stack
bugfix for http://www.yacy-forum.de/viewtopic.php?p=15684#15684

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1414 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 12:41:08 +00:00
orbiter
a70970f993 fixed increment in content iterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1413 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 12:11:32 +00:00
hermens
62ab8d18c1 *) Bugfix for peer sorting method. This seems to cause funny side effects in the SeedDB
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1412 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-23 01:42:26 +00:00
hermens
75b268f16d *) use majority voting for peer type decision
*) reduce the number of peer pings sent out
see: http://www.yacy-forum.de/viewtopic.php?t=1748



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1411 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 23:14:37 +00:00
rramthun
77548017f0 minifix: couldn't view message if german language active
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1410 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 20:02:42 +00:00
allo
da50e90615 " was missing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1409 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 20:02:22 +00:00
allo
31985fb38a simple Bugfix for Messages_p
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1408 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 19:50:57 +00:00
allo
bc75ea5e12 correcting migration
warning: if you have wiki*.db or message.db in SETTINGS, your new DBs in WORK will be overwritten
(only in case you replayed a backup, in normal operation you should have the DBs in WORK OR in SETTINGS)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1407 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 17:21:46 +00:00
orbiter
d6581c445b added content iterator for corrupted database files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1406 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 17:12:16 +00:00
theli
ecdc1f7547 *) Bugfix for crawling URLs with query parameters
See: http://www.yacy-forum.de/viewtopic.php?p=14065
*) Preparation for http://www.yacy-forum.de/viewtopic.php?t=1719

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1405 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 16:39:10 +00:00
borg-0300
0fcc07d3f7 "unresolved URL Hash" entries now checked
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1404 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 15:44:46 +00:00
low012
eb80156233 *) added Kane's code for tables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1403 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 15:41:49 +00:00
borg-0300
d5a86e2287 added keywords, properties
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1402 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 14:35:51 +00:00
low012
ef22fa8bf2 *) beautifying code and a little comment
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1401 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 14:20:38 +00:00
theli
319f8ffb18 *) changing file header
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1400 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 14:17:24 +00:00
theli
ed5ac0f81a *) adding servlet that is needed by the yacy screensaver
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1399 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 14:06:43 +00:00
orbiter
fc4ae899f7 added word-position to ranking (this is only a first step)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1395 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 02:16:09 +00:00
orbiter
bb2095fe39 assortment files are now not deleted, but shifted to a backup directory.
See also: http://www.yacy-forum.de/viewtopic.php?p=15458#15458

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1394 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 01:03:01 +00:00
orbiter
7366e39dd3 tried to fix 100% CPU bug.
See http://www.yacy-forum.de/viewtopic.php?p=15569#15569

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1393 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 00:50:05 +00:00
orbiter
f14d49fae9 enhancements, bugfixes and additions to word index attribute storage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1392 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-22 00:07:00 +00:00
allo
0f750c2ed6 new Templates
removed locales from Buildpath

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1391 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-21 23:01:08 +00:00
allo
a40acf050e warning if the DBs already exist in WORK
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1390 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-21 17:04:49 +00:00
allo
4d33020f56 Migration to WORK
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1389 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-21 16:39:57 +00:00
rramthun
1e5feedf0e Fix for http://www.yacy-forum.de/viewtopic.php?p=15547#15547
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1388 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-21 11:20:26 +00:00
orbiter
1a70ad64b2 extended network grafics capacity
try this:
http://localhost:8080/NetworkPicture.png?width=1280&height=1024&pal=10000&pol=10000&max=1000 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1387 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-21 00:21:39 +00:00
rramthun
5942f6334c Some language fixes.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1386 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-20 20:32:25 +00:00