Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,467 Commits 1 Branch 20 Tags 836 MiB
008bcb7fb8
Commit Graph

1040 Commits

Author SHA1 Message Date
low012
8af5df7883 *) Replaced replaceHTML by a more versatile method (code by Kane). Please test for possible side effects if you use this method in any of your classes. 
*) Added a little bit of javadoc
*) Replaced tabs by spaces and beautyfied the code here and there.

The code is saved in UTF-8 encoding. I hope that does not cause any trouble.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1354 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 21:15:06 +00:00
allo
fd1dd6859b code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1353 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:40:02 +00:00
theli
99031b10ae *) Bugfix for recursive translation problem with file separators 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1352 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:32:24 +00:00
allo
1f9ff68f45 bugfix for the notdir in the recursive functions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1351 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:16:50 +00:00
theli
da81d7db17 *) Adding possibility to close open connections via Connections_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 14:46:33 +00:00
hydrox
695dfb7eab *) -rwihashlist can now write to a zip-file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1347 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-15 10:29:48 +00:00
allo
4f8127946e inc Files are now translatable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1345 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 22:11:45 +00:00
allo
f8ee05372f better Logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1344 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 22:06:35 +00:00
allo
5531d18676 translations with relative Path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 18:52:14 +00:00
allo
fe2d983c3e recursive Translations! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 11:56:20 +00:00
orbiter
3d7c8aaeae removed confusing method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1339 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 02:08:11 +00:00
orbiter
4cd0c45a77 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1337 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 01:06:54 +00:00
hermens
971247b78f - rotate merged indexes after merging 
see: http://www.yacy-forum.de/viewtopic.php?t=1717
- fix -rwihashlist to correctly shutdown



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 23:59:04 +00:00
(no author)
001513cc1f Now custom httpHeader can be created 
and filled with cookies and so on.

This header one can set into serverObjects

Check CookieTest.html and CookieTest.java for details.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1334 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 22:50:04 +00:00
(no author)
55f3232219 Patch for the Coockie management. 
Version 0.1

Start Yacy, go to localhost:8080/CookieTest.html
Play around with cookies
Look into CookieTest.java to See, how it works

This behavior will be changed 
such that httpHeader will be responsible for the cookies in the future



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 21:29:04 +00:00
orbiter
e2ff1767b5 fix for last DHT distribution bug-fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1330 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 16:58:27 +00:00
allo
2cd01eb1aa bugfix for dates.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 15:26:10 +00:00
allo
d5aaaf500f bookmarksDB: 
lowercase Tags; if you create a Tag with Uppercase chars, friendlyName will be set.
So The Tag is displayed Uppercase, but stored Lowercase.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 15:10:24 +00:00
orbiter
060e5a0df0 fixed problem with DHT target peer selection: 
- shifted selection in front of distribution
see http://www.yacy-forum.de/viewtopic.php?p=15131#15131


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1327 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 14:32:48 +00:00
theli
7c22afe3de *) Bugfix for NullpointerException in deleteOldHTCache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1326 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 10:37:42 +00:00
(no author)
873cff20e9 handle UTF-8 correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1324 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 21:15:07 +00:00
(no author)
1d3249e787 handle UTF-8 correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1323 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 21:14:39 +00:00
(no author)
76f356315d handle UTF-8 correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 21:14:12 +00:00
orbiter
b21b9df2d0 added section headlines generation to html parser 
can be viewed in cache control, but is not yet included to indexing

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 20:21:34 +00:00
rramthun
c4487deba9 Minor changes collected over some time. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1319 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 19:15:31 +00:00
allo
13c978d3bc only lowercase tags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1317 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 17:41:02 +00:00
orbiter
de359a9431 patched possible 100% cpu bug. 
See http://www.yacy-forum.de/viewtopic.php?p=15067#15067

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1316 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 16:50:34 +00:00
allo
6822dce57b Using Orbiters function for auth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1315 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 16:21:08 +00:00
orbiter
38b19ff56a another bugfix to the correctedNodeIterator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1314 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 15:19:09 +00:00
orbiter
45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717 
(no rotation)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 07:24:03 +00:00
orbiter
c137683a5c added patch to correct tree-iterator 
(symptoms: at the end of the iteration,
more elements are iterated that are not in the
correct order)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1312 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 13:47:16 +00:00
orbiter
21fac0b6da small bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1310 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 00:43:00 +00:00
orbiter
2028403670 - consolidated different orderings to kelondroNaturalOrder 
- added another iteration method to rwihash-enumeration


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1309 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 00:32:44 +00:00
orbiter
9544c47684 added some UTF-8 handling. 
hope this will help somehow.. for shure not THE solution to our UTF-8 problem


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 16:48:59 +00:00
borg-0300
9d8dca750e BUGFIX for my last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1306 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 10:38:11 +00:00
orbiter
537a819824 extended RWIHashList DHT control method: 
it is now possible to select only assortments or only files in WORDS
selection of words only from the ram cache is not yet possible.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1305 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 01:04:22 +00:00
borg-0300
5449193167 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706 (i hope) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1304 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 23:19:05 +00:00
borg-0300
2a23f5d419 F..., Sorry, no time, later 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1303 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 19:26:39 +00:00
borg-0300
3a2d13786e bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1302 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 19:18:41 +00:00
borg-0300
23a39698a7 last commit removed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1301 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 19:07:11 +00:00
borg-0300
3abd843cdb bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1300 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 18:54:21 +00:00
allo
c3284c27f5 this Code is now in passwordAuth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1299 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 11:50:48 +00:00
theli
1c7f0789c9 *) Allow crawling of dynamic urls if configured 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1298 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 10:31:06 +00:00
theli
15b4e16591 *) correcting problems with comments while using the urlRedirector in command mode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1297 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 10:12:23 +00:00
theli
94e54c4450 *) Removing url hash from loaded list before inserting the url into the crawling queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1296 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 10:05:45 +00:00
theli
99861ff2c1 *) Crawling depth can now be configured via command string in urlRedirector mode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1295 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 09:34:51 +00:00
orbiter
a125fee9ce fixed iterator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1294 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 00:55:47 +00:00
orbiter
33f8920e1c new database format: splitted trees, using an ordering to split the tree 
The new format can be tested with the dbtest

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1293 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 00:46:56 +00:00
orbiter
d83cc3084a fixed small problem when password cannot be decrypted with base64 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1292 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 00:16:34 +00:00
borg-0300
dc0999ec9c adapted to new HTCache structure 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1290 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-05 00:33:59 +00:00
allo
6df8080cf2 tiny fix for recursive Translations 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1289 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 21:59:09 +00:00
allo
4e4bd4662d redirectors fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1288 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 17:40:18 +00:00
hydrox
8b6d31763d *)added function to create a list of all RWI hashs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1287 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 13:55:45 +00:00
allo
b63bcf25d7 moving string2vector and vector2string to listsmanager 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1286 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 13:09:43 +00:00
orbiter
10a095d6b5 - added base64 ordering methods 
- added coding interface

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1285 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 01:45:23 +00:00
orbiter
9086261476 refactoring of base64 encoding: 
the kelondro database needs specific information about the order of
base64-encoded keys. Since no other package depends on base64
(only the httpd uses base64 for encryption, but does not need to encode these strings)
it is good to move base64 encoding to the new ordering classes in kelondro.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 00:39:00 +00:00
orbiter
7c0d7ed4f8 introduction of generic order interface for kelondro 
this is needed for (to be introduced) splitted tree-files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1283 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 12:35:39 +00:00
borg-0300
b24fcc8ca4 oom 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1281 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 11:08:45 +00:00
borg-0300
7da232b5b9 HTCache Reset if necessary 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1280 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 11:02:02 +00:00
borg-0300
4f18f24d81 small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-02 22:30:40 +00:00
borg-0300
c652527620 YaCy removes now the old HTCACHE data 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1277 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-02 22:24:19 +00:00
borg-0300
69f65210e2 ".yacy" has its own directory; 
glad new year :)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1275 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-01 13:07:57 +00:00
allo
351fffc129 DATA/WORK for user-created content 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-31 11:47:52 +00:00
allo
a81cc9d969 no DATA/DATA to avoid confusion. 
increasing version number

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1273 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-31 11:13:26 +00:00
allo
ba96cefe0c packages for xml/* 
bugfix for servlets with packages from theli.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-30 13:57:51 +00:00
borg-0300
b95c5d5781 BUGFIX for URLs how "/../" ...; 
new port handling;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-30 12:58:36 +00:00
allo
9cce3c5709 dates Table for bookmarksdb(needed for del.icio.us api) 
Files in DATA/DATA
Migration: move bookmarks.db from SETTINGS in DATA

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-30 12:34:44 +00:00
hermens
11fe95832e avoid division by zero when index transfer is extremely fast 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1269 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-29 20:01:05 +00:00
allo
2e2fa99501 bookmarksManager: 
-gettitle_p.xml and AJAX to use it
-classpath change
httpc:
-simple wget function

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-29 17:45:50 +00:00
allo
ca3a513aee del.icio.us style api 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:26:26 +00:00
allo
75b9163242 xmlapi for bookmarktags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:07:57 +00:00
borg-0300
c7abd60782 last commit removed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 11:21:40 +00:00
borg-0300
8eb4181737 BUGFIX for regular expression 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 10:32:21 +00:00
borg-0300
106cd29981 regular expression shortened 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 10:00:13 +00:00
borg-0300
51433a121f added regular expression for '//'; 
* http://www.yacy-forum.de/viewtopic.php?t=1666
source text removes, url.getFile() has no ref's;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1259 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 09:44:52 +00:00
allo
4c824cacba Description Field 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 20:47:16 +00:00
allo
867573de71 rebuildTags to rebuild the tags.db from the bookmarks.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 15:20:21 +00:00
allo
2982715a04 fix for Nullpointer Exception when adding a bookmark 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 13:03:13 +00:00
allo
09c95544c0 edit Function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 22:10:12 +00:00
allo
0619051c4b timestamps 
sorted by timestamps

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 21:03:42 +00:00
allo
d5e27009b1 bookmarks: 
-bugfixes
-deleting

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:48:19 +00:00
allo
87ea300d71 bookmarks interface 
-bugfix for tags
-defaulttag, if no tag is given

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:29:26 +00:00
allo
d0d1855520 tagView 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 18:14:40 +00:00
allo
ece2844385 bookmarkManager 
tagView, Public Flag, next-page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 15:40:09 +00:00
allo
4ac0fd328a First Version of the Bookmarksmanager 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 14:21:01 +00:00
theli
d7b6dcbe2e *) Bugfix for MalformedURL problem if Location header is empty. 
See: http://www.yacy-forum.de/viewtopic.php?p=14325#14325

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1247 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-25 13:56:11 +00:00
allo
28f890ee3e Important SECURITY FIX! 
The UserDB Passwordcheck was buggy since 1138, any password allows access with the rights of 
the user!

USE SVN or disable all Users(take away all Rights)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1246 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-24 21:16:19 +00:00
allo
0f1212feb9 userDB.hasAdminrights to check adminRights. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 14:05:05 +00:00
orbiter
b3dca06bb1 added location column to network pages. 
The location is computed from the userAgent string of connecting peers.
Therefore this information is not available right after start-up.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 01:01:46 +00:00
hermens
5b3e01bd3c avoid division by zero when importing very small indexes (<100 entries) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1238 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-20 12:03:34 +00:00
rramthun
d0c2c67f4c Update YaWoStat version. 
See http://www.yacy-forum.de/viewtopic.php?p=14215#14215 for possible use.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1236 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-19 19:14:18 +00:00
orbiter
60fc34d9e8 iterartion bug: 
http://www.yacy-forum.de/viewtopic.php?p=14182#14182


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-19 00:40:06 +00:00
low012
6c91921e9b *) yacyWiki: more versatile distinction between real external links/links that point to DATA/HTDOC 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1232 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-18 21:24:55 +00:00
borg-0300
b7f9adc2c9 new filters added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1231 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-18 01:15:25 +00:00
hydrox
9b617bcb65 *)compression of -domlist now optional (-format zip 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1230 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-17 21:19:51 +00:00
hydrox
2bd4a66133 *)-domlist now creates a zipped txt-file. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1229 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-17 15:43:13 +00:00
rramthun
45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1224 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-17 11:13:44 +00:00
low012
eb0f511767 *) yacyWiki: easy way to link to files on local peers (external links) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1223 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 15:49:25 +00:00
theli
79667a172e *) Bugfix for additional parser problem 
See: http://www.yacy-forum.de/viewtopic.php?p=14146#14146

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1221 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 09:10:15 +00:00
theli
b6be828d15 *) Bugfix: Share subdirectory couldn't be views because of LinkageErrors 
See: http://www.yacy-forum.de/viewtopic.php?t=1634

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1218 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 08:39:48 +00:00
orbiter
c4dd39e8f2 fixing/changing wiki image inline code 
for local images hosted within DATA/HTDOCS


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1217 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 00:54:24 +00:00
low012
80b3e85356 *) yacyWiki: Images in a share on the same peer can be addressed by path and name only, no complete URL needed anymore. (As requested by theli in http://www.yacy-forum.de/viewtopic.php?t=809) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1215 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 21:58:13 +00:00
theli
8c594841a8 *) Bugfix for incorrectly indexing of URLs that were requested with Cookies in the 
Request header
   See: http://www.yacy-forum.de/viewtopic.php?p=14077

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1214 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 15:30:24 +00:00
orbiter
b5d02d649a fixed bug caused strange search result behaviour 
(results from remote peers had not been saved propery after search)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1213 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 13:21:42 +00:00
orbiter
4500506735 fixed some bugs concerning url entry retrieval and intexControl interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 10:31:00 +00:00
orbiter
83a34b838d * added Object allocation monitor on performanceMemory page 
* added some final statements
* changed shutdown sequence order

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1211 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-14 13:04:43 +00:00
orbiter
4ff3d219e8 increased delay for cacheScan start and slowed down scan process 
to provide more time to other tasks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1210 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-13 21:15:52 +00:00
orbiter
3031903d50 re-design of RAM cache flush into assortment cluster 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1209 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-13 16:00:20 +00:00
orbiter
676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-13 11:58:55 +00:00
orbiter
3cc02fe749 enhanced buffered write by combination of several chunks into one chunk 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1206 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-13 00:52:27 +00:00
orbiter
0c762daf4b better startup failure handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-12 23:59:58 +00:00
orbiter
f27f9ecf15 * activated write buffer for databases. 
This should increase IO performance and reduce HD activity
* bugfixes for new exception-on-failure policy
* bugfixes for new IOChunks
* new Object pool for database write-buffer


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1204 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-12 14:11:59 +00:00
orbiter
c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active) 
- minor bugfixes


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1203 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-12 00:19:28 +00:00
orbiter
ca7e60279d introduced IOChunks. 
This is an abstraction of chunked IO-processes.
It will help to synchronize access to IO-ports.
Furthermore this is a preparation for upcoming chunk-oriented write buffers.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1201 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-11 02:36:49 +00:00
orbiter
bb79fb5d91 - changed handling of error cases retrieving urls from database 
(no more NULL values are returned, instead, an IOException is thrown)
- removed ugly damagedURLS implementation from plasmaCrawlLURL.java
  (this inserted a static value into the Object which is not really a good style)
- re-coded damagedURLS collection in yacy.java by catching an exception and evaluating the exception message
to do:
- the urldbcleanup feature must be re-tested


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1200 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-11 00:25:02 +00:00
orbiter
fed92d364b introduced USAGE object for counter synchronization in kelondroRecords 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1199 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-10 02:11:24 +00:00
hermens
35cf6712b2 *) fixes for httpd 
- don't send Body on HEAD requests
  - don't send a Last-modified: date, that is later then Date:
  - Use Cache-control instead of Pragma with HTTP/1.1
  - don't send header with HTTP/0.9



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1198 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-09 17:35:45 +00:00
theli
5a627a690f *) Extending hydrox urlDbCleanup function 
- now the function tries to correct the URL first
   - if the url can not be corrected it will be deleted
   See: http://www.yacy-forum.de/viewtopic.php?p=13898

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1197 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-09 15:41:06 +00:00
theli
e7d16ef831 *) Corrections in jMimeMagic MagicRule-file to detect some special rss feeds 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1196 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 23:25:43 +00:00
orbiter
3086e38bb1 added getRemoved method on demand from theli for migration purpose 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1195 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 23:22:57 +00:00
theli
386d9e45d8 *) Bugfix for code cleanup 
- Code must be in finally block, otherwise it does not work if an error occurs!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1193 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 22:16:49 +00:00
orbiter
356231b033 changed only for testing with new hastable implementation. 
Core funktions are unchanged.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1192 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 21:38:34 +00:00
theli
5a1d45715d *) Bugfix for parser configuration bug 
- it was not possible to disable all parsers
   See: http://www.yacy-forum.de/viewtopic.php?t=1579

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1191 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 21:35:40 +00:00
orbiter
1041f4946a experiments with locks to remove synchronization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1189 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 12:30:55 +00:00
orbiter
288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1188 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 02:18:44 +00:00
rramthun
a1061495d4 Fixed some spelling mistakes and added some text which (should) make it easier to understand the options. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1187 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 19:47:21 +00:00
orbiter
0cdc58aaea fixed indexing of local domains. 
see http://www.yacy-forum.de/viewtopic.php?p=13680#13680

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1186 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 14:26:43 +00:00
orbiter
76b97e4d2a integrated geo-snap DBStressTest.java in dbtest 
this is still beta.
It uses serverInstantThreads instead of Java 1.5 code for multiple threads

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1185 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 13:33:39 +00:00
hermens
ec1202edbe *) Fixes for httpd 
- Fix for local timezone in http header
    See: http://www.yacy-forum.de/viewtopic.php?t=836
  - Allow static content to be cached by browser
    See: http://www.yacy-forum.de/viewtopic.php?t=1311


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1184 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 13:26:27 +00:00
theli
e1c2d8ec5f *) Speedup "removed from queue" 
See: http://www.yacy-forum.de/viewtopic.php?p=13442#12188

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1183 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 11:27:44 +00:00
hydrox
96930f0d2b *)added function to removed malformed URLs from urlHash.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1182 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 11:10:08 +00:00
orbiter
d007d14905 re-insert of migrateSwitchConfigSettings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1180 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 10:31:48 +00:00
theli
8862b6ba4b *) Corrections for code cleanup 1175 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1179 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 08:15:39 +00:00
orbiter
0e88ba997e * added option to generate url-lists as plain text file or in html 
* modified generation of dom-lists so that they can be also generated as html
these options can be called as:
java -classpath classes yacy -domlist -format html
java -classpath classes yacy -domlist -format html .
java -classpath classes yacy -domlist -format text .
java -classpath classes yacy -urllist -format html .
java -classpath classes yacy -urllist -format text .
the -format <type> can be ommitted. The text is default
a home path can be asserted or omitted at the end of the parameters

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1178 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 01:40:52 +00:00
orbiter
13fdebc50d added authentication for link deletion in search result 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1177 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 00:36:05 +00:00
orbiter
37f88b4017 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 23:51:29 +00:00
orbiter
ec2b39c1ce code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 22:30:15 +00:00
orbiter
76618442e0 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1173 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 21:21:14 +00:00
orbiter
8f1f2daa5e implemented interactive link deletion of search results. 
next steps: attach voting and restrict to administrator
to see the deletion button, move the mouse pointer to the left of a search result

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1172 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 16:15:21 +00:00
theli
6d0f7e6988 *) Adding missing file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1171 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 11:20:06 +00:00
theli
44fa94ac52 *) Modifications for dbImport functionality 
- dbImporter threads are now shutdown by the switchboard on server shutdown
   - adding possibility to pause a importer thread via GUI
   - Bugfix for abort function
     See: http://www.yacy-forum.de/viewtopic.php?p=13363#13363

*) Modification of content parser configuration
   - now it's possible to configure which parsers should be enabled for the proxy,
     crawler, icap, etc. separately
   - 

*) htmlFilterContentScraper.java
   - adding regular expression to normalize URLs containing /../ and /./ parts

*) httpc.java
   - adding functionality to unzip gzipped content
   - requested by roland: should be used later to allow gzipped seed lists

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1170 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 10:41:19 +00:00
orbiter
28ddba8813 added vote-button images 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1169 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 00:16:41 +00:00
orbiter
dc778659fb fixed problem with time-out during result joint which caused OR behavior instead of AND beahvior 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1167 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 15:48:45 +00:00
orbiter
3d8a5ae652 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1166 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 14:24:13 +00:00
allo
ae6a4650bc reenabling debugMode (60 Seconds timeout for *all* http connections) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1165 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 11:14:11 +00:00
theli
bb1f73ec15 *) Bugfix for code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1164 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:48:11 +00:00
orbiter
7920e1547d code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:13:13 +00:00
theli
972b8ddd2a *) minor changes: using constants properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1162 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:18:47 +00:00
theli
1c3750de57 *) Bugfix for code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1161 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:15:05 +00:00
theli
64478b1f02 *) Adding possibility to delete crawler queue entries using regular expressions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1160 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:11:28 +00:00