Commit Graph

1291 Commits

Author SHA1 Message Date
(no author)
1d3249e787 handle UTF-8 correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1323 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 21:14:39 +00:00
(no author)
76f356315d handle UTF-8 correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1322 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 21:14:12 +00:00
(no author)
5c87685438 handle UTF-8 correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1321 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 21:13:01 +00:00
orbiter
b21b9df2d0 added section headlines generation to html parser
can be viewed in cache control, but is not yet included to indexing

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1320 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 20:21:34 +00:00
rramthun
c4487deba9 Minor changes collected over some time.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1319 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 19:15:31 +00:00
borg-0300
6de5c46702 new CacheAdmin (redesign);
bugfix: no more '//' in cachelink;
bugfix: don't left the htCachePath;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1318 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 18:02:54 +00:00
allo
13c978d3bc only lowercase tags
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1317 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 17:41:02 +00:00
orbiter
de359a9431 patched possible 100% cpu bug.
See http://www.yacy-forum.de/viewtopic.php?p=15067#15067

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1316 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 16:50:34 +00:00
allo
6822dce57b Using Orbiters function for auth
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1315 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 16:21:08 +00:00
orbiter
38b19ff56a another bugfix to the correctedNodeIterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1314 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 15:19:09 +00:00
orbiter
45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717
(no rotation)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1313 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-12 07:24:03 +00:00
orbiter
c137683a5c added patch to correct tree-iterator
(symptoms: at the end of the iteration,
more elements are iterated that are not in the
correct order)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1312 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-11 13:47:16 +00:00
allo
25c4e47582 bugfix for login
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1311 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-11 12:49:02 +00:00
orbiter
21fac0b6da small bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1310 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-11 00:43:00 +00:00
orbiter
2028403670 - consolidated different orderings to kelondroNaturalOrder
- added another iteration method to rwihash-enumeration


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1309 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-11 00:32:44 +00:00
orbiter
9544c47684 added some UTF-8 handling.
hope this will help somehow.. for shure not THE solution to our UTF-8 problem


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1308 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-10 16:48:59 +00:00
allo
7586fcb1a4 second Loginbug...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1307 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-10 16:12:28 +00:00
borg-0300
9d8dca750e BUGFIX for my last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1306 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-10 10:38:11 +00:00
orbiter
537a819824 extended RWIHashList DHT control method:
it is now possible to select only assortments or only files in WORDS
selection of words only from the ram cache is not yet possible.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1305 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-10 01:04:22 +00:00
borg-0300
5449193167 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706 (i hope)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1304 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 23:19:05 +00:00
borg-0300
2a23f5d419 F..., Sorry, no time, later
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1303 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 19:26:39 +00:00
borg-0300
3a2d13786e bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1302 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 19:18:41 +00:00
borg-0300
23a39698a7 last commit removed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1301 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 19:07:11 +00:00
borg-0300
3abd843cdb bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1300 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 18:54:21 +00:00
allo
c3284c27f5 this Code is now in passwordAuth
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1299 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 11:50:48 +00:00
theli
1c7f0789c9 *) Allow crawling of dynamic urls if configured
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1298 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 10:31:06 +00:00
theli
15b4e16591 *) correcting problems with comments while using the urlRedirector in command mode
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1297 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 10:12:23 +00:00
theli
94e54c4450 *) Removing url hash from loaded list before inserting the url into the crawling queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1296 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 10:05:45 +00:00
theli
99861ff2c1 *) Crawling depth can now be configured via command string in urlRedirector mode
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1295 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 09:34:51 +00:00
orbiter
a125fee9ce fixed iterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1294 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 00:55:47 +00:00
orbiter
33f8920e1c new database format: splitted trees, using an ordering to split the tree
The new format can be tested with the dbtest

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1293 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 00:46:56 +00:00
orbiter
d83cc3084a fixed small problem when password cannot be decrypted with base64
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1292 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-09 00:16:34 +00:00
daburna
ba49946376 translation for QuickCrawlLink_p.html added
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1291 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-07 13:21:33 +00:00
borg-0300
dc0999ec9c adapted to new HTCache structure
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1290 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-05 00:33:59 +00:00
allo
6df8080cf2 tiny fix for recursive Translations
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1289 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 21:59:09 +00:00
allo
4e4bd4662d redirectors fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1288 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 17:40:18 +00:00
hydrox
8b6d31763d *)added function to create a list of all RWI hashs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1287 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 13:55:45 +00:00
allo
b63bcf25d7 moving string2vector and vector2string to listsmanager
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1286 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 13:09:43 +00:00
orbiter
10a095d6b5 - added base64 ordering methods
- added coding interface

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1285 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 01:45:23 +00:00
orbiter
9086261476 refactoring of base64 encoding:
the kelondro database needs specific information about the order of
base64-encoded keys. Since no other package depends on base64
(only the httpd uses base64 for encryption, but does not need to encode these strings)
it is good to move base64 encoding to the new ordering classes in kelondro.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1284 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-04 00:39:00 +00:00
orbiter
7c0d7ed4f8 introduction of generic order interface for kelondro
this is needed for (to be introduced) splitted tree-files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1283 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-03 12:35:39 +00:00
daburna
a4696fa92e added new submenu for index control
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1282 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-03 11:46:46 +00:00
borg-0300
b24fcc8ca4 oom
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1281 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-03 11:08:45 +00:00
borg-0300
7da232b5b9 HTCache Reset if necessary
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1280 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-03 11:02:02 +00:00
daburna
c7a4bf7ed1 #updated de.lng:
-translation for IndexImport_p.html added
-translation for Bookmarks_p.html added
-updated other files

#corrected spelling:
-IndexImport_p.html
-IndexTransfer_p.html
-Bookmarks_p.html

#added link for IndexImport_p.html at IndexControl_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1279 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-03 00:38:45 +00:00
borg-0300
4f18f24d81 small change
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1278 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-02 22:30:40 +00:00
borg-0300
c652527620 YaCy removes now the old HTCACHE data
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1277 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-02 22:24:19 +00:00
orbiter
4609c8e11b update of doc/material (added 22c3 speech slides)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1276 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-02 01:32:10 +00:00
borg-0300
69f65210e2 ".yacy" has its own directory;
glad new year :)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1275 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-01 13:07:57 +00:00
allo
351fffc129 DATA/WORK for user-created content
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1274 6c8d7289-2bf4-0310-a012-ef5d649a1542
2005-12-31 11:47:52 +00:00