Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,788 Commits 1 Branch 20 Tags 836 MiB
3ca8f71cbb
Commit Graph

342 Commits

Author SHA1 Message Date
theli
734d18f283 *) more correct robots.txt validation 
- isDisallowed now uses getFile instead of getPath

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1870 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 13:04:57 +00:00
theli
f0ad0d2b2b *) better robots.txt support 
- previously rules for all crawlers and special rules for yacy where 
     combined using AND. Now the general rule will be ignored if there is
     a special rule for yacy (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1867 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:19:46 +00:00
theli
915812f597 *) Undoing robots parser policy changes from svn rev. 1421 
- crawling is not allowed if server returned a 403 statuscode (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 10:17:37 +00:00
low012
1965a8cf70 *) bugfix for previous commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 00:38:39 +00:00
low012
1c3b415c35 *) nicer anchors (TOC) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 00:24:49 +00:00
low012
6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1851 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 23:58:30 +00:00
auron_x
b92a00172e *) modified Blog 
- added delete-option
- fixed displaying of admin options

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1805 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-03 16:47:41 +00:00
orbiter
a4682e2810 fixed problems in basic config and added language setting 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1799 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-02 22:25:46 +00:00
auron_x
8c6f38fe70 *) added Blog to YaCy (atm not reachable through interface) -> Blog.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1790 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-01 07:40:25 +00:00
low012
d6cc0ec3d8 *) Fixed a bug: Images in tables were not displayed if alt or align attributes were added. 
*) Align for images only accepts valid parameters (bottom, top, center, middle, left , right) now.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1775 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-27 12:33:34 +00:00
low012
f31b633b2e *) Fixed yet another small bug in the wiki. (no blank between image URLs, align and alt) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1755 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-24 01:50:29 +00:00
low012
8bdbf0dfff *) Fixed a bug in code for tables and hopefully eliminated XSS vulnarability which Allo pointed out to me. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1754 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-24 01:14:38 +00:00
low012
62d0f7a334 *) added TOC for pages in wiki as requested in http://www.yacy-forum.de/viewtopic.php?t=1987 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-22 00:53:14 +00:00
allo
ff476c19a5 tuning User.html 
FIXED: Now admin can logout
ADDED: Nice Progressbar, representing your remaining onlinetime.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1727 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-21 15:51:09 +00:00
low012
2e8221050a *) removed redundancy, no changes in functionality 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1725 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-21 12:24:44 +00:00
allo
af1da090bb blogRight in UserDB. 
Look at the Fileshare, for how to use it.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-21 09:45:09 +00:00
allo
d7da273d7e using ArrayList instead of Vector 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1710 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-20 07:42:41 +00:00
allo
d6f7bd44ae fix for public tags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1709 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-20 06:34:44 +00:00
allo
467216d4c7 bugfix for umlaute and html-specialchars in wikiCode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1704 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-19 18:54:38 +00:00
orbiter
34341a868e code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1701 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-19 00:39:16 +00:00
allo
e3dd67bba0 bookmarks import. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1697 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-18 17:49:24 +00:00
allo
dda143df79 We NEED this here for the XML-Files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1696 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-18 14:57:25 +00:00
allo
bfd37e34aa using other XML Parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1693 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-18 12:00:13 +00:00
allo
0b5a736280 bugfix for nullpointer on unparsable date. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1688 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-17 19:40:01 +00:00
allo
f503df04f8 sort the Bookmarks with newest First. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1686 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-17 18:14:11 +00:00
allo
e6c2f700b1 public Tagview 
IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-15 14:35:30 +00:00
allo
672b384fc7 refactoring setTagsTable and setBookmarksTable. 
preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-15 13:16:10 +00:00
allo
b137c90015 BugFix for too long Usernames. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1642 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-14 20:19:40 +00:00
allo
a26574c894 Migration from tagName as key to wordhash(tagName) as key for bookmarkTags.db 
(just deleting the old db, rebuildTags does the rest)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1637 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-14 10:00:12 +00:00
theli
eeba8b055e *) guessing, testing and suggesting alternative hostnames on "unknown host" error 
See: http://www.yacy-forum.de/viewtopic.php?t=1879

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1636 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-14 09:55:09 +00:00
allo
a8a5ad959a using TAG_NAME for getFriendlyName() and the lowercaseversion for getTagName() 
Removed TAG_FRIENDLY_NAME

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1634 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-13 21:27:50 +00:00
allo
73f18ed5b2 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-02-13 14:42:19 +00:00
allo
bc6d400b03 bookmarktags with wordhashs. 
to Come: Migration
please test this...1) backup bookmarks.db 2) delete bookmarksTags 3) test it...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1626 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-13 08:38:32 +00:00
allo
addc802cf3 workaround for kelondro Umlaut-Problem. 
his will only fix öäüÖÄÜß ...just do not use other special chars ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1621 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-12 15:18:46 +00:00
allo
fb5c387368 XML import works. 
Please backup your bookmarks.db before trying it, i had many kelondro errors while importing del.icio.us xml-Files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1620 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-12 14:51:04 +00:00
allo
a4513523d6 hide add/edit/import bookmarks per default. 
xml-bookmark import (this does not work, yet)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1619 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-12 14:03:56 +00:00
allo
27b6b3d714 public Tags. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1589 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-09 20:08:45 +00:00
allo
a8eff9a0ae xml/bookmarks/posts/all.xml to list all public Bookmarks 
bookmarksIterator now accepts an option, if you want all(with private) or only public bookmarks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1577 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-08 17:13:27 +00:00
allo
d04e7d724e fix for deleting tags. 
string2vector should return an empty vector on ""

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1576 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-08 16:37:05 +00:00
allo
1fce0ea263 xml api for deleting bookmarks. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1546 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 14:54:07 +00:00
allo
6b16c13b20 showing the public/privat flag. 
TODO: Some nice icons.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1545 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 14:03:33 +00:00
rramthun
49647583b2 language update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1544 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 13:55:18 +00:00
allo
670356fa4e code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1543 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 13:27:04 +00:00
allo
af2127f3ad allow multiple #File: Sektions for one File in translations. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1534 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 18:08:01 +00:00
allo
1bb768178f simple check for unused Translations. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1533 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 17:49:10 +00:00
orbiter
3419b3bcdd fix for bug that caused the peer-counter problem. 
See http://www.yacy-forum.de/viewtopic.php?p=16016#16016
The kelondroDyn now uses a generic fill character.
kelondroDyn-Tables containing peer/word/url-hashes must not use '_'
as fill character.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1498 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 22:16:55 +00:00
theli
5c56b9ed59 *) catch exceptions that could occur during url decoding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1451 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-26 13:57:49 +00:00
low012
927c2c3709 *) Fixed a minor bug in code for tables. {|border"1" did not work, {| border"1" did. Now the space is not needed anymore. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1423 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 11:15:20 +00:00
theli
754a35877f *) Changing robots parser cxclusion policy 
- crawling is now allowed if server returned a 403 statuscode 
     when trying to download the robots.txt
   See: http://www.yacy-forum.de/viewtopic.php?t=1612

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1421 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 08:53:30 +00:00
low012
c45517db46 *) replaced code for table with better version (by kane) 
*) split replaceHTML into replaceCharacters and replaceHTMLonly, replaceHTML can still be used to ensure compatibility



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1416 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-23 13:59:40 +00:00
low012
eb80156233 *) added Kane's code for tables 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1403 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 15:41:49 +00:00
low012
ef22fa8bf2 *) beautifying code and a little comment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1401 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 14:20:38 +00:00
rramthun
34a7802a36 .bat files create DOS-window with title "YaCy" as suggested in http://www.yacy-forum.de/viewtopic.php?p=15470#15470 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1380 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 12:01:12 +00:00
low012
ee010c36ae *) fixed bug where ampersands were replaced by replaceHTML even if they were part of &.+; 
*) fixed bug in htmlentities (cAseSenSitivity!)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1371 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-18 01:48:34 +00:00
low012
7d5af75d11 *) Second try: replaced replaceHTML again. There should be no problem this time. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 01:00:38 +00:00
low012
c6d58d9b9a *) taking back changes for replaceHTML 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1356 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 21:43:32 +00:00
low012
8af5df7883 *) Replaced replaceHTML by a more versatile method (code by Kane). Please test for possible side effects if you use this method in any of your classes. 
*) Added a little bit of javadoc
*) Replaced tabs by spaces and beautyfied the code here and there.

The code is saved in UTF-8 encoding. I hope that does not cause any trouble.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1354 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 21:15:06 +00:00
allo
fd1dd6859b code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1353 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:40:02 +00:00
theli
99031b10ae *) Bugfix for recursive translation problem with file separators 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1352 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:32:24 +00:00
allo
1f9ff68f45 bugfix for the notdir in the recursive functions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1351 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 17:16:50 +00:00
allo
f8ee05372f better Logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1344 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 22:06:35 +00:00
allo
5531d18676 translations with relative Path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 18:52:14 +00:00
allo
fe2d983c3e recursive Translations! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 11:56:20 +00:00
allo
2cd01eb1aa bugfix for dates.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 15:26:10 +00:00
allo
d5aaaf500f bookmarksDB: 
lowercase Tags; if you create a Tag with Uppercase chars, friendlyName will be set.
So The Tag is displayed Uppercase, but stored Lowercase.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 15:10:24 +00:00
(no author)
76f356315d handle UTF-8 correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 21:14:12 +00:00
allo
13c978d3bc only lowercase tags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1317 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 17:41:02 +00:00
orbiter
9544c47684 added some UTF-8 handling. 
hope this will help somehow.. for shure not THE solution to our UTF-8 problem


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 16:48:59 +00:00
allo
c3284c27f5 this Code is now in passwordAuth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1299 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 11:50:48 +00:00
orbiter
d83cc3084a fixed small problem when password cannot be decrypted with base64 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1292 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-09 00:16:34 +00:00
allo
6df8080cf2 tiny fix for recursive Translations 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1289 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 21:59:09 +00:00
allo
b63bcf25d7 moving string2vector and vector2string to listsmanager 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1286 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 13:09:43 +00:00
orbiter
9086261476 refactoring of base64 encoding: 
the kelondro database needs specific information about the order of
base64-encoded keys. Since no other package depends on base64
(only the httpd uses base64 for encryption, but does not need to encode these strings)
it is good to move base64 encoding to the new ordering classes in kelondro.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 00:39:00 +00:00
allo
9cce3c5709 dates Table for bookmarksdb(needed for del.icio.us api) 
Files in DATA/DATA
Migration: move bookmarks.db from SETTINGS in DATA

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-30 12:34:44 +00:00
allo
2e2fa99501 bookmarksManager: 
-gettitle_p.xml and AJAX to use it
-classpath change
httpc:
-simple wget function

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-29 17:45:50 +00:00
allo
ca3a513aee del.icio.us style api 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:26:26 +00:00
allo
75b9163242 xmlapi for bookmarktags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:07:57 +00:00
allo
4c824cacba Description Field 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 20:47:16 +00:00
allo
867573de71 rebuildTags to rebuild the tags.db from the bookmarks.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 15:20:21 +00:00
allo
2982715a04 fix for Nullpointer Exception when adding a bookmark 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 13:03:13 +00:00
allo
09c95544c0 edit Function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 22:10:12 +00:00
allo
0619051c4b timestamps 
sorted by timestamps

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 21:03:42 +00:00
allo
d5e27009b1 bookmarks: 
-bugfixes
-deleting

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:48:19 +00:00
allo
87ea300d71 bookmarks interface 
-bugfix for tags
-defaulttag, if no tag is given

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:29:26 +00:00
allo
d0d1855520 tagView 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 18:14:40 +00:00
allo
ece2844385 bookmarkManager 
tagView, Public Flag, next-page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 15:40:09 +00:00
allo
4ac0fd328a First Version of the Bookmarksmanager 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 14:21:01 +00:00
allo
28f890ee3e Important SECURITY FIX! 
The UserDB Passwordcheck was buggy since 1138, any password allows access with the rights of 
the user!

USE SVN or disable all Users(take away all Rights)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1246 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-24 21:16:19 +00:00
allo
0f1212feb9 userDB.hasAdminrights to check adminRights. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 14:05:05 +00:00
low012
6c91921e9b *) yacyWiki: more versatile distinction between real external links/links that point to DATA/HTDOC 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1232 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-18 21:24:55 +00:00
low012
eb0f511767 *) yacyWiki: easy way to link to files on local peers (external links) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1223 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 15:49:25 +00:00
orbiter
c4dd39e8f2 fixing/changing wiki image inline code 
for local images hosted within DATA/HTDOCS


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1217 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 00:54:24 +00:00
low012
80b3e85356 *) yacyWiki: Images in a share on the same peer can be addressed by path and name only, no complete URL needed anymore. (As requested by theli in http://www.yacy-forum.de/viewtopic.php?t=809) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1215 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 21:58:13 +00:00
orbiter
83a34b838d * added Object allocation monitor on performanceMemory page 
* added some final statements
* changed shutdown sequence order

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1211 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-14 13:04:43 +00:00
orbiter
0c762daf4b better startup failure handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-12 23:59:58 +00:00
orbiter
37f88b4017 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 23:51:29 +00:00
orbiter
ec2b39c1ce code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 22:30:15 +00:00
orbiter
7920e1547d code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:13:13 +00:00
orbiter
1d6a6d1f85 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 00:17:12 +00:00
allo
8f4259f1e3 md5Auth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1144 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-29 21:31:06 +00:00
allo
b86d1085e2 passwordAuth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1138 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-28 22:35:41 +00:00
low012
5cd1e9cef4 *) fixed some dirty code, idea analog to bit stuffing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1098 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-16 23:58:13 +00:00
allo
f8f9d509d5 removed dead Code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 12:48:14 +00:00
allo
5918d3985e removed Debug Statements 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1076 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 11:47:46 +00:00
allo
3bbb932fa2 Bugfix for nullpointerexception. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1067 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-13 09:55:14 +00:00
allo
4976f97956 Logout Function on User.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-12 15:29:18 +00:00
allo
b74e990c74 better Logout function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1064 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-12 12:09:45 +00:00
allo
4daa4b00e9 logout function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1062 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-11 22:41:36 +00:00
theli
9649d08171 *) More tolerant robots parser 
- converting tabs to spaces
   - cutting of '*' in the disallow section

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1056 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-11 07:49:54 +00:00
theli
93cadb47b9 *) More tolerant robots parser for robots-files which missing empty lines between rule blocks 
See: http://www.yacy-forum.de/viewtopic.php?p=12471

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1048 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 07:41:25 +00:00
theli
f9fb284fb7 *) Better handling of robots.txt files with incorrect keywords 
See: http://www.yacy-forum.de/viewtopic.php?p=12292#12292

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1035 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-06 06:01:08 +00:00
theli
b8ceb1ffde *) Adding better https support for crawler 
- solving problems with unkown certificates by implementing a dummy trust Manager
   - adding https support to robots-parser 
   - Seed File can now be downloaded from https resources
   - adapting plasmaHTCache.java to support https URLs properly

*) URL Normalization
   - sub URLs are now normalized properly during indexing
   - pointing urlNormalForm function of plasmaParser to htmlFilterContentScraper function
   - normalizing URLs which were received by a crawlOrder request

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 15:28:37 +00:00
theli
3d0dfd4df4 *) Using StringBuffer instead of String concatenation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1018 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 08:08:37 +00:00
low012
452db479cd *) bugfix: "21" was displayed as "21" in yacyWiki 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 23:28:54 +00:00
hydrox
56b9f34411 *)removed unused imports 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 16:30:45 +00:00
orbiter
7a9fc653e9 fixed 100% cpu bug in wikiCode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1007 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-30 14:27:09 +00:00
orbiter
1aa707d357 fix for http://www.yacy-forum.de/viewtopic.php?p=11866#11866 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1005 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 15:30:06 +00:00
allo
5526d2ff73 Basic WatchCrawler.html, which loades the Queues using AJAX. 
ajax.js: generic Ajax-Functions
xml/queues/indexing_p*: the Backend


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 09:47:30 +00:00
theli
3b5d0eb053 *) Synchronizing robots.txt downloads to avoid parallel downloads of the same file by separate threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@998 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-28 09:10:48 +00:00
allo
e3f87f9dab Bugfix for not parsable Numbers (NumberFormatException when loading users) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@985 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-25 12:30:07 +00:00
low012
8e7b214e41 *) 5 inverted commas are needed instead of only 4 to strongly emphasise a text (closer to Wikipedia's syntax now) 
*) Tried to fix nested <pre> and [= issues, but did not succeed due to sleepyness. Will continue work when I'm awake and have some time.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@981 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 22:37:10 +00:00
low012
1e6cf9fd41 *) indented texts between escape symbols behave like indented preformatted texts now 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@979 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 13:21:57 +00:00
theli
6c48c3ce39 *) Bugfix for ArithmeticException during IndexTransfer 
See: http://www.yacy-forum.de/viewtopic.php?t=1362

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@974 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 16:07:44 +00:00
low012
fd1b08303e fixed a bug theli pointed out (indented <pre>-blocks) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@973 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 14:04:21 +00:00
theli
02d9af1a70 *) Restructuring and extending of Remote Proxy Support 
- remote proxy configuration can now be "really" changed on the fly and takes effect immediately
   - adding possibility to disable remote proxy usage for yacy->yacy communication
   - adding possibility to disable remote proxy usage for ssl
   - restructuring proxy configuration so that it is stored in a single place now

*) Adding possibility to import a foreign word DB (or even more of them in parallel) 
   at runtime into the peers DB
   - this can be done by calling IndexImport_p.html 
   - ATTENTION: please not that at the moment this thread must be aborted via gui
     before a normal server shutdown is done. 
   - TODO: integrating IndexImport Thread into normal server shutdown
   - TODO: Adding posibility to import crawl-queues, etc. from foreign peers
   - TODO: removing old import function from yacy.java and calling the new routines instead

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@968 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-22 13:28:04 +00:00
low012
222607ef0f *) added <pre>-tag for preformatted text to yacyWiki (as requested by theli) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@967 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-22 13:00:36 +00:00
allo
f97c303ebd rights for Admin and Proxy. 
Adminrights are OR(old auth or new).
Proxyrights are AND(you need Proxyrights and a not reached Timelimit)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 12:20:08 +00:00
allo
df147d0fb0 rightsmanagement for upload/download User - preparations for proxy and admin User 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@957 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 11:26:35 +00:00
theli
40777556c5 *) Connection Tracking 
- adding automatic refresh
   - accepts new parameter nameLookup which can be used to deactivate 
     yacy-peer name lookup (because we have problems with this on large seed-dbs)

*) ViewFile
   New page that can be used to view 
   - original content 
   - plain text content 
   - parsed content
   - parsed sentences 
   of a webpage specified by there url hash
   Mainly for debugging purpose at the moment

*) Robots.txt 
   Bugfix for if-modified-since usage
   TODO: synchronization of downloads to avoid loading the same robots-file 
   multiple times in parallel by different threads

*) Shutdown
   Better abortion of transferRWI and transferURL sessions on server shutdown

*) Status Page
   Adding icon to start/stop crawling via status page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@950 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 07:45:27 +00:00
allo
93c1cb9226 ipAuth works. thx theli. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@939 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-14 12:01:41 +00:00
allo
4320425a17 ipAuth (this does not work yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@937 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-14 10:53:50 +00:00
allo
9ff2bd2f0e allow surfing, if no timelimit set. 
thx, theli


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@920 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 10:58:21 +00:00
allo
141417821e limitless Accounts (set timelimit = 0) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@914 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-11 20:56:51 +00:00
allo
6bd9348bf1 small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@907 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 14:25:18 +00:00
allo
be8e95d86a debug printlns removed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@905 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 13:38:13 +00:00
allo
f1ff33177d reset Timelimits on Daychange 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@904 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 13:06:03 +00:00
allo
5605cc8018 TimeLimits 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@901 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:21:25 +00:00
theli
3966b38360 *) Bugfix for userDB time limit calculation 
See: http://www.yacy-forum.de/viewtopic.php?p=10949

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@898 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 09:17:19 +00:00
theli
1688be8590 *) plasmaSwitchboard.java 
adding more verbose logging output for db initialization
*) httpdFileHandler.java
   adding cache for servlet response methods


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@897 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 09:13:17 +00:00
theli
959eefbc4f *) Robots.txt parser/ppt 
cutting of comments at the line end
*) Adding Threadpool for stackCrawl Thread to speedup robots.txt download
   and double url checks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 04:43:07 +00:00
borg-0300
fb27428674 added restart to Status.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:35:05 +00:00
borg-0300
0dcfc25d98 cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@862 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:25:43 +00:00
theli
a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl) 
various checks like the blacklist check or the robots.txt disallow check are now
   done by a separate thread to unburden the indexer thread(s)
   TODO: maybe we have to introduce a threadpool here if it turn out that this single
         thread is a bottleneck because of the time consuming robots.txt downloads

*) improved index transfer
   The index selection and transmission is done in parallel now to improve index 
   transfer performance.
   TODO: maybe we could speed up performance by unsing multiple transmission threads in 
         parallel instead of only a single one.

*) gzip encoded post requests
   it is now configureable if a gzip encoded post request should be send on
   intex transfer/distribution

*) storage Peer (very experimentell and not optimized yet)
   Now it's possible to send the result of the yacy indexer thread to a remote peer 
   istead of storing the indexed words locally. 
   This could be done by setting the property "storagePeerHash" in the yacy config file
   - Please note that if the index transfer fails, the index ist stored locally.
   - TODO: currently this index transfer is done by the indexer thread. 
     To seedup the indexer
     a) this transmission should be done in parallel and
     b) multiple chunks should be bundled and transfered together


*) general performance improvements  
   - better memory cleanup after http request processing has finished
   - replacing some string concatenations with stringBuffers
   - replacing BufferedInputStreams with serverByteBuffer
   - replacing vectors with arraylists wherever possible
   - replacing hashtables with hashmaps wherever possible
   This was done because function calls to verctor or hashtable functions
   take 3 time longer than calls to functions of arraylists or hashmaps.
   TODO: we should take a look on the class serverObject which is inherited from hashmap
         Do we realy need a synchronization for this class?
   TODO: replace arraylists with linkedLists if random access to the list elements is not needed

*) Robots Parser supports if-modified-since downloads now
   If the downloaded robots.txt file is older than 7 days the robots parser tries to
   download the robots.txt with the if-modified-since header to avoid unnecessary downloads
   if the file was not changed. Additionally the ETag header is used to detect changes.

*) Crawler: better handling of unsupported mimeTypes + FileExtension

*) Bugfix: plasmaWordIndexEntity was not closed correctly in 
   - query.java
   - plasmaswitchboard.java

*) function minimizeUrlDB added to yacy.java 
   this function tests the current urlHashDB for unused urls
   ATTENTION: please don't use this function at the moment because
              it causes the wordIndexDB to flush all words into the
              word directory!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 10:45:33 +00:00
theli
c7b7c69484 *) adding some functions to userDB.Entry 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@826 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 15:41:01 +00:00
theli
d9c08a47f9 *) Minor changes to userDB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@824 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 15:02:17 +00:00
theli
af7829df25 *) adding some functions to userDB.Entry 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@823 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 14:56:50 +00:00
theli
19648702cc *) adding iterator to userDB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@819 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 13:21:31 +00:00
theli
dd59c1ace9 *) Adding first version of yacy user DB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@817 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 10:28:49 +00:00
theli
023be89586 *) Bugfix for "Robots.txt wird immer wieder geladen" 
See: http://www.yacy-forum.de/viewtopic.php?p=10241#10233

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@794 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 08:05:59 +00:00
orbiter
dc474aa22f various bug-fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@792 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 01:10:41 +00:00
orbiter
495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@774 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:01:26 +00:00
orbiter
fb52a82008 added new performance page for memory settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 10:10:34 +00:00
rramthun
9dfbd93c7b Updated german language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@748 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 15:44:17 +00:00
borg-0300
718950c5da small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@679 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-07 15:20:12 +00:00
theli
2cd695f376 *) Bugfix path-entries of robots.txt were not decoded correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@676 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-07 11:49:53 +00:00
theli
f8ad65eae1 *) First trial implementation of robots.txt support 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@674 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-07 11:17:21 +00:00
allo
9300689dde bugfix *gr* 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@662 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:46:11 +00:00
allo
ebc39a7b9a minor fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@659 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:34:26 +00:00
low012
e19ededd66 *) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@657 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:15:59 +00:00
allo
f90f699ab1 missing package line. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@655 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:04:27 +00:00
low012
89d7c6e45e *) Bugfix: offset of 1 prevented correct replacement of HTML 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@654 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 09:53:00 +00:00
allo
06a451768f a simple robotsParser. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@652 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 07:35:19 +00:00
low012
2ee4f9f4e5 *) added escape characters [= and =] to yacyWiki 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@622 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-31 14:43:55 +00:00
theli
4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels 
- please use logFine instead of logDebug
   - please use logSevere instead of logFailure and logError
   See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@615 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 21:32:59 +00:00
theli
6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels 
- please use logFine instead of logDebug
   - please use logFailure instead of logError
   See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@614 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 21:10:39 +00:00
low012
ecfdc4928a *) better implementation of definition lists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@564 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-20 12:57:31 +00:00
low012
36dfb9f686 implemented citings (blockquote) and an early version of definitions (not much of a list yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@557 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-19 01:38:14 +00:00
allo
5d511d651e fix for Windows 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@513 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-10 17:11:37 +00:00
allo
ee0a9a2d9b recursive Translations. 
You can now translate the Menu and other things in subfolders, too


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@508 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-09 14:27:18 +00:00
allo
53dcbadfbf using Wikicode instream of bbCode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@504 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-07 17:56:44 +00:00
allo
8659a689f4 seperate Class for the wikiParser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@500 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-06 17:03:12 +00:00
orbiter
2d8557cb10 minor changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@487 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-03 02:02:39 +00:00
orbiter
cc38c5e77b bugfix for wiki key-length 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 10:56:40 +00:00
allo
0a68aa6999 translate the last file, too 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@443 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 19:03:52 +00:00
orbiter
3470a72d48 fixed div by zero, set default delays, fixed release number format and display 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@435 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 11:47:50 +00:00
rramthun
bf7d5d1310 Usage of logging-class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@432 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-25 14:46:36 +00:00
rramthun
fe62a38896 minor fixes to the translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@429 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-24 15:32:27 +00:00
allo
98d22a73ef "File: foo.html" 
and
"File:bar.html"
support


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@420 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 21:23:21 +00:00
allo
e6c381a2e2 Translationfile Division for different files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@411 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 21:19:12 +00:00
orbiter
40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 00:07:09 +00:00
orbiter
311e627363 blocking of blacklisted urls in indexReceive and small changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-11 15:36:10 +00:00
orbiter
858cd94299 replaced indexing ram-queue by file-based stack-queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-06 14:48:41 +00:00
allo
a31029c5de == as separator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@374 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 17:40:44 +00:00
allo
9f0f45bcae Warning: this is untested. 
I will need this for recursive Translation, and check it while extending the Translator.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@373 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 15:53:45 +00:00
allo
bef3aaec38 better Translationsystem. 
You only need to escape Chars, which have special meanings in regexps.
some you have to escape: ()[]{}


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 15:28:40 +00:00
theli
890e3f4d4a *) adding missing calls for function close() to avoid "too many open file" bug*) adding 
*) bugfix in plasma/plasmaParser.java:
   - parsers with missing dependencies wehre not ignored correctly
*) passing a logger instance to the parsers modules which can be used 
   for logging purposes by the parsers (not done yet)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 13:49:17 +00:00
theli
361ba50056 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 11:15:36 +00:00
theli
7b4778b4b9 *) changing reference to logger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 11:02:54 +00:00
allo
f57d280afd serverLog instead of System.out.println 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@179 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 19:45:19 +00:00
allo
a8b2dccc7a New Translation System. 
Use Wordlists like these:
de.lng
Network\ Overview=Netzwerk-Übersicht


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 10:26:32 +00:00
theli
2aa5fe8f50 *) Import statements reorganized 
Now it's easier to determine which class really uses which other class

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@82 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-05 05:32:19 +00:00
orbiter
248077d3f0 initial load with yacy 0.36 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-07 19:19:42 +00:00