Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-24 00:00:19 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,342 Commits 1 Branch 20 Tags 836 MiB
e4734a8b6b
Commit Graph

1376 Commits

Author SHA1 Message Date
allo
22da652d4f more options on Userpage. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1068 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-13 14:17:23 +00:00
allo
4976f97956 Logout Function on User.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-12 15:29:18 +00:00
orbiter
f763923e0a added missing files for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1057 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-11 08:02:46 +00:00
orbiter
79818a320f introduced citation-rank transmission protocol and activate transport for anonymisation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1055 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-10 23:48:20 +00:00
borg-0300
9a441e8e77 new Ranking Images 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-09 13:24:41 +00:00
theli
6f8d7d3bcd *) Adding first version of YaCy bookmarklet 
- this can be used to easily crawl a webpage which is currently opened in the browser
   - to get the bookmarklet javascript simply call http://localhost:8000/QuickCrawlLink_p.html
     and drag and drop the link shown to your Browsers Toolbar/Link-Bar.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1053 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 12:14:51 +00:00
hydrox
86c74d209d *) fix for Settings_p.html (wrong variablename in link) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1051 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 09:02:26 +00:00
hydrox
886955e38c *) fix for last commit (wrong filename) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1050 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 08:58:18 +00:00
hydrox
88669ce008 *) cleaned up Settings_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1049 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 08:40:18 +00:00
orbiter
d2731418bf added creation of global ranking files and changed url normal form usage 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 12:33:02 +00:00
theli
fb766413d1 *) Changes on httpc dns caching 
- Bugfix: old dns cache did not handle case insensitive hostnames correctly. 
   - adding a possibility to set domain name patterns defining hostnames that should not be cached by the httpc dns cache
     e.g. borg-300.dyndns.org
     This can be done by setting the new httpc.nameCacheNoCachingPatterns property
   - using httpc.dnsResolve wherever possible within the sourcecode
     [httpd.java,plasmaCrawlStacker.java]

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1044 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 10:57:54 +00:00
allo
89a4cca4df max. num of Entries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 06:53:44 +00:00
allo
8d8d866494 Bugfix for catch up late Peer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 06:52:30 +00:00
theli
dd24f0252f *) Searchword highlighting for info page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1036 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-06 06:27:17 +00:00
borg-0300
440e6ed747 see http://www.yacy-forum.de/viewtopic.php?t=1416 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1025 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 23:49:50 +00:00
theli
b8ceb1ffde *) Adding better https support for crawler 
- solving problems with unkown certificates by implementing a dummy trust Manager
   - adding https support to robots-parser 
   - Seed File can now be downloaded from https resources
   - adapting plasmaHTCache.java to support https URLs properly

*) URL Normalization
   - sub URLs are now normalized properly during indexing
   - pointing urlNormalForm function of plasmaParser to htmlFilterContentScraper function
   - normalizing URLs which were received by a crawlOrder request

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 15:28:37 +00:00
hydrox
2c5999ae00 *)fixed UNRESOLVED PATTERN in ViewLog_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 10:44:53 +00:00
theli
f871408729 *) sharedBlacklist_p.java 
- Setting Pragma: no-cache
   - increasing timeout to 12 sec.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 08:32:43 +00:00
hydrox
cb69047b91 *)cleanup access static methods and fields 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 17:56:26 +00:00
hydrox
56b9f34411 *)removed unused imports 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 16:30:45 +00:00
hydrox
62b6c2b9e7 *)added news count to News.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 10:31:52 +00:00
hydrox
295aff52a3 *)added offline-browsing-support (onlineMode=0) 
*)online-mode now can be changed in Status.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-31 12:25:40 +00:00
orbiter
b058ecf0bc refactoring of image-generation; added experimental PNG encoder (not active now) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1008 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-31 02:43:55 +00:00
orbiter
fce616db23 security limits for network picture 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-30 13:47:42 +00:00
allo
749f44d144 LiveUpdate. 
(this does not work correctly at the Moment :-/)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1003 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 10:52:21 +00:00
allo
5526d2ff73 Basic WatchCrawler.html, which loades the Queues using AJAX. 
ajax.js: generic Ajax-Functions
xml/queues/indexing_p*: the Backend


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 09:47:30 +00:00
orbiter
7a3be46c18 bugfix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-28 13:03:30 +00:00
theli
8194fde340 *) trying to continue transferRWI processing even if this error occures: 
|> Caused by: de.anomic.kelondro.kelondroException: kelondroTree.searchproc: nullpointernull in db '.../urlHash.db' 
   - if URL existence can not be determined, we request it from the remote peer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-28 07:47:30 +00:00
theli
ec3af327f7 *) Bugfix for Proxy-Authentication against remote proxy 
See: http://www.yacy-forum.de/viewtopic.php?p=11804#11804

*) Adding first version of db test for mysql
   NOTES:
   - db user + db + db table must be created before starting the test
   - db table must be empty. Entries can not be updated at the moment
   - db connection properties must be changed in the sourcecode at the moment
   TODOs:
   - accepting connection properties via command line
   - implementing update + remove + read operations
   - 'maybe' adding code to create db + table if it doesn't exists

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-27 11:28:37 +00:00
orbiter
5b0911d7ea added new performance menu for search sequence configuration and monitoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-27 00:42:08 +00:00
orbiter
8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@980 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 14:07:43 +00:00
orbiter
097009d910 experimental visualization of DHT access during global search (temporary) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@977 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 00:34:15 +00:00
orbiter
4dcbc26ef1 introduction of search profiles; very experimental 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@976 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 17:50:27 +00:00
theli
efd11c13b6 *) Fixed wrong button text 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@975 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 16:18:41 +00:00
theli
525c8dcbd4 *) Adding Traffic Statistic for Crawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@972 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 12:35:48 +00:00
theli
02d9af1a70 *) Restructuring and extending of Remote Proxy Support 
- remote proxy configuration can now be "really" changed on the fly and takes effect immediately
   - adding possibility to disable remote proxy usage for yacy->yacy communication
   - adding possibility to disable remote proxy usage for ssl
   - restructuring proxy configuration so that it is stored in a single place now

*) Adding possibility to import a foreign word DB (or even more of them in parallel) 
   at runtime into the peers DB
   - this can be done by calling IndexImport_p.html 
   - ATTENTION: please not that at the moment this thread must be aborted via gui
     before a normal server shutdown is done. 
   - TODO: integrating IndexImport Thread into normal server shutdown
   - TODO: Adding posibility to import crawl-queues, etc. from foreign peers
   - TODO: removing old import function from yacy.java and calling the new routines instead

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@968 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-22 13:28:04 +00:00
theli
af3060938b *) Bugfix for manual peer ping functionality 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@965 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 11:43:43 +00:00
theli
9879c68be9 *) Bugfix for manual peer ping functionality 
- updateMySeed was not called properly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@964 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 10:43:26 +00:00
theli
6e3201b74d *) Bugfix in httpc.java 
- Requestheader was not passed to the underlying post function properly
   - Bug seems not to have caused any side-effect until yet

*) Bugfix for manual peer ping functionality

*) Bugfix for UnresolvedPattern Problem if an Exception occurred in a servlet.
   See: http://www.yacy-forum.de/viewtopic.php?t=1353

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@963 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 09:55:12 +00:00
borg-0300
58b670201d now, changed HTCacheSize needs no restart 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 17:59:54 +00:00
allo
f97c303ebd rights for Admin and Proxy. 
Adminrights are OR(old auth or new).
Proxyrights are AND(you need Proxyrights and a not reached Timelimit)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 12:20:08 +00:00
allo
2e1597320f now you can use userDB Users to login 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 11:51:24 +00:00
allo
df147d0fb0 rightsmanagement for upload/download User - preparations for proxy and admin User 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@957 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 11:26:35 +00:00
theli
7256bea45f *) Bugfix for nameLookup parameter handling 
*) Bugfix for Received xx Words [xxxxxxx .. null] Bug



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 05:38:04 +00:00
orbiter
99f4d2931a added options in network picture generation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@952 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 20:18:49 +00:00
allo
e057d5686f fix for translatedIncludes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@951 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 18:56:42 +00:00
theli
40777556c5 *) Connection Tracking 
- adding automatic refresh
   - accepts new parameter nameLookup which can be used to deactivate 
     yacy-peer name lookup (because we have problems with this on large seed-dbs)

*) ViewFile
   New page that can be used to view 
   - original content 
   - plain text content 
   - parsed content
   - parsed sentences 
   of a webpage specified by there url hash
   Mainly for debugging purpose at the moment

*) Robots.txt 
   Bugfix for if-modified-since usage
   TODO: synchronization of downloads to avoid loading the same robots-file 
   multiple times in parallel by different threads

*) Shutdown
   Better abortion of transferRWI and transferURL sessions on server shutdown

*) Status Page
   Adding icon to start/stop crawling via status page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@950 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 07:45:27 +00:00
borg-0300
e642a5d8b7 more constants 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@947 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-17 15:46:12 +00:00
orbiter
6260942590 changed search process: received indexes are now buffered and written to wordIndex after search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@934 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 13:57:15 +00:00
theli
91e676744e *) Temporarily deactivating reverse name lookup for passive and potential yacy peers to avoid blocking requests when calling 
Connections_p.html
   See: http://www.yacy-forum.de/viewtopic.php?p=11271#11271

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@933 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 13:52:17 +00:00
allo
4a8e6d552e invokation with "emailaddress" in Parameter. 
(compatible with other programs than sendmail, like sendxmpp)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@929 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 10:12:10 +00:00
allo
b88a9584f8 New Errorpage 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@928 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 07:47:57 +00:00
orbiter
bc56a88cc8 further refactoring of search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@925 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 00:05:30 +00:00
allo
7ca60f97bf localization Support for Includes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@923 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 12:44:05 +00:00
orbiter
d29dfb0a12 refactoring of search / preparation for better search methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@921 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 12:28:49 +00:00
theli
f02c79273e *) Correcting file header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@917 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 08:40:05 +00:00
theli
c8a35a0130 *) Adding new connection tracking page (currently only for incoming connections) 
*) Displaying statistic for incoming connections on status page
*) Bugfix for Loop-Access Bug when trying to access the yacy page while yacy is configured as proxy
   See: http://www.yacy-forum.de/viewtopic.php?p=6826
*) Bugfix for Referer Bug
   See: http://www.yacy-forum.de/viewtopic.php?p=11098#11098
*) Adding reverse Name lookup for yacy-domain names (used by the connection tracking page)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@916 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 08:17:43 +00:00
orbiter
b80b2fbdcc crawling peers now produce waves in network graphic 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@912 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-11 13:06:07 +00:00
orbiter
10d3627c90 changed word cache flush scheduling and removed possible locks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@910 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-11 07:06:33 +00:00
orbiter
dced5c761e added 'corona' for crawling peers in network graphic 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@909 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 16:21:09 +00:00
orbiter
4cf0d1eb6d less memory occupation in ImagePainter 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@908 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 15:02:53 +00:00
orbiter
aae5af9686 imagePainter may now paint arbitrary large circles; small update to network graphics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@906 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 13:48:25 +00:00
theli
a9e25c26e1 *) adding new sendRespondError method to httpd which accepts a template include file 
for individual error messages

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@902 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:33:09 +00:00
allo
5605cc8018 TimeLimits 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@901 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:21:25 +00:00
orbiter
6a72f06c40 resizable network picture + greater on click 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@900 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:08:28 +00:00
orbiter
839db8869c added high/low priority for index adding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@899 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 09:28:28 +00:00
orbiter
77ae30063d refactoring of websearch process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@893 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 00:32:15 +00:00
orbiter
579b22d8ff small update to network drawing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 23:11:17 +00:00
orbiter
e85989510a update to network image; added disconneced peers by disconnection time and changed colors 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@890 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 17:20:40 +00:00
orbiter
c83594528c integrated crawl stacker into thread control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 15:59:09 +00:00
orbiter
d666b61b83 fix for news-deletion, see also http://www.yacy-forum.de/viewtopic.php?p=11000#11000 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 14:31:35 +00:00
theli
45f55a6fad *) Bugfix for wrong index-queue size displayed on status page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 04:58:09 +00:00
orbiter
c1c94111b0 added new network picture at Network menu using the new image-servlet method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-08 00:37:43 +00:00
borg-0300
a1777788a5 small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@879 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 15:04:03 +00:00
orbiter
d98ed41f31 update to image painter and test on http://localhost:8080/imagetest.png 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 14:17:33 +00:00
allo
f65c939a60 userDB Auth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@874 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 13:49:07 +00:00
orbiter
5153ec0f3e update to image painter 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 01:25:39 +00:00
orbiter
c6f0e35a32 removed notifier.gif; this file is created automatically after startup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 23:12:38 +00:00
orbiter
1b2db0b52a fix for file-share access; damaged some commits before by me :-( 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@870 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 22:30:13 +00:00
borg-0300
f875eda9b7 changed 2, added 5 new picture for more information 
added runtime to the list

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 22:18:44 +00:00
orbiter
1a5d98cd6d better imagePainter example and fix for typo http://www.yacy-forum.de/viewtopic.php?p=10920#10920 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 11:51:35 +00:00
orbiter
06f4ac494a image-painter test; try with http://localhost:8080/imagetest.png 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@864 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:38:16 +00:00
borg-0300
fb27428674 added restart to Status.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:35:05 +00:00
borg-0300
13dd16d1dd small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:00:16 +00:00
borg-0300
5c4db6968e sorted URL list, StringBuffers, finals, cleaned, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@860 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 14:11:50 +00:00
borg-0300
2a18e6486b cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:45:11 +00:00
borg-0300
64acb46a91 cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@857 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:16:53 +00:00
borg-0300
52168fab9b cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@856 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:14:18 +00:00
orbiter
be60b512b7 fix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@855 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 12:24:25 +00:00
orbiter
f6cf3967de fix for compile-bug in svn 583 (Martin guck mal ob das richtig ist: fifo oder filo-stack?) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 12:21:30 +00:00
theli
a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl) 
various checks like the blacklist check or the robots.txt disallow check are now
   done by a separate thread to unburden the indexer thread(s)
   TODO: maybe we have to introduce a threadpool here if it turn out that this single
         thread is a bottleneck because of the time consuming robots.txt downloads

*) improved index transfer
   The index selection and transmission is done in parallel now to improve index 
   transfer performance.
   TODO: maybe we could speed up performance by unsing multiple transmission threads in 
         parallel instead of only a single one.

*) gzip encoded post requests
   it is now configureable if a gzip encoded post request should be send on
   intex transfer/distribution

*) storage Peer (very experimentell and not optimized yet)
   Now it's possible to send the result of the yacy indexer thread to a remote peer 
   istead of storing the indexed words locally. 
   This could be done by setting the property "storagePeerHash" in the yacy config file
   - Please note that if the index transfer fails, the index ist stored locally.
   - TODO: currently this index transfer is done by the indexer thread. 
     To seedup the indexer
     a) this transmission should be done in parallel and
     b) multiple chunks should be bundled and transfered together


*) general performance improvements  
   - better memory cleanup after http request processing has finished
   - replacing some string concatenations with stringBuffers
   - replacing BufferedInputStreams with serverByteBuffer
   - replacing vectors with arraylists wherever possible
   - replacing hashtables with hashmaps wherever possible
   This was done because function calls to verctor or hashtable functions
   take 3 time longer than calls to functions of arraylists or hashmaps.
   TODO: we should take a look on the class serverObject which is inherited from hashmap
         Do we realy need a synchronization for this class?
   TODO: replace arraylists with linkedLists if random access to the list elements is not needed

*) Robots Parser supports if-modified-since downloads now
   If the downloaded robots.txt file is older than 7 days the robots parser tries to
   download the robots.txt with the if-modified-since header to avoid unnecessary downloads
   if the file was not changed. Additionally the ETag header is used to detect changes.

*) Crawler: better handling of unsupported mimeTypes + FileExtension

*) Bugfix: plasmaWordIndexEntity was not closed correctly in 
   - query.java
   - plasmaswitchboard.java

*) function minimizeUrlDB added to yacy.java 
   this function tests the current urlHashDB for unused urls
   ATTENTION: please don't use this function at the moment because
              it causes the wordIndexDB to flush all words into the
              word directory!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 10:45:33 +00:00
orbiter
01db66dc69 implemented image-servlets. the imagetest will stay there only for a limited time. Now images can be generated on-the-fly from servlets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 08:40:20 +00:00
borg-0300
a9c466ef21 cleaned, finals, StringBuffer, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@849 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-04 17:51:32 +00:00
orbiter
0c3a20d44f more + changed log for better understanding of outOfMemory bug and others 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@846 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-04 00:28:59 +00:00
borg-0300
d8544e8416 cosmetic 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@844 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-03 23:13:41 +00:00
allo
0cb9566546 HTML for last Commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@840 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-03 12:23:20 +00:00
allo
8d871a6a79 delete Function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@839 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-03 12:17:12 +00:00
allo
7df4c85506 bugfix & cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@838 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-03 11:51:12 +00:00
borg-0300
f58cfbf9a8 passive red to yellow changed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@833 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-01 14:24:59 +00:00
allo
252492d031 update User 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@832 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-01 13:34:13 +00:00
borg-0300
1b61b674db changed method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@831 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-01 11:43:48 +00:00
borg-0300
2d481e89df Michael would like it 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@829 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 16:06:42 +00:00
allo
60fc32ffeb load values 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@828 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 16:06:20 +00:00
allo
8de3b2dd3c User create function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@825 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 15:25:45 +00:00
allo
ff1d3d0680 Init of userDB 
Pagelayout of User_p.html


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@822 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 13:48:26 +00:00
borg-0300
8d728d742b remove my SVN 818 change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@821 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 13:46:25 +00:00
borg-0300
a3bb20ca88 New column Info replaced Type, Contact and accept Crawl/Index; 
11 new pictures show the information in 11x32 pixel;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@818 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 13:03:36 +00:00
theli
1d1b8f699e *) Extending proxy autoconfig to avoid problems with multiple local network cards 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@816 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-30 07:47:28 +00:00
low012
394fb5d484 *) Small changes that make entering values much easier for people who use the TAB-key to navigate through the page or who use textbowsers like lynx. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@814 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-29 20:17:10 +00:00
borg-0300
138d218d5b all big number have now separators (not Last Seen); 
used dot instead of comma;
used yacySeed.constants;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@812 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-29 13:10:59 +00:00
orbiter
9c4306e41e fixed problem with htcache path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@811 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-29 00:24:09 +00:00
orbiter
25a59a51ad fixed problem created with last svn commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@810 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 23:16:00 +00:00
orbiter
0054d3b1a6 added age in network menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@809 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 22:54:31 +00:00
orbiter
3dd7e90cdd kbytes instead of bytes in performance settings; new default values 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@808 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 18:53:41 +00:00
orbiter
2c7b490e30 memory-logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@804 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-28 00:52:54 +00:00
allo
ee347364d9 basic xhtml/css layout 
-to test, replace #[he4ader]# with #[xhtml-header]#, #[footer]# with #[xhtml-footer]# and use the xhtml-style css


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@803 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 20:13:34 +00:00
orbiter
7fc822a59b changed handling of time-zones 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@801 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-27 16:28:55 +00:00
orbiter
3c1d968d29 fix-fix for 792 and small changes in ftpc/download/dir experiments 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@797 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 10:36:42 +00:00
orbiter
dc474aa22f various bug-fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@792 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-26 01:10:41 +00:00
(no author)
1aa79f5bb5 cleaned; 
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@790 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 11:58:17 +00:00
orbiter
694226d4b1 typo 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@789 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 00:40:52 +00:00
orbiter
3fcc95a82c integrated crawl-profiles db in memory-performance monitor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@788 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-24 00:33:27 +00:00
theli
fe6a6abc0b *) Adding robots.txt db to Performance Settings for Memory menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@785 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-23 01:31:29 +00:00
orbiter
68d5ff2ef1 added stringbuffer in condenser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@782 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:43:45 +00:00
theli
c42a543bc3 *) Adding peername to logmessage when receiving URLs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@781 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 23:40:03 +00:00
orbiter
495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@774 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:01:26 +00:00
theli
1dc94e7753 *) Adding support for gzip content-encoding of http post requests 
used to transferRWIs and transferURLs.
   See: http://www.yacy-forum.de/viewtopic.php?t=1167#10020

*) adding yacyVersion.java containing constants defining yacy versions
   that support a given feature.
   Needed to determine if a remote peer is able to decode gzip 
   content-encoded http post bodies properly.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@772 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 10:30:55 +00:00
orbiter
e6b9b23290 configuration of startup-memory in webinterface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@771 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 01:17:49 +00:00
orbiter
07f30931ec various configuration options in memory performance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@763 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 14:21:45 +00:00
orbiter
2f732e32a2 enhancements to memory menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@762 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 12:21:01 +00:00
borg-0300
150bd33591 finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@761 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 10:48:46 +00:00
orbiter
e17df64b54 removed IS_ADMIN - feature. This was covered by plasmaSwitchborad.adminAuthenticated 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@760 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 09:22:01 +00:00
orbiter
b5337a122c some more information about available memory in PerformaceMemory menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@759 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 00:12:37 +00:00
orbiter
96a5b6e8fb removed yacy peer types from serverSwitch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@758 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 23:15:33 +00:00
orbiter
71a31f0902 integrated and extended new memory performance menu; found and fixed bug in DHT caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@752 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 10:54:20 +00:00
orbiter
fb52a82008 added new performance page for memory settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-20 10:10:34 +00:00
low012
0f1bbff459 *) Tiny little job of cleaning up. (Was man nicht im Kopf hat, hat man in den Fingern...) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@750 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 20:42:53 +00:00
low012
4dbc871524 *) Trying to get rid of possibility of exploits in IndexCreate* through HTML and JavaSkript in peernames, URLs, <title>-tags etc. (see http://www.yacy-forum.de/viewtopic.php?t=1181) I hope I got them all and did not overdo it. 
*) Just a tiny bit of cleanig up in News.java. (I messed it up myself some time ago.)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@749 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 20:36:29 +00:00
borg-0300
effbf35f57 finals; 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@746 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 23:07:29 +00:00
borg-0300
11e175630b StringBuffers, finals; 
cleaned;
Properties;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@745 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 15:23:01 +00:00
borg-0300
22ffde70dd more Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@744 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-18 15:18:51 +00:00
borg-0300
5543ea08ad sorted directory/file list; 
dont list responseHeader.db;
StringBuffers, finals;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@739 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-16 20:28:07 +00:00
borg-0300
d06aa558f5 back to 731 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@736 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 23:47:55 +00:00
orbiter
50a9500035 fixed 100% CPU bug with news queue deletion 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@735 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:51:41 +00:00
borg-0300
f50d45678e better values for BIG directory's 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:41:24 +00:00
borg-0300
650764ce62 sorted directory/file list; 
dont list responseHeader.db;
StringBuffers, finals;
cleaned;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@733 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 22:24:46 +00:00
orbiter
51aa6d0b33 fix for performance-problem on CacheAdmiin_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@731 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 21:46:15 +00:00
orbiter
416c126815 fix for a profile = null problem and new monitor in crawl queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@730 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 21:39:37 +00:00
theli
beefddf0e8 *) Adding option which allows to do a Index-Transfer without deletion of index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 07:14:24 +00:00
borg-0300
16c371a385 finals; 
StringBuffer;
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@720 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 11:56:50 +00:00
theli
40925f4fb7 *) Improving complete index transfer performance by automatically increasing size of transfered word chunk 
for fast connections (much similar to normal dht behavior) 
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 10:29:04 +00:00
theli
a62677f761 *) Adding additional logging output for complete index transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@717 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 06:44:38 +00:00
theli
7638b4181b *)Undoing peername sorting 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@716 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-13 05:46:55 +00:00
borg-0300
61d3b23ada replace created with contributed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 22:20:37 +00:00
borg-0300
e0aadfe76e sorted config list (Config_p.html); 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@714 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 21:55:22 +00:00
theli
3c00c5f6c7 *) Complete Index Transfer 
See: http://www.yacy-forum.de/viewtopic.php?p=9622

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@711 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 11:39:32 +00:00
theli
85958e5064 *) IndexControl_p.java: sorting peernames properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@709 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 10:49:35 +00:00
theli
2cb084d426 *) Complete Index Transfer 
See: http://www.yacy-forum.de/viewtopic.php?p=9622

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@707 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-12 10:37:16 +00:00
borg-0300
595ec6faf1 svn keyword test 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@706 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-11 21:03:35 +00:00
borg-0300
fdf38d6559 smaller StringBuffer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@705 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-11 20:41:55 +00:00
borg-0300
0de9245975 big lists, accelerated 20x+; 
cleaned;

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@703 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-11 15:45:57 +00:00
theli
8ba6be1d72 *) Bugfix for "YaCy verzählt sich ..." Bug. 
See: http://www.yacy-forum.de/viewtopic.php?p=9559

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@700 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-11 05:25:13 +00:00
rramthun
5fb898870b Partial bugfix for http://www.yacy-forum.de/viewtopic.php?p=9507 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@692 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-09 17:39:46 +00:00
theli
a2fec3bb1c *) Bugfix for " java.lang.NullPointerException at hello.respond(hello.java:167)" 
See: http://www.yacy-forum.de/viewtopic.php?p=9471

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@685 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-08 20:07:57 +00:00
theli
d666630bad *) Bugfix for Status class not found 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@683 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-07 22:23:53 +00:00
theli
e6338b4390 *) Bugfix for "Error with request: GET http://localpeer:80/IndexDelete_p.ht" 
See: http://www.yacy-forum.de/viewtopic.php?p=8906

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@678 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-07 13:27:38 +00:00
theli
dc85b1021e *) Bugfix of Delete-Indexqueue-Entry, Clear Indexing Queue functionality 
- htcache files will now also be deleted if entry should not be stored into cache

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@667 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-06 08:03:04 +00:00
low012
4557966cdb *) avoiding the possibility of news pages getting messed by HTML in news messages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@658 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:29:54 +00:00
low012
e19ededd66 *) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@657 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-05 10:15:59 +00:00
borg-0300
22adb555de replaced o.compareTo() with o.equals() 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@648 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-04 00:01:09 +00:00
rramthun
966c527966 Improved german translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@647 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-03 16:20:31 +00:00
theli
dc0a2d4c11 *) Bugfix for Loader Queue: 
Job count was not displayed correctly
*) IndexingQueue:
- now it's possible to delete single entries from the queue
- now it's possible to clear the whole queue
  See: http://www.yacy-forum.de/viewtopic.php?t=995

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@641 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-02 11:40:40 +00:00
theli
732a107160 *) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug 
- Logging message for "urlEntry.url() == null" is now displayed as info
   - IndexCreateWWWLocalQueue_p.html now detects null entries while looping throug the list and removes them automatically
   See: 
   - http://www.yacy-forum.de/viewtopic.php?t=532#8781
   - http://www.yacy-forum.de/viewtopic.php?t=639
   - http://www.yacy-forum.de/viewtopic.php?t=1071
   - http://www.yacy-forum.de/viewtopic.php?t=338
   - http://www.yacy-forum.de/viewtopic.php?t=980

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@640 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-02 09:33:05 +00:00
theli
33aaffbfc6 *) Displaying content size of each entry in indexing queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@639 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-02 08:22:11 +00:00
theli
0471019606 *) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@633 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-01 22:05:20 +00:00
theli
bead8a32aa *) IndexCreate_p.java: 
Crawler StartURLs will now also added to the errorURL-DB if an error occures on this url
*) kelondroStack.java, plasmaSwitchboardQueue.java
   Adding method which returns a list of all entries in the queue. This list is used by IndexCreate_p.java 
   instead of an iterator to display the indexing-list. 
   Advantages: avoid concurrent modifications of the list while displaying it. 
               Speedup because now we have to access only one sync function instead of multiple ones 
               (one for each entry)
*) IndexCreateIndexingQueue_p.java
   Using new list() function of plasmaSwitchboardQueue
*) httpdFileHandler.java
   If a servelet returns the special value "LOCATION" the httpFileHandler does a Redirection of 
   the Browser to the URL specified by the servelet. This can e.g. be used when a http get request is
   used insead of a post request, but a refresh should not be allowed.
*) IndexCreateWWWLocalQueue_p.html
   Now it's possible to delete single entries of the local crawler queue

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@626 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-01 07:52:46 +00:00
theli
66bab602e1 *) Bugfix for "wrong link to IndexDelete_p.html in status text after new crawl job was started" 
http://www.yacy-forum.de/viewtopic.php?p=8827

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@624 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-01 06:39:43 +00:00
theli
3563552bd3 *) Renaming Logger function names to reflect the proper Java Logging API Loglevels 
- please use logFine instead of logDebug
   - please use logSevere instead of logFailure and logError
   See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@616 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 22:05:46 +00:00
theli
4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels 
- please use logFine instead of logDebug
   - please use logSevere instead of logFailure and logError
   See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@615 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 21:32:59 +00:00
theli
6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels 
- please use logFine instead of logDebug
   - please use logFailure instead of logError
   See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@614 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 21:10:39 +00:00
borg-0300
a88e6d3ba2 increase max length 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@612 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 16:31:42 +00:00
borg-0300
eac34cf772 no negative values 
See http://www.yacy-forum.de/viewtopic.php?t=1021

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@611 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 16:28:59 +00:00
borg-0300
904ab7aa39 Bugfix 5.0 to old version 
See http://www.yacy-forum.de/viewtopic.php?t=1064

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@609 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 15:06:59 +00:00
borg-0300
bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing' 
- path now are absolute
*) move path check from plasmaHTCache to plasmaSwitchboard
   - only one path check when starting
*) small other

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@606 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 12:50:30 +00:00
borg-0300
3c1e105009 *) smaller file, save 9 kb 
*) rename the old file to *.bak

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@599 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 23:17:27 +00:00
borg-0300
578b0c525c *) test: first 'Commit' 
*) added notifier.gif
   See: http://www.yacy-forum.de/viewtopic.php?t=1029

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@598 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 22:57:58 +00:00
low012
cc26779aeb *) fixed broken link problem in profile. see http://www.yacy-forum.de/viewtopic.php?t=964 for details 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@597 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 21:09:41 +00:00
theli
a812fb86cc *) Port Forwarding Feature does not detect broken connection properly. 
Therefor a test-request was added to the isConnected function to detect broken connections
   and to keep open connections alive


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@596 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-29 11:39:10 +00:00
allo
b778493aae publicIP() fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@593 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-28 18:05:17 +00:00
allo
0d912a3de9 removed not needed copyFile Method. 
(same exists in Skins_p.java (there its used))


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@585 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-24 13:05:47 +00:00
theli
e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup 
See: http://www.yacy-forum.de/viewtopic.php?p=8349

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@584 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-24 09:34:04 +00:00
theli
17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed" 
See: http://www.yacy-forum.de/viewtopic.php?t=965&highlight=ramdisk
*) Making ACCEPT_LANGUAGE configureable for crawler
   See: http://www.yacy-forum.de/viewtopic.php?p=8327

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@583 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-24 07:47:42 +00:00
theli
cf03c139e7 *) Adding missing include file for splitted status page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@582 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 19:17:25 +00:00
theli
858cb983d7 *) Printout date and system name on proxy error page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@581 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 11:32:36 +00:00
theli
b2d48ebcef *) Splitting Status Page into Private and Public Informations 
*) Adding Queue overview to status page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@576 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 08:27:37 +00:00
theli
cb97d2972e *) Bugfix for "peer not accessible via .yacy name if Transparent Proxy Support is enabled" bug 
See: per Browser nicht erreichbare Peers

*) Proxy Error Page now displays the Peer Name on top

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@575 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-23 07:27:58 +00:00
theli
330eae7cf3 *) Normalizing CrawlerStartURL now before crawling is started 
*) CrawlWorker also does a URL normalization now before following the redirection URL
*) CrawlWorker removes redirection URL correctly from noticeURL stack now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@571 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-21 22:52:46 +00:00
orbiter
c47bb1182d bugfix for assortment initialization error 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@547 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 11:43:14 +00:00
rramthun
c3e1abffaf Small changes for 0.40 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@544 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 09:37:37 +00:00
low012
d242cf7a6d added a Preview button to yacyWiki 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@543 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 01:19:29 +00:00
orbiter
25f632dbd9 more DHT bugfixes and better logging of DHT effects 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@542 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-16 00:31:15 +00:00
orbiter
dbba052331 removed internal addres presentation in interface according to http://www.yacy-forum.de/viewtopic.php?p=6779#6779 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@541 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-15 18:45:18 +00:00
orbiter
5cb00889d9 enhancements to dht selection, search and search presentation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@540 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-15 01:12:25 +00:00
orbiter
ba0a486328 moved printStackTrace() to logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@539 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-14 23:35:18 +00:00
rramthun
ea780a7afc Additions to the language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@537 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-14 20:16:52 +00:00
orbiter
8d6c288f04 display of peer name in headline; see http://www.yacy-forum.de/viewtopic.php?p=7466#7466 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@535 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-14 15:45:48 +00:00
rramthun
28bf20608b Converted standard content-charset for HTMl pages to UTF-8 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@533 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-14 14:01:19 +00:00
orbiter
cd10370992 several bugfixes and dht selection / logging improvement 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@531 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-14 00:57:30 +00:00
rramthun
da81dcd66a Corrected regex-tutorial... 
Wenn noch was falsch ist, einfach korrigieren.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@528 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-13 10:21:22 +00:00
orbiter
ed978c8564 added words; see http://www.yacy-forum.de/viewtopic.php?p=7349#7349 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@525 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 22:35:21 +00:00
orbiter
7db543a9fa fixes for several dht misbehaviours 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@524 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 22:14:24 +00:00
rramthun
20002b6386 Added Regex tutorial to Help.html, because many people don't understand Regex. 
Added german translation for Regex tutorial. 
Added bold and underline to bbCode.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@522 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 20:16:38 +00:00
orbiter
5716f8521d bug fixes for word ordering and dht index selection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@521 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 14:06:47 +00:00
theli
41cd5e930a *) Adding missing Template for SOAP API 
http://www.yacy-forum.de/viewtopic.php?t=169

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@520 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 06:19:59 +00:00
allo
a223faace1 not recursive, but it should work on Windows. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@516 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-11 09:23:46 +00:00
allo
ee0a9a2d9b recursive Translations. 
You can now translate the Menu and other things in subfolders, too


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@508 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-09 14:27:18 +00:00
orbiter
ec07928807 faster listing and news aging enhancement 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@505 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-08 18:05:43 +00:00
allo
53dcbadfbf using Wikicode instream of bbCode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@504 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-07 17:56:44 +00:00
allo
8659a689f4 seperate Class for the wikiParser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@500 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-06 17:03:12 +00:00
theli
865b9490a2 *) Making DHT Transfer while Crawling configurable 
See: http://www.yacy-forum.de/viewtopic.php?p=6904

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@496 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-06 11:40:12 +00:00
theli
0610e83468 *) Bugfix. recipient peer was accidentally displayed as source peer of a url transmission. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@495 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-05 21:37:59 +00:00
rramthun
0211c4f297 Added scripts for Windows ME and 98 as requested in http://www.yacy-forum.de/viewtopic.php?t=839. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@494 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-05 18:18:50 +00:00
orbiter
bb3e897baf mor minor changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@488 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-03 13:43:55 +00:00
orbiter
2d8557cb10 minor changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@487 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-03 02:02:39 +00:00
rramthun
eacff63eda Typos... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 16:09:19 +00:00
theli
228b04b499 *) Bugfix for "wrong seed-upload timestamp" problem 
http://www.yacy-forum.de/viewtopic.php?t=817

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@480 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 15:36:10 +00:00
rramthun
34f449e6f1 Added description of the "one character links" 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@479 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 15:25:46 +00:00
low012
77f4a3d99d yacyWiki now supports the [[Image:]] tag 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 14:22:55 +00:00
theli
470839a16a *) Crawler/Session pool settings will now be stored properly into configfile 
Bugfix for:
- http://www.yacy-forum.de/viewtopic.php?t=502
- http://www.yacy-forum.de/viewtopic.php?t=778

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@477 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 12:20:03 +00:00
orbiter
e84a177c49 many bigfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 02:18:01 +00:00
orbiter
9ee8a5ba6c fixed big in yacynews 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 00:50:20 +00:00
orbiter
083c8ddc69 new alert symbols 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-02 00:16:19 +00:00
orbiter
93811dc6e0 wiki-update-marked entries in network now link to the updated wiki page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@471 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 13:47:18 +00:00
orbiter
e9bfa80050 integrated Wiki to Main Menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 13:29:57 +00:00
orbiter
bcc292ad12 added self-news; added news in case of wiki update; added crawl announcement on Network page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@469 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 12:47:47 +00:00
orbiter
5157159281 update of links 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 10:31:44 +00:00
orbiter
d34eb23e4e fixed news; added news appearance on Network and IndexCreate page; added intention string to global crawl 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@466 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-01 01:12:02 +00:00
orbiter
5672709ef3 several bugfixes for YaCyNews 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 14:59:31 +00:00
orbiter
e24dbde217 better logging for WRONG seed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@463 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 11:11:29 +00:00
theli
41be998391 *) Removing confusing colon 
See: http://www.yacy-forum.de/viewtopic.php?p=6305

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@462 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 05:11:23 +00:00
orbiter
1022fbeb65 many YaCyNews fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@461 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-31 01:54:46 +00:00
orbiter
13abd8b6e7 added news-creation at crawl start 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 11:57:19 +00:00
rramthun
f555b9d5f2 Translation, spelling... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 11:11:32 +00:00
orbiter
849b194149 fixed news receipt and added processing buttons on News page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@458 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-30 07:15:39 +00:00
orbiter
f65dd694a1 integrated news service: update of profile 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@456 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 15:14:48 +00:00
orbiter
60117a2073 integrated YaCyNews basis 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@455 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-29 14:10:19 +00:00
rramthun
b99205e445 Translation, spelling... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@448 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-28 13:30:11 +00:00
low012
515d6c00eb Fixed a typo and changed the order of some words. (Sounds better to me now.) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@446 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 22:52:46 +00:00
orbiter
0174df12af deny of global search in case DHT is switched off 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@445 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 22:52:29 +00:00
orbiter
81e564edb8 faster crawl profile list cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@442 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 14:16:47 +00:00
orbiter
e5a63c3c70 cleaned up search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@441 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 13:59:53 +00:00
orbiter
85877413a0 tried to fix principal bug .. not succeeded 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@440 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 13:38:46 +00:00
orbiter
2181982ce5 disabled buttons on Status page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@439 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 13:03:42 +00:00
orbiter
ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 12:51:00 +00:00
orbiter
b9d18d40cb configuration of proxy idle time in performance menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@436 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 15:17:29 +00:00
orbiter
3470a72d48 fixed div by zero, set default delays, fixed release number format and display 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@435 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 11:47:50 +00:00
allo
12da0c2758 http://www.yacy-forum.de/viewtopic.php?p=5645#5645 
the line with ??? does not work...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@434 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-26 10:26:35 +00:00
allo
89e9e467d2 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@433 6c8d7289-2bf4-0310-a012-ef5d649a1542 2005-07-25 21:46:30 +00:00
allo
45378323c3 stupid mistake 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@430 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-25 09:52:48 +00:00
allo
fc83032579 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@428 6c8d7289-2bf4-0310-a012-ef5d649a1542 2005-07-23 21:24:29 +00:00
orbiter
be1f324fca performance setting for remote indexing configuration and latest changes for 0.39 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@424 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-22 13:56:19 +00:00
rramthun
69afae514d Updated translations... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@422 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-21 15:42:06 +00:00
orbiter
c64970fa47 re-implemented proxy-busy-check and fixed some other things 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@421 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-21 11:17:04 +00:00
orbiter
86d778f7bc default-button in profile menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@419 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 17:08:58 +00:00
orbiter
b6d32f7f89 bugfix performace-menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@418 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 16:20:14 +00:00
orbiter
b73557ed2d better assortment monitoring and enhanced profile menue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@416 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 13:03:41 +00:00
allo
e16e4ba32b staticIP/DynDns Settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@414 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 08:53:47 +00:00
orbiter
a2cf76ea7c bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@413 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-20 01:36:28 +00:00
rramthun
25a7d4c982 Finished translation of status.html into german. I hope I forgot nothing... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@410 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 19:26:57 +00:00
rramthun
0f11399d16 Some corrections... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@409 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 16:07:13 +00:00
orbiter
9f505af7aa preparations for bulk remote crawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@408 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-19 00:26:31 +00:00
orbiter
0f663bcebf added global ppm computation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@407 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-18 15:22:14 +00:00
orbiter
51962d55bf added 'PPM', page-per-minute statistics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@405 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-18 00:44:51 +00:00
orbiter
c47736a158 configuration of number of output lines in IndexMonitor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@402 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 15:55:25 +00:00
orbiter
19dbed7cc8 code clean-up 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@401 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 15:09:35 +00:00
orbiter
40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-12 00:07:09 +00:00
orbiter
311e627363 blocking of blacklisted urls in indexReceive and small changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-11 15:36:10 +00:00
theli
13eeaa08f3 *) httpc.java: 
- Now it's possible to interrupt pending httpc-actions on server shutdown  
   - this is possible because of a newly introduced registration mechanism for
     open sockets
*) yacyCore.java
   - blocking peerPing threads can now be interrupted on server shutdown
*) serverCore.java
   - restructuring shutdown code 
*) error.html
   - port number is now set correctly if port forwarding was enabled


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@389 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 13:58:54 +00:00
theli
5c3822d5f4 *) adding experimental support for parsing of bookmarksfiles 
See: http://www.yacy-forum.de/viewtopic.php?t=177

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@388 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 13:41:56 +00:00
orbiter
419f8fb398 fixed bugs/missing code regarding new crawl stack 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-07 01:38:49 +00:00
orbiter
858cd94299 replaced indexing ram-queue by file-based stack-queue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-06 14:48:41 +00:00
allo
4851b432e1 nice Version display(without svn rev added) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@380 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-05 13:43:48 +00:00
orbiter
252c6e4869 added crawl queue monitor for global crawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@372 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 15:07:33 +00:00
rramthun
e2d8766fa7 Nearly finished translation of Status.html... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@371 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 13:08:17 +00:00
orbiter
9a3f80403e redesigned IndexCreate menu -- introduced submenues to enable more crawl queue control pages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@370 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 12:42:29 +00:00
theli
0e2c33ee55 *) Network.html/Network.java: 
- Adding function to manually force peer ping to remote yacy peer
  See:Network.html?page=4
- for debugging purpose only!

*) serverAbstractThread.java:
- Adding posibility to notify a server thread via a synchronization object
- this is needed e.g. by the port forwarding feature to send a notification
  to the peerPing thread to redo peer-ping with the new ip/port Settings_p.html

*) Port Forwarding Feature (it should work now)
- adding a serverThread which is responsible to detect broken port forwarding 
  connections and to do reconnect if needed
- serverCore.java: moving port forwarding initialization into a separate function
- adding positility to configure the ssh port 
- moving configuration section on the gui into a separate fieldset
- hello.java: only trying to do a second connect to the clientIp address during
  peer handshake if either remote port forwarding is not enabled locally or
  the clientIP is not equal to any local ip

*) httpdFileHandler.java:
- printout a more verbose errormessage

*) httpc.java
- allowing to deactivate content encoding from outside


 

*) plasmaCrawlWorker.java
- the crawler worker now tries to refetch the content of a website without
  gzip content encoding if a gzip error occured



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@368 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-04 11:09:48 +00:00
orbiter
5159a090b0 fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@367 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 23:33:25 +00:00
rramthun
377e94f30e The usual stuff... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@366 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 19:47:53 +00:00
orbiter
fbef7fed81 adopted latestVersion to float handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@363 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-03 12:40:36 +00:00
rramthun
f32ce64789 Began translation of status-page... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@361 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-02 20:02:17 +00:00
orbiter
eb74fa0c82 fixed a bug with snippet-length 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-01 23:35:36 +00:00
rramthun
1a75762897 Translation... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@357 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-01 12:29:31 +00:00
allo
8290969150 Automatic regeneration of Locales on Restart with a new (SVN) Version 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@353 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 20:30:05 +00:00
allo
129929b396 Preparations for automatic Languagefile upgrade on new YaCy Version. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@352 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 19:39:19 +00:00
rramthun
35c7a5883b First update of german language file + corresponding changes in HTML-file. Many will follow... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@349 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 18:26:10 +00:00
allo
bef3aaec38 better Translationsystem. 
You only need to escape Chars, which have special meanings in regexps.
some you have to escape: ()[]{}


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-30 15:28:40 +00:00
orbiter
712fe9ef18 bugfixed utf-8 decoding and parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@346 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 22:55:37 +00:00
allo
63f9570d3a bbCode 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@344 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 21:03:04 +00:00
theli
ec397c343c *) Allowing longer forwarding commands 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 13:07:05 +00:00
theli
d50ad1521a *) correcting logging statement 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@335 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 11:08:47 +00:00
rramthun
8718795c6d Using theli's anchors on Status.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@334 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 10:53:34 +00:00
theli
9d8c66fb5e *) adding possibility to forward received yacy-messages (htroot/yacy/message.java) 
via a command-line email program (e.g. sendmail) to a configured email address
   - the configuration dialog is reachable via Settings_p.html#messageForwarding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 09:50:48 +00:00
low012
24d77b892f This changes eliminate a way to cripple Profile pages on other peers by sending special messages with HTML tags. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@331 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-29 08:22:04 +00:00
rramthun
dbd06eace9 Used "id" tags instead of <a name="XXX">XXX</a>. 
This avoids links without target, which change colour on mouseover, but are not clickable. (<-- Das Wort gibt es bestimmt nicht...)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@330 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 18:28:37 +00:00
theli
08e4334c1d *) Status.java: showing amount of time since last upload of seed-file 
*) hello.java: adding additional output for principal-downgrade bug
*) httpd.java, httpdFileHandler.java, httpdProxyHandler.java: improved errorhandling
*) yacyCore.java: trying to fix principal-downgrade bug
*) yacySeed.java: adding some constants

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-28 11:27:31 +00:00
low012
a333715ffd This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@325 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-27 19:52:40 +00:00
theli
aad2268751 *) adding menue to top of configuration pages 
- IndexCreate_p.html
- Settings_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@324 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-27 09:59:58 +00:00
orbiter
3addf58046 enhanced snippet-loading with threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-24 07:41:07 +00:00
orbiter
56d28a16f0 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 14:40:39 +00:00
theli
d53b2393e5 *) autoconfig.java: ip address was not reported correctly when port-forwardin is on 
*) hello.java: reportedip my be empty at peer startup
*) httpc.java: adding method to determine if the connection was already closed or is broken
*) httpdProxyHandler.java: trying to do a better errorhandling
*) server/serverCore.java
- setting myseed ip-address and port correctly if port-forwarding is on
- doing a more failsafe close and adding some debugging output
*) yacyClient.java: adding some logging statements to allow a better detection of 
   "degraded to senior"-bug
*) yacyCore.java: restructuring publishMySeed
   (@Orbiter: pleas take a look)
- to avoid buzy waiting
- to allow a gracefull shutdown on server shutdown
- new seed count was not calculated correctly in the previous version
*) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding
   was activated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@318 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 11:00:26 +00:00
theli
933256bbfc *) adding href's to allow direct access to the currently crawled website 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@317 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 10:11:26 +00:00
theli
83ceec3a63 *) Bugfix for wrong "Statusanzeige" 
See: http://www.yacy-forum.de/viewtopic.php?p=4560

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@314 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 07:23:40 +00:00
orbiter
1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 02:07:45 +00:00
theli
dc1d707eb2 *) Deactivating "Port Forwarding Feature" for a while because of too many problems at the moment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@312 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-21 08:22:03 +00:00
low012
afe7cbe4de just a typo... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@310 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-21 00:53:04 +00:00
low012
10f6f19c08 Fixed one typo and added a few options to handle messages when messages get displayed. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@309 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 23:35:42 +00:00
rramthun
cf171ca35d Some corrections to the webinterface... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@306 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 16:19:13 +00:00
orbiter
85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@303 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-20 00:46:23 +00:00
orbiter
10781f36b7 changed performance menu to accept milliseconds; 200 milliseconds may be appropriate for all crawling jobs; indexing should be set to 0 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@299 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 11:52:21 +00:00
theli
3227a9eba5 *) Adding retry function for seed uploading 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@298 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 08:45:44 +00:00
theli
aea355c03c *) adding test for connection status of port forwarding feature 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@292 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 07:57:00 +00:00
orbiter
5d06ded005 enhanced html parser speed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@290 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-17 01:26:51 +00:00
orbiter
5a490aa065 fixed html parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@289 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 21:49:56 +00:00
orbiter
a25b5b4986 fixed possible memory leak in htmlScraper: be aware that now links can get lost; further work necessary 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@288 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 18:31:28 +00:00
orbiter
38747857c2 correction of correction to port-forwarding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@287 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 11:49:54 +00:00
orbiter
dbda6e1e85 corrections to port forwarding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@286 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 11:40:36 +00:00
theli
d8cb3324a9 *) property "mytime" was not set correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@285 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 11:22:20 +00:00
theli
b2c5305737 *) Bugfix: Uptime Uptime #minutes (kosmetisch) 
See: http://www.yacy-forum.de/viewtopic.php?p=4294

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@283 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 10:09:13 +00:00
theli
9a98988c3c *) Bugfix for SSL/NIO Bug 
See: http://www.yacy-forum.de/viewtopic.php?t=516
   - removing NIO from server/serverCore.java because of massive problems
     with socket close issues
*) Adding support for remote port forwarding via sch
   @Orbiter: Please take a look into
   - hello.java
   - server/serverCore.java.publicIP()
   - yacy/yacyClient.java.publishMySeed(...)
*) Making startup loading of additional content parsers more failsafe


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@281 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 07:28:07 +00:00
orbiter
a1ffc27041 preparations for image/movie/music indexing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@280 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-16 00:31:13 +00:00
orbiter
f45dc29f35 maintenance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@279 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-15 14:59:53 +00:00
theli
a2e5018427 *) adding missing calls for function close() to avoid "too many open file" bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@273 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 09:56:41 +00:00
theli
3ee35b9ff9 *) Proxy-Error-Msg: align=center 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 09:54:36 +00:00
theli
c7d294d8d4 *) Bugfix for: 
- 302 redirection Problem on Amazon Server
   - Wrong References in proxymsg/error.html
   See: http://www.yacy-forum.de/viewtopic.php?t=515

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-13 07:50:35 +00:00
orbiter
878ff0ae7b corrections 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 16:39:25 +00:00
theli
a566588e9b *) adding configuration section for new http keep-alive support 
*) moving transparent proxy configuration into new config section


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@238 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:44:07 +00:00
theli
6bde37950f *) adding xsl stylesheet that can be used by browsers to format the rss search result in a user friendly format 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@237 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:36:44 +00:00
theli
e302c50390 *) Changes needed because of logging migration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@236 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:34:44 +00:00
theli
f9a95b5cb8 *) Displaying more user friendly Memory Usage statistic 
*) Displaying traffic consumed by yacy 
   - this is not finished yet
   - at the moment only outgoing proxy traffic is counted

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:33:15 +00:00
theli
f8de2556f8 *) Changes needed to allow a move verbose error message 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@234 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-09 09:29:35 +00:00
orbiter
33f9315e58 implemented multithreading of indexing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@221 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 13:19:05 +00:00
allo
7c318f8886 Language files, not skins... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@220 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 11:05:04 +00:00
theli
52cf732fad *) correcting "seed-ftp-upload/Nothing changed" bug: 
See: http://www.yacy-forum.de/viewtopic.php?p=3986#3986

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@219 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 09:54:52 +00:00
orbiter
ca3b4ccaf4 added snippet-routines (not yet finished) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@218 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-08 00:52:24 +00:00
orbiter
a73e6de005 faq/doc - Fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@215 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-07 09:28:45 +00:00
theli
9af1bf4b38 *) displaying memory usage of yacy in Status.html 
*) displaying more expressive uptime information on Status.html and Network.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@214 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-07 09:05:21 +00:00
orbiter
ee0758fe4d bugfixes/empty-dir-deletion/snippet-test-activation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-07 01:05:55 +00:00
orbiter
594c591223 changes towards 0.38 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-03 02:43:35 +00:00
orbiter
d8fdc2526e added experimental snipplet-generation (to be disabled for 0.38) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@206 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-02 01:33:10 +00:00
orbiter
e89ded9e41 bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@204 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 22:12:43 +00:00
orbiter
650ca3955a added flush-thread for index cache and added language-name mapping in Language_p 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@203 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 17:39:14 +00:00
rramthun
ec77e6faa6 updated german language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@201 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-30 18:19:04 +00:00
rramthun
4e63456dba some corrections/enhancements to the webinterface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@198 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-29 18:23:58 +00:00
orbiter
3d8a2ff937 enhanced parallelization of local/global/remote crawling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@197 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-29 11:56:40 +00:00
allo
8ab021b39f Your-Peer Stats added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@185 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-28 11:07:08 +00:00
allo
c6331cf088 "Comma separated Values File" for the Network Overview Page. 
http://www.yacy-forum.de/viewtopic.php?t=4


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@184 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-28 10:45:42 +00:00
allo
7de98b1895 Deleted static locales because they conflict with the dynamic ones. 
use Language_p.html and $rootdir/locales/*.lng to generate locales in htroot/locales


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@178 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 14:08:22 +00:00
allo
a8b2dccc7a New Translation System. 
Use Wordlists like these:
de.lng
Network\ Overview=Netzwerk-Übersicht


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-26 10:26:32 +00:00
orbiter
21110dcd5e fixed bugs with open files and caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-25 13:48:48 +00:00
theli
74eb21f62e *) adding image tag into rss template 
*) adding a xslt stylesheet so that the rss document can be viewed in a normal webbrowser
*) adding pubDate tag to each search item

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@173 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-25 08:47:34 +00:00
orbiter
6f09251bbc added peer-Name settings to Settings page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@172 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-24 15:47:50 +00:00
orbiter
5f90daa265 implemented localization environment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@171 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-24 14:23:04 +00:00
theli
6cc4297761 *) adding namespace for yacy topwords feature 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@170 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-24 09:29:10 +00:00
orbiter
73922f3501 experimental topword-intergartion in rss 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@167 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 21:59:57 +00:00
allo
6af3744a0b http://www.yacy-forum.de/viewtopic.php?p=3368 fixed: 
Newlines are now converted correctly.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@166 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 20:21:58 +00:00
allo
6ee564c482 a really simple Interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@165 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 18:44:12 +00:00
orbiter
76dc892017 refined assortment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 13:15:28 +00:00
theli
0e1d9e9722 *) shrinking httpc linebuffer when httpc is returned to pool. This is done to free memory 
*) Making Seed-Upload configuration more verbose.
*) Some Changes in SOAP Search API (not finished yet).

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@158 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 10:10:51 +00:00
theli
b625aa91fd *) Trying to solve Seed-Upload-Configuration - "Error with submitted information. Nothing changed." Bug: 
see: http://www.yacy-forum.de/viewtopic.php?p=3233

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@157 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-23 09:12:20 +00:00
orbiter
4b01ff7548 activated assortments, removed write-queues 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@151 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-22 23:59:52 +00:00
orbiter
e26ac60c3e modified assortment data structures 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@148 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-22 13:27:54 +00:00
rramthun
377fb07250 Used YaCy logging class instead of stdout 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@147 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-21 21:33:58 +00:00
rramthun
85e7c31a57 Fixed a spelling mistake 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@145 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-21 18:37:23 +00:00
rramthun
76475f9f38 Fixed various spelling mistakes... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@144 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-20 20:12:33 +00:00
rramthun
bfff0a96a7 Fixed some spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@143 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-19 18:47:03 +00:00
low012
71b9cb0c33 Just making it look like it is supposed to in Opera too. (Opera makes a difference between center and middle which most browsers don't.) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@138 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 20:42:34 +00:00
rramthun
01fb4e4eb9 Fixed problem described in http://www.yacy-forum.de/viewtopic.php?t=377 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@135 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 12:35:58 +00:00
theli
042f171022 *) Correcting problems with old seed configuration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@133 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-18 07:46:34 +00:00
orbiter
dfde28a244 changed kaskelix mascot 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@130 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-17 23:27:50 +00:00
theli
361f05978d Multiple updates regarding the yacy seedUpload facility, 
optional content parsers, thread pool configuration ...

Please help me testing if everything works correct.

*) Migration of yacy seedUpload functionality
See: http://www.yacy-forum.de/viewtopic.php?t=256
- new uploaders can now be easily introduced because of a new modulare uploader system
- default uploaders are: none, file, ftp
- adding optional uploader for scp
- each uploader provides its own configuration file that will be 
  included into the settings page using the new template include feature
- Each uploader can define its libx dependencies. If not all needed libs are
  available, the uploader is deactivated automatically.

*) Migration of optional parsers
See: http://www.yacy-forum.de/viewtopic.php?t=198
- Parsers can now also define there libx dependencies
- adding parser for bzip compressed content
- adding parser for gzip compressed content
- adding parser for zip files
- adding parser for tar files
- adding parser to detect the mime-type of a file
  this is needed by the bzip/gzip Parser.java
- adding parser for rtf files
- removing extra configuration file yacy.parser
  the list of enabled parsers is now stored in the main config file

*) Adding configuration option in the performance dialog to configure
See: http://www.yacy-forum.de/viewtopic.php?t=267
- maxActive / maxIdle / minIdle values for httpd-session-threadpool
- maxActive / maxIdle / minIdle values for crawler-threadpool

*) Changing Crawling Filter behaviour
See: http://www.yacy-forum.de/viewtopic.php?p=2631

*) Replacing some hardcoded strings with the proper constants of the httpHeader class

*) Adding new libs to libx directory. This libs are
- needed by new content parsers
- needed by new optional seed uploader
- needed by SOAP API (which will be committed later)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@126 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-17 08:25:04 +00:00
theli
014b139c73 *) Bugfix of "There are xxx entries in the crawler queue. Showing 0 most recent entries" Bug. 
see: http://www.yacy-forum.de/viewtopic.php?t=338
   see: http://www.yacy-forum.de/viewtopic.php?p=2552

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@122 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-15 10:09:15 +00:00
rramthun
f9c7deca2e Fixed some spelling mistakes and removed underline from accesskey chars 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@121 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-14 13:56:01 +00:00
theli
1d38599598 *) changing comment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@119 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-14 09:50:22 +00:00
theli
d2c4e9a55e *) Implementing yacy forum wishlist item: "Pause Crawling" 
see: http://www.yacy-forum.de/viewtopic.php?t=48



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@118 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-14 09:41:05 +00:00
rramthun
2d751ba831 Fixed a spelling mistake 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@117 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-13 20:43:08 +00:00
orbiter
287d2e6f10 further enhanced caching (new cache flush methods) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@111 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-12 23:33:48 +00:00
rramthun
85c2f3be8a Fixed spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@110 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-12 17:50:45 +00:00
orbiter
ea478f3975 enhanced indexing-caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@107 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-11 23:42:40 +00:00
orbiter
b4030e5023 implemented serverSwitchActions - action-hooks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@105 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-11 14:58:03 +00:00
theli
a5fec449c8 *) setting threadnames for kelondroMap:writequeue and publishSeed 
so that a thread dump is more verbose

*) Moving code for transparent proxy support to a separate function

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@98 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-09 08:53:39 +00:00
theli
74f12bb0f3 *) adding transparent proxy support 
Now a firewall can transparently redirect all 
   http traffic through yacy.
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@96 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-08 22:36:26 +00:00
rramthun
982c3ebeeb Added some accesskeys to webinterface and updated help with some hints on how to use them. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@91 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-08 13:05:30 +00:00
rramthun
6c8e0fdbf5 Made Homepage and eMail clickable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@87 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-07 21:38:14 +00:00
orbiter
1d7fed87dc redesign of index caching - removed indexCache.db 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@86 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-07 21:11:18 +00:00
rramthun
3f85978519 Fixed one spelling mistake, limited input for ICQ numbers to 9 digits and made ICQ number in peer profiles clickable. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@85 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-07 21:07:43 +00:00
theli
e7f7aa0bb9 *) Import statements reorganized 
Now it's easier to determine which class really uses which other class*) Reogranizing Import Statements 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@83 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-05 05:36:42 +00:00
theli
351c86d5d9 *) Migration of optional Content Parser integration 
- each additional parser must be in a subpackage 
  of plasma.parser
- each parser must have its own ant build file (which will 
  be called automatically from the main build file)
- Calling the main build file results in building a separate 
  zip file for each optional parser. This zip file includes:
  + sources of the Parser.java
  + compiled classes of the Parser.java
  + needed additional libs (libx)
- To install an additional parser the user simply needs to
  extract the zip file listed above into his/her yacy directory.
- The configuration (enabling/disabling) of a parser can be done
  via the webinterface (currently the settings dialoge) and is
  done "on-the-fly". The installation can not be done "on-the-fly"
  at the moment because of classpath issues.
- The classpath of the linux startup/stop scripts is generated 
  automatically now (including all libraries from lib and libx).

*) Bugfix: File Extension was not calculated correctly by the crawler
   e.g.: file extension was accidentally: .php?param=value
   Corrected.

*) Adding additional parser for parsing of rss/atom feeds
- added needed libs to do this.

TODO:
- automatic building classpath for windows startup scripts


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@78 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-03 09:47:56 +00:00
orbiter
f99930c04b fixed brute-force + peer-disconnect - Bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@75 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-01 23:31:21 +00:00
orbiter
c7c6aaf06e many bug-fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@73 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-30 01:22:46 +00:00
allo
52abc456fb new Templates 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@70 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-28 19:38:35 +00:00
rramthun
56409402f0 Fixed some spelling mistakes... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@66 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-26 18:10:40 +00:00
rramthun
9cb8779208 Fixed some spelling mistakes... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@64 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-26 15:38:44 +00:00
rramthun
19e69f0efd Changed <head> YACY into YaCy 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@58 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-25 15:34:18 +00:00
allo
4c8cc101d6 Bugfix: Do not shot the first X lines, but the last X line of log 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@57 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-25 15:10:24 +00:00
orbiter
ba16da72b4 fixed not-working kelondroRecords-Cache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@56 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-25 14:46:59 +00:00
orbiter
7fb645b0ab enhanced crawling performance, changed memory settings, new performace options 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@51 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-24 23:15:40 +00:00
theli
58b1a0ba40 *) adding an new package for extra content parsers 
*) adding content parser for
- pdf (using the pdf-box library)
- doc (using the textmining.org library)
*) adding a Interface for content parsers
*) adding a configuration file which can be used to configure which parser is used for which mimeType
*) Sempahore class was moved and renamed to serverSemaphore
*) Changing yacy shutdown behaviour
Buzy waiting loop for shutdown was removed and replaced with a blocking call (using the semaphore class mentioned above) to the new switchboard.waitForShutdown method.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@46 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-24 21:24:53 +00:00
rramthun
ff21586a27 Fixed some spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@43 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-22 15:29:28 +00:00
orbiter
00f223cfc1 fixed post-parsing (a case when the bluelist is empty) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@41 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-21 17:13:43 +00:00
theli
c9c0a1f11c *) Trying to speedup local crawling 
- introduction of a threadpool for crawling
- introduction of a job queue to avoid buzy waiting for a free crawler slot

*) New classes added
- queue for receiving of crawler jobs
- semaphore class to do reader/writer synchronization (mutual exclusion)
- message object to hold all needed data about a crawler job

*) Trying to solve session-thread shutdown problem
- session thread stopped variable is now set from outside before interrupting the
  session thread.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@39 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-21 10:31:40 +00:00
rramthun
ce7d8c4fe0 Fixed some spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@37 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-20 16:01:14 +00:00
rramthun
570de9c4f4 Fixed some spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@36 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-20 13:28:32 +00:00
rramthun
b61567a39e Fixed spelling mistake and inserted author as described in mailinglist 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@32 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-19 13:56:59 +00:00
(no author)
d5ff81c636 *) Undoing last changes. Sorry. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@25 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-19 06:52:04 +00:00
(no author)
ea4849716f *) Bugfix: plasmaCondenser.getWords() was not used correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@24 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-19 06:37:27 +00:00
(no author)
0a6cf3f5e7 *) Bugfix: Reference to plasmaHTCache.Entry.urlString was not set correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@23 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-19 06:33:53 +00:00
orbiter
b9203bdb50 bug fixes and code cleaning 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@22 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-15 14:18:14 +00:00
(no author)
b7d4389e4b *) support for Proxy Auto-Config File generation added. 
File is accessible using: 
   http://proxy:8080/autoconfig.pac

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@20 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-15 09:06:15 +00:00
orbiter
e7d055b98e very experimental integration of the new generic parser and optional disabling of bluelist filtering in proxy. Does not yet work properly. To disable the disable-feature, the presence of a non-empty bluelist is necessary 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@17 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-13 15:52:00 +00:00
orbiter
a87a17a3c8 prepared generic text parser environment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@15 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-12 22:57:54 +00:00
rramthun
a6154697ba Fixed some grammar/spelling mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-09 10:49:03 +00:00
allo
1e33de27da Log ist now skinnable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-09 10:10:32 +00:00
rramthun
f824958184 Fixed some spelling/grammar mistakes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-09 09:20:50 +00:00
orbiter
7eb3c81aad name check on new peer names 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-08 23:15:03 +00:00
allo
955d26b117 Bug: could not install from url and use the skin (because of a two names "use") 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-08 19:07:41 +00:00
orbiter
248077d3f0 initial load with yacy 0.36 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-04-07 19:19:42 +00:00