Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,167 Commits 1 Branch 20 Tags 836 MiB
dbdf2570ba
Commit Graph

2778 Commits

Author SHA1 Message Date
apfelmaennchen
34af8b4877 - yacysearch.html compromise for positioning the sidebar 
- position is now fixed on the right top side
- should scale down to window width 800px, smaller windows will cause distortions
- see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15293

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:57:09 +00:00
orbiter
4522c13ee7 added option for a table prefix when importing phpbb3 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5996 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:29:02 +00:00
orbiter
3d5f2ff544 - added new servlets to support search portal administrators for the integration of yacy search fields in their web pages 
- moved some servlets from here to there..
- changed menu structure
- removed yacyui-portaltest.html which contained an example for the live search which is now integrated on all pages in yacy. The code snippet example from that page is integrated into the ConfigLiveSearch.html servlet


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5994 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:16:03 +00:00
orbiter
88426912ad more refactoring to make the segment object easier to use and to be prepared to integrate author navigation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 10:03:35 +00:00
orbiter
99bf0b8e41 refactoring of plasmaWordIndex: 
divided that class into three parts:
- the peers object is now hosted by the plasmaSwitchboard
- the crawler elements are now in a new class, crawler.CrawlerSwitchboard
- the index elements are core of the new segment data structure, which is a bundle of different indexes for the full text and (in the future) navigation indexes and the metadata store. The new class is now in kelondro.text.Segment

The refactoring is inspired by the roadmap to create index segments, the option to host different indexes on one peer.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-28 14:26:05 +00:00
orbiter
fec6f9054f some refactoring of search methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5988 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 23:51:34 +00:00
orbiter
4b4bddca00 added new submenu to crawler menu: import of phpbb3 forum postings from mysql 
- yacy can import phpbb3 posts without crawling
- all data is written as surrogate
- indexed surrogate files can be re-used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5985 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 14:53:23 +00:00
apfelmaennchen
f1a9253baa see: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15198 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5984 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 08:56:55 +00:00
apfelmaennchen
369bb78a7a - added "visibility: hidden;" for yacysearch.html sidebar 
- this only works with javascript....sorry

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5983 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 07:30:59 +00:00
apfelmaennchen
16a226b016 removed debug-alert() from last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5982 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 07:13:45 +00:00
apfelmaennchen
01334686bd small fixes for yacysearch.html sidebar (display=3) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5981 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 07:06:13 +00:00
orbiter
63a0255166 - refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index 
- refactoring: migrated data objects for the new connector classes
- added a DAO interface class to specify an abstract interface for database retrieval connector methods

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5977 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-26 07:44:22 +00:00
orbiter
f246928c20 first attempt to add 'real' Navigation to yacy search results: host navigation 
- after a search is started, it is analysed how many hits are in each site
- this can be done really efficient, because the navigation information is hidden in the url hash and can be computed very fast
- the search result shows a column on the right with the hosts and the hits per host
- after a click on a host the search is modified using the efficient site: - operator

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5976 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-25 22:27:34 +00:00
orbiter
54b9e99c01 - more information about peer tags 
- peer tag is by default '*'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5975 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-25 21:43:33 +00:00
orbiter
41dd31cad2 replaced new navigation icons with same images but smaller resolution (16x16 instead of 128x128) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-17 22:22:29 +00:00
orbiter
bffbe43e09 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14522#p14522 
fix for http://forum.yacy-websuche.de/viewtopic.php?p=14955#p14955

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-17 21:15:06 +00:00
low012
16d28496ac *) YaCy will load status page once it is up again after restart or update if Javascript is enabled. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5957 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-17 16:28:39 +00:00
orbiter
1efe686e3f fix for http://forum.yacy-websuche.de/viewtopic.php?p=13960#p13960 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5954 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-15 22:51:15 +00:00
lotus
13fb84ab81 you can define your default number of search results displayed by search.items 
this applies only to requests through the classic-style page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-15 14:48:34 +00:00
orbiter
a642d6a7b5 - added navigation icons for search result pages 
- modified result page rendering to use new icons instead of numbers
- set different default values in yacy.init for higher indexing performance; removed pro-values
- modified WatchCrawler to accept 30000 PPM instead of only a maximum of 6000 PPM

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5952 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-14 23:11:10 +00:00
low012
012157c87f *) fixed "select all" and "deselect all"-button 
This bug was introduced when search boxes were added to the header of each page and there may be more pages which are affected.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5951 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-12 22:32:30 +00:00
orbiter
c01d6f43e1 - fixed problem with thread dump if no arguments are given 
- rejecting peers that are older than 6 hours (not-seen during 6 hours)
- 0.78, targeting 0.8 at the end of the week

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5948 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-11 22:26:21 +00:00
orbiter
d3ca038979 fixed domain graph applet (visible in Terminal) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5946 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-11 21:12:30 +00:00
orbiter
04ec42e1d0 removed index Transfer, because it does not make sense any more to do a complete index transfer using the DHT methods. It is far easier and faster to just copy the whole index files from the source to the target peer. To do this, copy all files from DATA/INDEX/<network>/TEXT/RICACHE and DATA/INDEX/<network>/TEXT/METADATA from the source to the destination peer. 
Future versions of YaCy will have different file structures than given here, because of the new index segment concept, where each peer may have several indexes (called segments) for each network definition. A copy from one peer to another will then create a new index segment.
To track changes for this feature, see forum discussion at
http://forum.yacy-websuche.de/viewtopic.php?p=14728#p14728

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5945 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-10 21:00:39 +00:00
lotus
29f93b2abf Kaskelix looks forward to see you again :-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5943 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-10 17:53:15 +00:00
lotus
ea5729ce21 hint for search parameters 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5938 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-09 19:14:52 +00:00
orbiter
55d51e4b8c fixed bug in indexcleaner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5933 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-08 15:35:53 +00:00
orbiter
89aeb318d3 enhanced the wikimedia dump import process 
enhanced the wiki parser and condenser speed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5931 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-08 10:36:13 +00:00
orbiter
5fb77116c6 added a submenu to index administration to import a wikimedia dump (i.e. a dump from wikipedia) into the YaCy index: see 
http://localhost:8080/IndexImportWikimedia_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5930 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-08 07:54:10 +00:00
apfelmaennchen
492165338d small addition for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5917 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-02 12:12:33 +00:00
f1ori
bde88b684a * splitt off yacyRelease from yacyVersion 
* added some gui infos about signatures


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5916 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-02 12:12:22 +00:00
apfelmaennchen
ac3139a1fd fix for live-search positioning in header.template 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5915 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-02 11:56:55 +00:00
lulabad
c3cd70b461 better human readable date format 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5913 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-02 06:56:08 +00:00
orbiter
d2ac0aa682 - fixed possible bugs in Stack (may affect Crawler reset) and RandomAccess handling 
- increased default memory size to 180MB
- fixed possible bug in http client reset (there was a deadlock)
- bug in BOBHeap marked, but not solved, cause is still unknown.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5912 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-02 01:40:03 +00:00
apfelmaennchen
acfd79ab4a yacyui-portalsearch: added keyboard controlls 
ESC: close window
PageDown: next search result page
PageUp: prev. page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5911 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-01 10:34:56 +00:00
apfelmaennchen
f490eab6ba yacyui-portalsearch: clear input on window close 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5910 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-01 10:06:24 +00:00
low012
ff5f82d780 *) removed description of removed commands from wikiHelp ([= =]) 
*) used format function of Netbeans for wikiCode to make it more readable, no functional changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5907 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-01 07:28:59 +00:00
orbiter
d3f8aa5a2a set of small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5903 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-29 21:36:20 +00:00
apfelmaennchen
84518710d0 small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5901 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-29 19:51:42 +00:00
apfelmaennchen
63097513ae maybe this smoothens the timing problems yacyui-portalsearch.js a little bit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5900 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-29 18:52:20 +00:00
orbiter
d31e6f9c14 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14457#p14457 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5899 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-29 11:18:17 +00:00
lotus
0e01e846ef small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5898 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-28 18:59:56 +00:00
lotus
d8fca85c11 fixed search: allow dots in operators 
added new operator "tld:" which was the former "site:"
"site:" uses fast site operator introduced in r5770

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5897 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-28 17:12:31 +00:00
orbiter
d079d6dfdb small changes in surrogate reader, wiki code and portal test 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5894 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-27 20:30:43 +00:00
orbiter
07f09742bb set of small fixes and comments 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5893 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-27 15:29:50 +00:00
orbiter
d9e62508e5 fixed a NPE bug (from SVN 5888) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-27 12:52:12 +00:00
orbiter
50e96ee894 - moved live search window in yacy to different location 
- changed div id for live seach from 'yacy' to 'yacylivesearch'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5889 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 21:04:31 +00:00
apfelmaennchen
dd489fcce0 fixed some json encoding problems in yacysearchitem 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5888 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 19:17:36 +00:00
apfelmaennchen
0b4e4bbddd fixed css interferance for previous posts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 18:46:05 +00:00
apfelmaennchen
ed4fb3bf75 small fix to portal search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5886 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 18:30:21 +00:00
apfelmaennchen
753affca4b - request: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=2041#p14336 
- integrated portal search in yacy web interface


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 18:22:28 +00:00
apfelmaennchen
4cf8b08eec Portal Search: 
- request: http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&start=50#p14350
- window closes for empty query
- example for fancy input field

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 17:44:11 +00:00
apfelmaennchen
42d936288e small update for RichClient LogViewer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 17:20:08 +00:00
lotus
2714ff034b avoid undefined in rssTerminal 
thanks to freq.9! http://forum.yacy-websuche.de/viewtopic.php?p=14288

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-26 11:45:36 +00:00
apfelmaennchen
6f5ea7b1a8 small fix for previous post 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5879 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 21:28:08 +00:00
apfelmaennchen
2eabd989ce - added a log viewer to RichClient (alpha version, very slow) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 20:58:56 +00:00
apfelmaennchen
557c2a32a3 small fix for yacyui-portalsearch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5876 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 16:59:35 +00:00
apfelmaennchen
b4539a61dd some more documentation for yacyui-portaltest.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5875 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 15:14:10 +00:00
orbiter
64a63306b8 added portal-test explanation page to the customization submenu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5874 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 13:18:13 +00:00
apfelmaennchen
64ce9da60f - new yconf parameter global 
- see http://forum.yacy-websuche.de/posting.php?mode=quote&f=9&p=14207#pr14207

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 13:08:07 +00:00
apfelmaennchen
5ca306da9a fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2054#p14306 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5872 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 12:24:40 +00:00
apfelmaennchen
9325198c42 hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14305 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-25 08:15:27 +00:00
apfelmaennchen
675f350d18 YaCy Portal Search Widget 
- see http://localhost:8080/yacy/ui/yacyui-portaltest.html
- two new parameters (logo and link) for yconf as requested at http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14101


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-24 17:21:31 +00:00
orbiter
09987e93fd fixed some more bad handling of byte[] 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5865 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-23 22:02:12 +00:00
lotus
fbca4f8354 more stability on watchcrawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-23 18:42:15 +00:00
orbiter
dec495ac78 added dummy class for help page 
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2033&hilit=&p=14107#p14107

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-22 13:59:20 +00:00
lotus
daea87d436 do not accept dht from bad versions 
delete bad hashes on receive

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-22 12:13:37 +00:00
orbiter
dfb96ecb72 more fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5844 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-20 22:08:38 +00:00
orbiter
1b8d346b4c fixes in connection with transiton to byte[] hashes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5843 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-20 21:54:00 +00:00
orbiter
e7559f3234 fix for http://forum.yacy-websuche.de/viewtopic.php?p=13977#p13977 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5838 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-20 10:06:55 +00:00
orbiter
fa3adbbfc6 added domain checks to surrogate reader and RWI transfer receiver to prevent spaming using surrogates 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5837 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-20 06:38:28 +00:00
low012
31c6934df2 *) fix for r5832 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5835 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-19 07:40:23 +00:00
lotus
616a4d724f high-end favicon with 2 versions: 
* true color + alpha channel for modern browsers
* 256 colors and non-transparent background for others

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5833 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-18 18:37:26 +00:00
low012
d1116c049f *) added new method "contains()" to Blacklist interface 
*) implemented contains() in class AbstractBlacklist
*) used new method in Blacklist_p to prevent double entries in blacklists

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5832 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-18 16:27:17 +00:00
f1ori
94a6c83256 * rewrite code without using java 1.6 features 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5829 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-17 15:54:44 +00:00
orbiter
29e96c1a60 bugfixes and performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5824 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-17 13:04:56 +00:00
f1ori
44daec7936 * introduce signatures to autoupdate 
as long as there aren't publickeys for the updatelocations set,
  no signatures are checked
* wiki-article follows...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5822 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-17 09:58:06 +00:00
orbiter
e16c25ddf7 (peak-) performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5819 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 22:45:39 +00:00
orbiter
63cd152969 fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5818 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 22:18:35 +00:00
orbiter
870066ab35 another fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5814 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 20:23:20 +00:00
orbiter
b15b059c0d fix for latest commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5813 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 19:53:21 +00:00
orbiter
c8624903c6 full redesign of index access data model: 
terms (words) are not any more retrieved by their word hash string, but by a byte[] containing the word hash.
this has strong advantages when RWIs are sorted in the ReferenceContainer Cache and compared with the sun.java TreeMap method, which needed getBytes() and new String() transformations before.
Many thousands of such conversions are now omitted every second, which increases the indexing speed by a factor of two.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5812 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 15:29:00 +00:00
f1ori
dd6b5005ff * fix missing charset handling in getpageinfo_p 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5811 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 12:31:28 +00:00
orbiter
bd5f4c78d8 - added default profile for surrogate indexing 
- integrated surrogate indexing into indexing queue process

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5810 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-16 08:01:38 +00:00
orbiter
ad78e3a59f - less lines in rssTerminal 
- crawl more documents: if remote crawling is enabled, a remote crawl list is also loaded if a local crawl is running in case that the indexer is idle

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5809 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-15 23:07:51 +00:00
orbiter
12d81e98eb - fixed bad search results when searching for empty string 
- simplified result handling and page composition in case that nothing was searched


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5807 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-15 11:22:43 +00:00
orbiter
8a24350036 - fix for join method with new generalized RWI data structure (caused by latest commit) 
- added more functions to mediawiki parser


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5806 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-15 10:26:24 +00:00
orbiter
89ec3acb3e - full abstraction of index content type: the kelondro full text index may now also contain indexes about other content than text, i.e. navigation indexes or reverse linking indexes. 
- during index joins all word positions are maintained: better ranking for word distance possible; exact phrase match can be implemented soundly


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5804 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-15 06:34:27 +00:00
orbiter
dc2af61bc9 allow up to 50 results from remote peers 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5802 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-13 21:47:57 +00:00
low012
6504b21cea *) fix for http://forum.yacy-websuche.de/viewtopic.php?t=1976 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5800 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-13 09:22:11 +00:00
orbiter
601d63ef48 removed comment tag (no use at this point) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5797 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-11 12:24:45 +00:00
low012
0c8fd811dc *) first and very limited version of XML import, does not use benefits provided by XML yet 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5795 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-11 09:55:46 +00:00
orbiter
c08f9b36a4 refactoring of wiki parser. 
This was done to prepare the wiki parser as parser for wikipedia dumps, which will be used for performance test (to omit crawling)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5785 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-08 15:28:45 +00:00
apfelmaennchen
faeff21012 - fix for display of automatic ReCrawls in surftips 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5784 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-08 07:35:08 +00:00
orbiter
44e01afa5b - refactoring 
- a little bit more abstraction
- new interfaces for index abstraction

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5783 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-07 09:34:41 +00:00
orbiter
c2359f20dd refactoring: better abstraction of reference and metadata prototypes. 
This is a preparation to introduce other index tables as used now only for reverse text indexes. Next application of the reverse index is a citation index.
Moved to version 0.74

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5777 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-03 13:23:45 +00:00
orbiter
a29a11e526 added evaluation of incoming links in webstructure api 
the api hash changed, new XML schema.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5774 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-03 07:59:49 +00:00
orbiter
f21a8c9e9c a different naming scheme for BLOBArray files. This may be necessary if blobs are written more often than once in a second. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5771 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-02 15:08:56 +00:00
orbiter
7ba078daa1 - added fast site-operator 
- refactoring merge into BLOBArray

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5770 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-02 13:26:47 +00:00
orbiter
bd409fb7ba added web structure analysis for a special domain that can be requested from the api. 
Example:
http://localhost:8080/api/webstructure.xml?about=www.yacy.net
returns a xml with the following content:

<?xml version="1.0"?>
<webstructure>
<domains reference="reverse" count="1" maxref="300">
<domain host="www.yacy.net" id="FXg39Q" date="20090401">
  <citation host="java.sun.com" id="o-R3yY" count="1" />
  <citation host="yacy-suche.de" id="-KCLaB" count="1" />
  <citation host="suma-ev.de" id="VRAHIA" count="1" />
  <citation host="www.kit.edu" id="EMaLDQ" count="1" />
  <citation host="yacy.net" id="Fh1hyQ" count="1" />
  <citation host="www.fzk.de" id="V2Kl-A" count="1" />
  <citation host="en.wikipedia.org" id="rwtdfR" count="3" />
  <citation host="vimeo.com" id="MmdQDY" count="3" />
  <citation host="liebel.fzk.de" id="sX4ozA" count="6" />
</domain>
</domains>
</webstructure>


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5766 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-04-01 14:53:23 +00:00
orbiter
587838bd09 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5758 6c8d7289-2bf4-0310-a012-ef5d649a1542 2009-03-30 21:13:53 +00:00
orbiter
96eaecda3e - added migration class to go from index collections to the index cell data structure. 
- added better control over file deletion, because this sometimes fails, especially on windows

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5756 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-30 15:31:25 +00:00
apfelmaennchen
9ab009b16b fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1890#p13476 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5755 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-30 07:33:43 +00:00
apfelmaennchen
eb65990f85 small fix for opera in yacyui-portalsearch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5751 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-29 12:49:42 +00:00
apfelmaennchen
695c420bcd small fix for yacyui-portalsearch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5750 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-29 10:31:15 +00:00
apfelmaennchen
95885a263a - added default properies to yacyui-portalsearch 
- see http://localhost.8080/yacy/ui/yacyui-portaltest.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5749 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-29 09:29:08 +00:00
apfelmaennchen
c001a020a9 - small modifications to yacyui-portalsearch 
- see http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&p=13459#p13459

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5748 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-28 23:06:15 +00:00
apfelmaennchen
34a825f90d small fix for yacyui-portaltest.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5746 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-27 06:41:39 +00:00
apfelmaennchen
9f9d7f875d small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5745 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-27 06:30:59 +00:00
apfelmaennchen
453f3aaa94 RichClient: further clean-up 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5744 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-27 06:06:14 +00:00
apfelmaennchen
e888c9a934 RichClient: 
- renamed base theme to start theme
- reoved all but start theme
- additional themes can be downloaded from http://jquery-ui.googlecode.com/files/jquery-ui-themes-1.7.zip
- or a custom theme can be generated at http://jqueryui.com/themeroller/
- themes are installed into DATA/LOCALE/htroot/yacy/ui/css/themes
- update for RichClient theme selection will follow soon

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5743 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-27 06:04:39 +00:00
apfelmaennchen
42c5f930c8 reverted an accidental commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5742 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-24 05:41:29 +00:00
apfelmaennchen
b5e6232f8d small correction of font-size for portal search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5741 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-23 21:26:28 +00:00
apfelmaennchen
7425c6c3ca added an ajax loading graph to portal search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5740 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-23 20:22:53 +00:00
apfelmaennchen
a975ae4a7e Added YaCy portal search: http://localhost:8080/yacy/ui/yacyui-portaltest.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5739 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-23 20:16:07 +00:00
apfelmaennchen
b57a1820bd small fix for jquery-faviconize-1.0.js to handle https properly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5738 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-21 19:35:20 +00:00
apfelmaennchen
075b58a0a9 minor fixes for RichClient search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5737 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-21 18:54:42 +00:00
borg-0300
8c494afcfe svn attributes added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-20 11:21:32 +00:00
orbiter
67aaffc0a2 - added Latency control to the crawler: 
because of the strongly enhanced indexing speed when using the new IndexCell RWI data structures (> 2000PPM on my notebook), it is now necessary to control the crawling speed depending on the response time of the target server (which is also YaCy in case of some intranet indexing use cases).
The latency factor in crawl delay times is derived from the time that a target hosts takes to answer on http requests. For internet domains, the crawl delay is a minimum of twice the response time, in intranet cases the delay time is now a halve of the response time.

- added API to monitor the latency times of the crawler:
a new api at /api/latency_p.xml returns the current response times of domains, the time when the domain was accessed by the crawler the last time and many more attributes.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5733 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-20 10:21:23 +00:00
orbiter
61f9dbf0cc - fixed a display problem in watch crawler 
- another small enhancement in balancer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5729 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-18 21:25:52 +00:00
orbiter
b3f75e48fa - enhanced balancer: auto-solving of waiting-deadlocks 
- removed deprecated cache-init size value
- more debug lines for IndexCell cache dump merge

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5728 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-18 20:21:19 +00:00
orbiter
83792d9233 more refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-16 16:24:53 +00:00
orbiter
474aac65af more refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-16 08:32:28 +00:00
orbiter
209f25f5f5 refactoring to integrate indexCell data structures 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5718 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-16 00:18:37 +00:00
orbiter
7dff1cba62 removed option to use different primary keys in kelondro tables 
this option was never used and there is also no use to set other columns but the first as the primary key. as a result, access methods to the key do not need to compute key positions, and they work faster.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5711 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-13 16:52:31 +00:00
orbiter
7f67238f8b refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5710 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-13 14:56:25 +00:00
orbiter
14a1c33823 refactoring of wordIndex class 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5709 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-13 10:34:51 +00:00
orbiter
e2e7949feb replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5706 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-13 00:13:47 +00:00
borg-0300
d612430fce copy paste mistake 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5689 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-09 19:05:36 +00:00
borg-0300
acbdac1b67 corrected examples 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5688 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-09 18:37:50 +00:00
orbiter
396a4451be increased timeout in ViewFile 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5685 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-09 10:16:37 +00:00
apfelmaennchen
9b6fac4a82 RichClient: better handling for small screens/windows 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5681 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-08 08:55:04 +00:00
lotus
8ee946bf1d show upnp status 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5679 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-07 15:31:24 +00:00
apfelmaennchen
f0947a20a8 - RichClient: increased ajax timeout to 10 sek. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5678 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-07 11:01:13 +00:00
apfelmaennchen
e73ac67f7e - for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5677 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-07 10:51:24 +00:00
apfelmaennchen
f7fd3d30c2 - various changes to RichClient 
- improved search stability

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5675 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-07 10:20:34 +00:00
apfelmaennchen
4f3bdc64b5 - added ?callback= parameter for JsonP support 
- this is needed for json ajax cross domain calls
- see: http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5674 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-07 10:18:47 +00:00
apfelmaennchen
d84264946b - Randspalte für Navigatoren in Suchergebnissen (display=3) 
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p13195

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5673 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-06 17:51:04 +00:00
orbiter
d7a493b4f5 added experimental timeline api 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5672 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-06 16:01:29 +00:00
orbiter
efcd95dc37 simplification of (internal) query process / refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5671 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-06 15:53:20 +00:00
orbiter
f1b712c29a small corrections to image loading methods in result presentation 
especially loading of favicons in search results. This is a fix that
affects only searches in intranet/repository configurations.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5670 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-06 15:39:02 +00:00
orbiter
98f36a801a - small update to search result layout 
- some more mime types

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5669 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-06 10:16:14 +00:00
lotus
4f6658b115 * non-sliding api icon 
* regex doc links update

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5668 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-05 20:41:30 +00:00
orbiter
aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5664 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-02 11:04:13 +00:00
orbiter
6ffc6e3389 more refactoring of indexer and kelondro classes; 
- integrating the indexer into kelondro as package 'text'
- renaming of classes in kelondro.index

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5663 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-02 10:00:32 +00:00
orbiter
404bc21da9 simplification of (internal) query process / refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5662 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-02 08:48:27 +00:00
orbiter
76ef5f0f14 refactoring of index package: better names for the classes (to be continued) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5661 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-03-01 23:58:14 +00:00
lotus
39a177649b * added upnp listener for devices that do not respond to discovery but advertise themselves 
* moved package

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5659 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-28 14:36:23 +00:00
orbiter
89d8e824ed memory protection for URLAnalysis 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5649 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-24 22:05:09 +00:00
apfelmaennchen
72cc1d3a6c YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5645 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-24 07:48:23 +00:00
apfelmaennchen
784a7bb7fd YaCy-UI: small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5644 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-24 07:03:55 +00:00
apfelmaennchen
aa13d03b99 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5643 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 23:08:58 +00:00
orbiter
de714783b1 - added host, path, filename to search result 
- modified yacyinteractive, shows now also date
- added size attribut to export file in xml format

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5639 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 11:39:20 +00:00
orbiter
7cfab2ee9a added a size field to the search results. The file size is now shown in the html search page and the yacyinteractive. The field is presen in the rss and json 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5638 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 07:59:11 +00:00
orbiter
4693495bbe added sru-compatibility to yacyuisearch ('query' instead of 'search') 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5637 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 23:43:05 +00:00
apfelmaennchen
54c7698219 YaCy-UI: some clean up of base.css 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5635 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 16:00:24 +00:00
apfelmaennchen
5d806623d5 YaCy-UI: 
- fix for folders
- first experiments with topwords
- first experiments with bookmark tag folder

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5634 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 15:59:24 +00:00
apfelmaennchen
bd6a3083c5 YaCy-UI Widget: added a target='_blank' to search results 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5632 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 22:35:41 +00:00
apfelmaennchen
b6b39e9556 YaCy-UI Widget: 
- added parameters fontsize=[small,normal,big], height and width
- e.g. http://localhost:8080/yacy/ui/yacyui-widget.html?style=darkness&fontsize=small&height=400&width=300

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5631 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 22:25:07 +00:00
apfelmaennchen
be29ece9d0 - added a new YaCy-UI Widget: /yacy/ui/yacyui-widget.html?style=xyz 
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1127#p12781

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5630 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 13:30:47 +00:00
orbiter
1ba4301920 automated interruption of dead incoming connections, if they are there for more than one minute 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5622 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-19 22:27:24 +00:00
orbiter
c12bb8a6d0 - refactoring of the http client 
- added a protection against memory leaks for the access tracker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5621 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-19 16:24:46 +00:00
orbiter
62505bb3cb more bugfixes as recommendet by findbugs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5619 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-17 09:12:47 +00:00
orbiter
94c42691d8 - reject less transmissions as transmission receiver 
- do not flag too much receiver when something goes wrong during transmission as sender

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5616 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-16 21:28:48 +00:00
lotus
4aad461100 added UPnP support 
YaCy can now automatically forward ports on home routers
off by default

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5609 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-14 13:12:08 +00:00
orbiter
62762ba81a fix for thread dump 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5608 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-14 01:08:20 +00:00
apfelmaennchen
40ab13c886 YaCy-Ui: small bug fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5604 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-13 11:00:34 +00:00
daburna
5d3233ca6c some updates for german translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5602 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-12 14:24:14 +00:00
apfelmaennchen
e4597bd780 YaCy-UI: small bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5601 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 17:28:51 +00:00
apfelmaennchen
8aafbe234b YaCy-UI: 
- some themes to get started

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5598 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 12:58:04 +00:00
apfelmaennchen
222c97b798 YaCy-UI: 
- updated to jquery 1.3.1
- updated to jquery-ui 1.6rc6
- added support for themes (not yet persistent but otherwise working well)
- deleted some obsolete files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5597 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 12:50:42 +00:00
low012
4c11843eba *) fixed small bug with large effect (OOM exception hazard when "show all" was selected for a blacklist) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5594 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 23:46:51 +00:00
orbiter
6a32193916 - refactoring of cache naming in web index cache (no more dht semantics there) 
- activating a feature in the thread dump that cuts off dumping of a trance of inside-java-core events

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5593 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 23:28:13 +00:00
orbiter
e52c3eb79d added option to create a custom number of thread dumps in multiple thread dumps 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5592 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 20:57:04 +00:00
orbiter
6c627dbdff update to the server core 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5591 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 13:26:26 +00:00
apfelmaennchen
bc1e7da83f small bugfix for Safari to work with YaCy-UI 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5590 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 12:35:09 +00:00
orbiter
6a876ecb88 first fixes to the DHT transmission process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5588 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:48:54 +00:00
orbiter
de610b99ec replaced invisible pixel image with 'real' invisible pixel ;-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5587 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:13:00 +00:00
orbiter
c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them: 
- after a index selection is made, the index is splitted into its vertical components
- from differrent index selctions the splitted components can be accumulated before they are placed into the transmission queue
- each splitted chunk gets its own transmission thread
- multiple transmission threads are started concurrently
- the process can be monitored with the blocking queue servlet
To implement that, a new package de.anomic.yacy.dht was created. Some old files have been removed.
The new index distribution model using a vertical DHT was implemented. An abstraction of this model
is implemented in the new dht package as interface. The freeworld network has now a configuration
of two vertial partitions; sixteen partitions are planned and will be configured if the process is bug-free.
This modification has three main targets:
- enhance the DHT transmission speed
- with a vertical DHT, a search will speed up. With two partitions, two times. With sixteen, sixteen times.
- the vertical DHT will apply a semi-dht for URLs, and peers will receive a fraction of the overall URLs they received before.
  with two partitions, the fractions will be halve. With sixteen partitions, a 1/16 of the previous number of URLs.
BE CAREFULL, THIS IS A MAJOR CODE CHANGE, POSSIBLY FULL OF BUGS AND HARMFUL THINGS.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5586 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:06:59 +00:00
orbiter
c6c57b7b3d svn 5580 placed a bug into yacyinteractive and it was not possible 
to search any more. The cause was the replacement of '&' with '&amp'
in the call of the json source.
Please TEST _every_ code change.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5585 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-09 09:21:31 +00:00
auron_x
49d95fb3d9 - cytag-xhtml-fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5582 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 15:31:28 +00:00
orbiter
01b97ef3f8 added new cybertag-tracking feature that was inspired by itgrl 
from the forum discussion in
http://forum.yacy-websuche.de/viewtopic.php?p=12612#p12612

The feature will provide two basic entities:
- you can integrate image links which point to your yacy installation anywhere in the web.
  the image can be loaded with
  <img src="http://<yourpeer>:<yourport>/cytag.png?icon=invisible&nick=<yournickname_or_community_id>&tag=<anything>">
  This will place a invisible 1-pixel image. If you change the icon=invisible to icon=redpill, you will see a red pill
  Use this, to track your activity in the web.
- you can view your tracks at
  http://localhost:8080/Tracks.html
- There is a public api to your tracks at
  http://localhost:8080/api/tracks_p.json
  which needs authentication


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5581 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 15:06:19 +00:00
auron_x
03a16f6c20 - more XHTML-validation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5580 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 14:45:56 +00:00
auron_x
46af1e06dc - XHTML-Validation of some pages (Status.html still needs work) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5579 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 08:51:03 +00:00
orbiter
b57c9da1f8 - fixes to doc, ppt, xls parser: better title 
- fixes to httpd server response header generation
- fixes to a server date computation bug
- new Button in indexControl to view content of url in ViewFile


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5576 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-05 15:15:13 +00:00
orbiter
65a1de6c05 longer timeout for remote crawl queries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5573 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-04 16:55:09 +00:00
orbiter
86763c42c4 enhanced interactive search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5571 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-04 15:59:22 +00:00
low012
5b79221037 *) bugfix for my last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5570 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-03 21:45:41 +00:00
orbiter
9d282d2c16 - renamed interactivesearch to yacyinteractive 
- added a configuration option to set the pop up page in Config Appearance
- added a minimized header option to yacyinteractive
- fixed a bug in yacysearch: default values when no query is done


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5569 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-03 13:04:02 +00:00
low012
910c2aaed6 *) blacklists will only displayed partly now with 50 entries per page by default, this should make it easier to administrate large lists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5568 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-02 18:24:04 +00:00
orbiter
75bef03ac6 fix for bad encoding in yacydoc.html and yacydoc.xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5566 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-02 15:55:45 +00:00
orbiter
12ec5132ce tried to fix the remote crawl problem. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5563 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 22:35:56 +00:00
apfelmaennchen
ee3fe19c0b added /api/bookmarks/get_folders.xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5559 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 20:41:37 +00:00
apfelmaennchen
7a159dc745 update for api/bookmarks/get_folders 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5558 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 20:40:51 +00:00
apfelmaennchen
f6ef9014c7 Bookmarks.html - removed API Logo for add, edit etc. views, as this is not supported for RSS Version 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5557 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:38:46 +00:00
apfelmaennchen
35a5116606 - another update to Bookmarks.html 
- only calculate tags and folders if display = 0

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5556 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:26:11 +00:00
apfelmaennchen
ab1a09ab95 small addition to last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5555 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:13:35 +00:00
apfelmaennchen
416d16e026 - partial work around for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1815#p12526 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5554 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 15:51:35 +00:00
orbiter
ef82cced01 removed default line 'P2P WEB SEARCH' if no line is given 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5553 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 00:43:52 +00:00
f1ori
bacccda6d7 * blacklist_p.xml: attrOnly = only give parameters of blacklists, no content 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5548 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-31 13:33:08 +00:00
orbiter
94110df85a moved logging partially to kelondro 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5545 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-31 01:06:56 +00:00
orbiter
024da2916b refactoring of logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5544 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 23:33:47 +00:00
orbiter
83ce65707a (almost) completed partition of classes in kelondro 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5543 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 22:44:20 +00:00
orbiter
7ee494fde5 more refactoring of kelondro: 
- seperated BLOB from table classes
- renamed 'coding' package to 'order'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5542 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 22:08:08 +00:00
orbiter
bf93767ec6 refactoring of kelondro database classes 
(to be continued)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5540 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 15:33:00 +00:00
orbiter
fc27bf8c4c refactoring of kelondro classes: 
kelondro shall become independent from other packages.
moved bytebuffer, date and memory to kelondro

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5539 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 14:48:11 +00:00
lotus
7e011de34e hint for recrawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5537 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 08:24:27 +00:00
apfelmaennchen
3905caf8a1 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5536 6c8d7289-2bf4-0310-a012-ef5d649a1542 2009-01-29 22:07:18 +00:00
apfelmaennchen
08ed14603e - fixed YaCy-UI sciencenet search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5535 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 22:06:06 +00:00
apfelmaennchen
55dd15e344 - clean up of YaCy-UI 
- added /yacy/ui/yacyuisearch.html (stand alone version)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5534 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 19:57:18 +00:00
apfelmaennchen
025ebd7574 small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5531 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 22:52:26 +00:00
apfelmaennchen
9bd9ccade2 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5530 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 22:47:03 +00:00
low012
b41a06228f *) cleaning up... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5529 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 19:48:52 +00:00
low012
ce81391095 *) using parameters like site: in the search field does not affect urlmask anymore 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5528 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 19:37:24 +00:00
apfelmaennchen
96684df1a9 - security fix for addTag.java and editTag.java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5526 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 06:43:13 +00:00
apfelmaennchen
6dd52422ea - added two dialogs to manage bookmark tags in YaCy-UI 
- fixed renameTag() in bookmarksDB
- added /api/bookmarks/tags/addTag.xml
- added /api/bookmarks/tags/editTag.xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5525 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 00:15:43 +00:00
apfelmaennchen
12511bd236 - some additional icons for YaCy-UI 
- added license (readme.txt) to exiting icon sets

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5524 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-27 18:17:59 +00:00
apfelmaennchen
e76cbd9016 YaCy-UI: some small cosmetical changes.... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5522 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 19:12:03 +00:00
apfelmaennchen
af3147c3fc and one more....eclipse ist tricky... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5521 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:41:49 +00:00
apfelmaennchen
9317650272 forgot to post this one... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5520 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:40:56 +00:00
apfelmaennchen
92d77c3bef Major update to YaCy-UI...still not perfect...but I thought I share my progress :-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5519 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:38:58 +00:00
borg-0300
a2b336dfe7 small table fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5518 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 16:25:33 +00:00
low012
80e6356860 *) r 5512 has introduced a bug which resulted in useless filters if site:, filtetype:, or inurl: was used since the filters included the word "null". 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5517 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-25 22:16:49 +00:00
lotus
4ef6b15eb8 limit -Xmx setting to 1999m on win32. bigger values would never work. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5513 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-23 15:13:09 +00:00
lotus
5078e837ac better readability / no functional changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5512 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-22 13:41:11 +00:00
orbiter
dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5511 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-22 00:03:54 +00:00
f1ori
34da04c7dd * fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1754 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5510 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-21 21:30:20 +00:00
low012
9a4780c165 *) Javascript should work with Konqueror too now (http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5507 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-20 23:29:24 +00:00
low012
1927fd5992 *) hopefully fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757 
*) small change which prevents weird situation when choosing empty list of entries to edit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5503 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-18 21:23:53 +00:00
apfelmaennchen
98ab7ae20a small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5501 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-17 09:51:04 +00:00
apfelmaennchen
d7122722b2 hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1736#p12061 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5500 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 23:22:42 +00:00
lotus
a2bc32e909 fix for IE6 api-icon display 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5499 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 07:33:36 +00:00
orbiter
6663365720 adopted many calls to new api path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5498 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 00:02:55 +00:00
orbiter
b423d0a036 moved all servlets from htroot/xml to htroot/api 
the file server contains a patch that temporary matches all xml paths to api,
that means all interfaces still work. Please adopt all your interfaces to the new path.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5497 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-15 23:52:58 +00:00
orbiter
91af105373 last changes before release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5493 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 23:49:08 +00:00
orbiter
4bd927d513 the Semantic Web moves in! 
- added two new api files for document metadata:
- added a XHTML+RDFa html file shows the document metadata in a format that presents the data for rendering and for metadata retrieval. This is a typical document format for a semantic web data structure. the used RDF vocabulary is Dublin Core
- added a xml file that shows the same data as pure DC metadata
- integrated the API into the existing IndexControlURLs interface

With about one billion metadata files (URL metadata) this extension makes the freeworld YaCy network
to one of the probably largest metadata document provider for the semantic web!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5490 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 22:04:38 +00:00
apfelmaennchen
613c49bc38 YaCy-UI: update to welcome text (change-log and bug tracker) for stable release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5485 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 05:59:39 +00:00
orbiter
bed38a5f8c fix for uncaught exception in RSSReader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:20:37 +00:00
lotus
c7c291bc6b allow simultaneous inurl: site: and filetype: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 14:59:27 +00:00
orbiter
9ef77d57f5 added an access control to the search interface using white/blacklists: 
in the network configuration, you can configure a whiteliste and a blacklist
- blacklistet clients cannot search
- whitelistet client get never any search restrictions
- for all other clients: apply DoS search restrictions
Please see the example configuriation in yacy.network.freeworld.unit
by default, all clients from localhosts get whitlistet.
If you have your own YaCy network, please put all the IPs of your peers into the whitelist

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 10:55:48 +00:00
orbiter
ac89e8e84d removed unused search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 08:45:12 +00:00
apfelmaennchen
9b26dfec80 small fix to correct encoding of xml output 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:50:53 +00:00
orbiter
efe801173c better dht-in cache flush. see also: 
http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:39:49 +00:00
apfelmaennchen
3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:39:51 +00:00
apfelmaennchen
cc207a979e - added new unified bookmark api to /xml/bookmarks/ 
the get_bookmarks api currently supports:
  .xml: posts, xbel, rss, flexigrid
  .json: posts, flexigrid
  .html: work in progress
- YaCy-UI: support for new bookmark api 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 12:29:19 +00:00
low012
f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 12:58:35 +00:00
orbiter
b2a8c653ee small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:21:44 +00:00
orbiter
8632eebf60 - added api icon to the web structure visualization 
- removed fixed horizontal menu
- the api icon in the search results can only be seen when display=1

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5461 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:42:20 +00:00
orbiter
4f45605f04 small update for timing in search result processing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:28:45 +00:00
lotus
66818a2f2e smaller api banner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 10:27:04 +00:00