Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
5,558 Commits 1 Branch 20 Tags 836 MiB
4cf8b08eec
Commit Graph

2527 Commits

Author SHA1 Message Date
apfelmaennchen
aa13d03b99 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5643 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 23:08:58 +00:00
orbiter
de714783b1 - added host, path, filename to search result 
- modified yacyinteractive, shows now also date
- added size attribut to export file in xml format

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5639 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 11:39:20 +00:00
orbiter
7cfab2ee9a added a size field to the search results. The file size is now shown in the html search page and the yacyinteractive. The field is presen in the rss and json 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5638 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-23 07:59:11 +00:00
orbiter
4693495bbe added sru-compatibility to yacyuisearch ('query' instead of 'search') 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5637 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 23:43:05 +00:00
apfelmaennchen
54c7698219 YaCy-UI: some clean up of base.css 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5635 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 16:00:24 +00:00
apfelmaennchen
5d806623d5 YaCy-UI: 
- fix for folders
- first experiments with topwords
- first experiments with bookmark tag folder

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5634 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-22 15:59:24 +00:00
apfelmaennchen
bd6a3083c5 YaCy-UI Widget: added a target='_blank' to search results 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5632 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 22:35:41 +00:00
apfelmaennchen
b6b39e9556 YaCy-UI Widget: 
- added parameters fontsize=[small,normal,big], height and width
- e.g. http://localhost:8080/yacy/ui/yacyui-widget.html?style=darkness&fontsize=small&height=400&width=300

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5631 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 22:25:07 +00:00
apfelmaennchen
be29ece9d0 - added a new YaCy-UI Widget: /yacy/ui/yacyui-widget.html?style=xyz 
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1127#p12781

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5630 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-21 13:30:47 +00:00
orbiter
1ba4301920 automated interruption of dead incoming connections, if they are there for more than one minute 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5622 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-19 22:27:24 +00:00
orbiter
c12bb8a6d0 - refactoring of the http client 
- added a protection against memory leaks for the access tracker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5621 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-19 16:24:46 +00:00
orbiter
62505bb3cb more bugfixes as recommendet by findbugs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5619 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-17 09:12:47 +00:00
orbiter
94c42691d8 - reject less transmissions as transmission receiver 
- do not flag too much receiver when something goes wrong during transmission as sender

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5616 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-16 21:28:48 +00:00
lotus
4aad461100 added UPnP support 
YaCy can now automatically forward ports on home routers
off by default

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5609 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-14 13:12:08 +00:00
orbiter
62762ba81a fix for thread dump 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5608 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-14 01:08:20 +00:00
apfelmaennchen
40ab13c886 YaCy-Ui: small bug fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5604 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-13 11:00:34 +00:00
daburna
5d3233ca6c some updates for german translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5602 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-12 14:24:14 +00:00
apfelmaennchen
e4597bd780 YaCy-UI: small bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5601 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 17:28:51 +00:00
apfelmaennchen
8aafbe234b YaCy-UI: 
- some themes to get started

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5598 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 12:58:04 +00:00
apfelmaennchen
222c97b798 YaCy-UI: 
- updated to jquery 1.3.1
- updated to jquery-ui 1.6rc6
- added support for themes (not yet persistent but otherwise working well)
- deleted some obsolete files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5597 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-11 12:50:42 +00:00
low012
4c11843eba *) fixed small bug with large effect (OOM exception hazard when "show all" was selected for a blacklist) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5594 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 23:46:51 +00:00
orbiter
6a32193916 - refactoring of cache naming in web index cache (no more dht semantics there) 
- activating a feature in the thread dump that cuts off dumping of a trance of inside-java-core events

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5593 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 23:28:13 +00:00
orbiter
e52c3eb79d added option to create a custom number of thread dumps in multiple thread dumps 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5592 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 20:57:04 +00:00
orbiter
6c627dbdff update to the server core 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5591 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 13:26:26 +00:00
apfelmaennchen
bc1e7da83f small bugfix for Safari to work with YaCy-UI 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5590 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 12:35:09 +00:00
orbiter
6a876ecb88 first fixes to the DHT transmission process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5588 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:48:54 +00:00
orbiter
de610b99ec replaced invisible pixel image with 'real' invisible pixel ;-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5587 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:13:00 +00:00
orbiter
c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them: 
- after a index selection is made, the index is splitted into its vertical components
- from differrent index selctions the splitted components can be accumulated before they are placed into the transmission queue
- each splitted chunk gets its own transmission thread
- multiple transmission threads are started concurrently
- the process can be monitored with the blocking queue servlet
To implement that, a new package de.anomic.yacy.dht was created. Some old files have been removed.
The new index distribution model using a vertical DHT was implemented. An abstraction of this model
is implemented in the new dht package as interface. The freeworld network has now a configuration
of two vertial partitions; sixteen partitions are planned and will be configured if the process is bug-free.
This modification has three main targets:
- enhance the DHT transmission speed
- with a vertical DHT, a search will speed up. With two partitions, two times. With sixteen, sixteen times.
- the vertical DHT will apply a semi-dht for URLs, and peers will receive a fraction of the overall URLs they received before.
  with two partitions, the fractions will be halve. With sixteen partitions, a 1/16 of the previous number of URLs.
BE CAREFULL, THIS IS A MAJOR CODE CHANGE, POSSIBLY FULL OF BUGS AND HARMFUL THINGS.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5586 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-10 00:06:59 +00:00
orbiter
c6c57b7b3d svn 5580 placed a bug into yacyinteractive and it was not possible 
to search any more. The cause was the replacement of '&' with '&amp'
in the call of the json source.
Please TEST _every_ code change.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5585 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-09 09:21:31 +00:00
auron_x
49d95fb3d9 - cytag-xhtml-fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5582 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 15:31:28 +00:00
orbiter
01b97ef3f8 added new cybertag-tracking feature that was inspired by itgrl 
from the forum discussion in
http://forum.yacy-websuche.de/viewtopic.php?p=12612#p12612

The feature will provide two basic entities:
- you can integrate image links which point to your yacy installation anywhere in the web.
  the image can be loaded with
  <img src="http://<yourpeer>:<yourport>/cytag.png?icon=invisible&nick=<yournickname_or_community_id>&tag=<anything>">
  This will place a invisible 1-pixel image. If you change the icon=invisible to icon=redpill, you will see a red pill
  Use this, to track your activity in the web.
- you can view your tracks at
  http://localhost:8080/Tracks.html
- There is a public api to your tracks at
  http://localhost:8080/api/tracks_p.json
  which needs authentication


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5581 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 15:06:19 +00:00
auron_x
03a16f6c20 - more XHTML-validation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5580 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 14:45:56 +00:00
auron_x
46af1e06dc - XHTML-Validation of some pages (Status.html still needs work) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5579 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-06 08:51:03 +00:00
orbiter
b57c9da1f8 - fixes to doc, ppt, xls parser: better title 
- fixes to httpd server response header generation
- fixes to a server date computation bug
- new Button in indexControl to view content of url in ViewFile


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5576 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-05 15:15:13 +00:00
orbiter
65a1de6c05 longer timeout for remote crawl queries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5573 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-04 16:55:09 +00:00
orbiter
86763c42c4 enhanced interactive search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5571 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-04 15:59:22 +00:00
low012
5b79221037 *) bugfix for my last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5570 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-03 21:45:41 +00:00
orbiter
9d282d2c16 - renamed interactivesearch to yacyinteractive 
- added a configuration option to set the pop up page in Config Appearance
- added a minimized header option to yacyinteractive
- fixed a bug in yacysearch: default values when no query is done


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5569 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-03 13:04:02 +00:00
low012
910c2aaed6 *) blacklists will only displayed partly now with 50 entries per page by default, this should make it easier to administrate large lists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5568 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-02 18:24:04 +00:00
orbiter
75bef03ac6 fix for bad encoding in yacydoc.html and yacydoc.xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5566 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-02 15:55:45 +00:00
orbiter
12ec5132ce tried to fix the remote crawl problem. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5563 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 22:35:56 +00:00
apfelmaennchen
ee3fe19c0b added /api/bookmarks/get_folders.xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5559 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 20:41:37 +00:00
apfelmaennchen
7a159dc745 update for api/bookmarks/get_folders 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5558 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 20:40:51 +00:00
apfelmaennchen
f6ef9014c7 Bookmarks.html - removed API Logo for add, edit etc. views, as this is not supported for RSS Version 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5557 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:38:46 +00:00
apfelmaennchen
35a5116606 - another update to Bookmarks.html 
- only calculate tags and folders if display = 0

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5556 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:26:11 +00:00
apfelmaennchen
ab1a09ab95 small addition to last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5555 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 16:13:35 +00:00
apfelmaennchen
416d16e026 - partial work around for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1815#p12526 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5554 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 15:51:35 +00:00
orbiter
ef82cced01 removed default line 'P2P WEB SEARCH' if no line is given 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5553 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-02-01 00:43:52 +00:00
f1ori
bacccda6d7 * blacklist_p.xml: attrOnly = only give parameters of blacklists, no content 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5548 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-31 13:33:08 +00:00
orbiter
94110df85a moved logging partially to kelondro 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5545 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-31 01:06:56 +00:00
orbiter
024da2916b refactoring of logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5544 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 23:33:47 +00:00
orbiter
83ce65707a (almost) completed partition of classes in kelondro 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5543 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 22:44:20 +00:00
orbiter
7ee494fde5 more refactoring of kelondro: 
- seperated BLOB from table classes
- renamed 'coding' package to 'order'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5542 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 22:08:08 +00:00
orbiter
bf93767ec6 refactoring of kelondro database classes 
(to be continued)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5540 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 15:33:00 +00:00
orbiter
fc27bf8c4c refactoring of kelondro classes: 
kelondro shall become independent from other packages.
moved bytebuffer, date and memory to kelondro

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5539 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 14:48:11 +00:00
lotus
7e011de34e hint for recrawls 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5537 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 08:24:27 +00:00
apfelmaennchen
3905caf8a1 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5536 6c8d7289-2bf4-0310-a012-ef5d649a1542 2009-01-29 22:07:18 +00:00
apfelmaennchen
08ed14603e - fixed YaCy-UI sciencenet search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5535 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 22:06:06 +00:00
apfelmaennchen
55dd15e344 - clean up of YaCy-UI 
- added /yacy/ui/yacyuisearch.html (stand alone version)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5534 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 19:57:18 +00:00
apfelmaennchen
025ebd7574 small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5531 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 22:52:26 +00:00
apfelmaennchen
9bd9ccade2 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5530 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 22:47:03 +00:00
low012
b41a06228f *) cleaning up... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5529 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 19:48:52 +00:00
low012
ce81391095 *) using parameters like site: in the search field does not affect urlmask anymore 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5528 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 19:37:24 +00:00
apfelmaennchen
96684df1a9 - security fix for addTag.java and editTag.java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5526 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 06:43:13 +00:00
apfelmaennchen
6dd52422ea - added two dialogs to manage bookmark tags in YaCy-UI 
- fixed renameTag() in bookmarksDB
- added /api/bookmarks/tags/addTag.xml
- added /api/bookmarks/tags/editTag.xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5525 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 00:15:43 +00:00
apfelmaennchen
12511bd236 - some additional icons for YaCy-UI 
- added license (readme.txt) to exiting icon sets

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5524 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-27 18:17:59 +00:00
apfelmaennchen
e76cbd9016 YaCy-UI: some small cosmetical changes.... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5522 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 19:12:03 +00:00
apfelmaennchen
af3147c3fc and one more....eclipse ist tricky... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5521 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:41:49 +00:00
apfelmaennchen
9317650272 forgot to post this one... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5520 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:40:56 +00:00
apfelmaennchen
92d77c3bef Major update to YaCy-UI...still not perfect...but I thought I share my progress :-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5519 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 18:38:58 +00:00
borg-0300
a2b336dfe7 small table fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5518 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 16:25:33 +00:00
low012
80e6356860 *) r 5512 has introduced a bug which resulted in useless filters if site:, filtetype:, or inurl: was used since the filters included the word "null". 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5517 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-25 22:16:49 +00:00
lotus
4ef6b15eb8 limit -Xmx setting to 1999m on win32. bigger values would never work. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5513 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-23 15:13:09 +00:00
lotus
5078e837ac better readability / no functional changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5512 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-22 13:41:11 +00:00
orbiter
dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5511 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-22 00:03:54 +00:00
f1ori
34da04c7dd * fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1754 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5510 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-21 21:30:20 +00:00
low012
9a4780c165 *) Javascript should work with Konqueror too now (http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5507 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-20 23:29:24 +00:00
low012
1927fd5992 *) hopefully fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757 
*) small change which prevents weird situation when choosing empty list of entries to edit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5503 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-18 21:23:53 +00:00
apfelmaennchen
98ab7ae20a small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5501 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-17 09:51:04 +00:00
apfelmaennchen
d7122722b2 hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1736#p12061 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5500 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 23:22:42 +00:00
lotus
a2bc32e909 fix for IE6 api-icon display 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5499 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 07:33:36 +00:00
orbiter
6663365720 adopted many calls to new api path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5498 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-16 00:02:55 +00:00
orbiter
b423d0a036 moved all servlets from htroot/xml to htroot/api 
the file server contains a patch that temporary matches all xml paths to api,
that means all interfaces still work. Please adopt all your interfaces to the new path.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5497 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-15 23:52:58 +00:00
orbiter
91af105373 last changes before release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5493 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 23:49:08 +00:00
orbiter
4bd927d513 the Semantic Web moves in! 
- added two new api files for document metadata:
- added a XHTML+RDFa html file shows the document metadata in a format that presents the data for rendering and for metadata retrieval. This is a typical document format for a semantic web data structure. the used RDF vocabulary is Dublin Core
- added a xml file that shows the same data as pure DC metadata
- integrated the API into the existing IndexControlURLs interface

With about one billion metadata files (URL metadata) this extension makes the freeworld YaCy network
to one of the probably largest metadata document provider for the semantic web!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5490 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 22:04:38 +00:00
apfelmaennchen
613c49bc38 YaCy-UI: update to welcome text (change-log and bug tracker) for stable release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5485 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 05:59:39 +00:00
orbiter
bed38a5f8c fix for uncaught exception in RSSReader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:20:37 +00:00
lotus
c7c291bc6b allow simultaneous inurl: site: and filetype: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 14:59:27 +00:00
orbiter
9ef77d57f5 added an access control to the search interface using white/blacklists: 
in the network configuration, you can configure a whiteliste and a blacklist
- blacklistet clients cannot search
- whitelistet client get never any search restrictions
- for all other clients: apply DoS search restrictions
Please see the example configuriation in yacy.network.freeworld.unit
by default, all clients from localhosts get whitlistet.
If you have your own YaCy network, please put all the IPs of your peers into the whitelist

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 10:55:48 +00:00
orbiter
ac89e8e84d removed unused search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 08:45:12 +00:00
apfelmaennchen
9b26dfec80 small fix to correct encoding of xml output 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:50:53 +00:00
orbiter
efe801173c better dht-in cache flush. see also: 
http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:39:49 +00:00
apfelmaennchen
3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:39:51 +00:00
apfelmaennchen
cc207a979e - added new unified bookmark api to /xml/bookmarks/ 
the get_bookmarks api currently supports:
  .xml: posts, xbel, rss, flexigrid
  .json: posts, flexigrid
  .html: work in progress
- YaCy-UI: support for new bookmark api 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 12:29:19 +00:00
low012
f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 12:58:35 +00:00
orbiter
b2a8c653ee small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:21:44 +00:00
orbiter
8632eebf60 - added api icon to the web structure visualization 
- removed fixed horizontal menu
- the api icon in the search results can only be seen when display=1

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5461 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:42:20 +00:00
orbiter
4f45605f04 small update for timing in search result processing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:28:45 +00:00
lotus
66818a2f2e smaller api banner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 10:27:04 +00:00
lotus
4641ecd6d9 inurl: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5456 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-08 18:59:29 +00:00
orbiter
299189f1a9 added the API icon to the bookmarks, the network page and the search page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5455 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 23:45:20 +00:00
orbiter
a1bf687b3b added first API tooltip! 
- description of JSON search result in interactive search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5454 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 22:57:32 +00:00
lotus
0d1bd78674 * full site: syntax support e.g. site:de.wikipedia.org 
possible if dots in query would work yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5453 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 21:05:07 +00:00
orbiter
9bed4de280 fix for the search bug introduced in SVN 5449 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5451 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 23:16:10 +00:00
lotus
d6a5c98080 api banner concept draft 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5450 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 20:51:22 +00:00
orbiter
b2b7edae18 fixed interactive search 
- added dummy servlet class, because otherwise the template engine is not triggered.
thats so because the yacy httpd works much faster as normal file server without a scan
of the served pages. Therefore each page with templates must now have a class file associated to it.
- fixed json output format of yacysearch

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5449 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 20:04:09 +00:00
orbiter
c6880ce28b removed the permanent cache flush and replaced it with a periodic cache flush 
The cache is now flushed only for one second every ten seconds. During a crawl the cache
fills up completely, and is only flushed if space is needed for more documents.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5446 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 13:51:59 +00:00
lotus
ca80930892 accept leading dots on filetype: and site: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5444 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 10:04:24 +00:00
orbiter
6c7e83909b - refactoring of data access methods to be prepared for new cell data structure 
- removed a memory overhead in collections which prevent OOM Exception in low memory configurations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5443 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 09:38:08 +00:00
low012
1af728ae09 *) regex for site operator changed as proposed by Lotus 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5441 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-05 18:30:34 +00:00
low012
9e58ae036d *) added site operator which can be used to only show results from a certain domain. example: "test site:edu" shows only documents which contain the word test and which come from an edu domain 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5439 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 14:58:32 +00:00
low012
19e7c56f7f *) apply filter to dir list to only show .black files as blacklists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5438 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 10:14:19 +00:00
orbiter
c4c4c223b9 fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5437 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 02:27:29 +00:00
low012
4bffe664ca *) moved entry field for new expressions to top of the list as requested in forum (http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1678) 
*) added some Javascript to disable list selection on bottom of list in cases it is not needed (edit, delete) and only enable it if needed (move), if JS is turned off everything will work as usual

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5435 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-03 10:18:48 +00:00
low012
9d5d30f877 *) http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1672 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5422 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-31 16:50:10 +00:00
orbiter
5448aad328 removed unused code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5421 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-30 12:12:00 +00:00
orbiter
28d2d28573 added support for filetype search 
(just use filetype:<type> in the search query)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5418 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-29 17:57:04 +00:00
orbiter
78c568331e added test channel to /xml/feed.rss 
can be obtained with 
http://localhost:8080/xml/feed.rss?set=TEST
returns always a single feed entry with a fresh date

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5416 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-29 12:39:07 +00:00
orbiter
e004da48d3 - added fast fingerprint computation for files (any). Will be used in new index dump method 
- refactoring

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5415 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-29 12:22:13 +00:00
low012
eab72424df *) Fixed small bug: When adding new elements to blacklist via import, the blacklist which the elements were added to was supposed to be displayed, which did not work correctly. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5414 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-28 09:58:02 +00:00
low012
0e56675596 *) cleaning up ;-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5413 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-27 20:09:36 +00:00
low012
cf69557ea2 *) blacklists can be exported as XML or plain text now 
*) blacklist import via file upload works now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5412 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-27 15:38:20 +00:00
low012
1594a15be9 *) explicit mentioning of blacklist in blacklist cleaner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5411 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-27 13:06:05 +00:00
low012
5a89266598 *) new parameters for future use (better blacklist handling for im- and export) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5403 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-19 19:33:08 +00:00
orbiter
e34ac22fbd - added new monitoring servlet at 
http://localhost:8080/PerformanceConcurrency_p.html
- used the new monitoring to do some fine-tuning of the indexing queue

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5402 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-19 15:26:01 +00:00
orbiter
d376d81fc4 replaced busy thread control of crawl stacker by blocking threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5400 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-18 23:18:34 +00:00
orbiter
7535fd7447 - refactoring of CrawlEntry and CrawlStacker 
- introduced blocking queues in CrawlStacker to make it ready for concurrency
- added a second busy thread for the CrawlStacker
The CrawlStacker is multithreaded. It shall be transformed into a BlockingThread in another step.
The concurrency of the stacker will hopefully solve some problems with cases where DNS blocks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5395 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-17 22:53:06 +00:00
lotus
6569cbbec1 npe fix: http://forum.yacy-websuche.de/viewtopic.php?t=1646 
(break to avoid bad side effects)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5394 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-16 20:53:31 +00:00
orbiter
2802138787 - refactoring of CrawlStacker (to prepare it for new multi-Threading to remove DNS lookup bottleneck) 
- fix of shallBeOwnWord target computation heuristic


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5392 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-15 00:02:58 +00:00
lotus
b1e211b258 no error-alert: http://forum.yacy-websuche.de/viewtopic.php?t=1639 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5391 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-13 12:04:08 +00:00
orbiter
13cb0916ee changes to statistics and content of thread dump servlet 
(points now more directly to performance leaks without mentioning class calls inside of sun/java calls that cannot be changed anyway)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5390 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-11 20:13:14 +00:00
orbiter
e1acdb952c fix for problem with userDB and bookmarksDB which was caused by changes in kelondroRA in SVN 5376 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5385 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-08 00:17:45 +00:00
lotus
e918d64c23 show hand-cursor an labels 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5383 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-06 17:32:53 +00:00
orbiter
4a2dac659e more speed hacks: 
- modified and activated write buffer
- increased cache flush factor
- fixed a problem with deadlocking of indexing process

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5382 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-05 13:55:48 +00:00
lotus
1fb518a5b4 display <String> etc. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5380 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-04 20:21:53 +00:00
orbiter
47292e696a more performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5379 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-04 12:54:16 +00:00
orbiter
bd1dc9cd5d thread dump with statistics, a little bit of profiling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5377 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-03 23:26:25 +00:00
orbiter
d39d420b39 performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5376 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-03 15:38:29 +00:00
lotus
5280ad638d added basic performance page 
other performance settings can be found on advanced settings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5375 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-03 14:10:01 +00:00
lotus
1a51d9fcfd display proper values 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5374 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-02 17:57:30 +00:00
orbiter
0b4808ba3d added new interactive search feature: 
- during the user types search queries, the local database is searched
- results are presented interactively

This was implemented using a new JSON result format for search results in YaCy
- added JSON as file format for servlets
- refactoring of current search servlets (xml and html)
- added JSON output format for search results
- added AJAX-based search page, that uses the yacysearch.json selrvlet to print results as a query is typed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5373 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-12-02 15:24:25 +00:00
lotus
fea82b54ef more contrast on search snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5370 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-26 19:57:13 +00:00
lotus
1951d30a62 addendum to last commit 
handle words with length < 3 correctly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5369 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-26 19:43:40 +00:00
lotus
325ba7bfb8 only query words with length > 2 
this is not complete, yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5368 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-26 16:41:38 +00:00
lotus
489edb4473 improved pattern selection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5367 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-26 10:06:38 +00:00
low012
e423fa9846 *) added method to only get file names in directory listing which match a filter 
*) only files which end with .black will be listed as blacklists
*) added a little bit of Javadoc

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5366 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-25 20:26:06 +00:00
lotus
577b53aee6 added more search engines 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5365 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-24 13:05:20 +00:00
lotus
7f4d411c0d npe-fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5364 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-24 13:04:57 +00:00
lotus
1545e5440a * index deletion: checkbox-confirmation 
* watch crawler: less load on exhausted peers; wait for data before reloading again

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-23 12:02:58 +00:00
orbiter
10f5ec1040 reverted last commit (more testing needed) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5356 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-11-22 00:12:50 +00:00