f1ori
b0724e5ec0
* add config option to disable cookie monitoring (disabled by default)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5028 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 21:19:06 +00:00
lotus
f0dfb858d8
reverted balloon messages from r5014. don't try to annoy the user. ;)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5027 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 07:42:02 +00:00
lotus
cafa1a952f
- performance settings refactoring: made headlines to fieldsets
...
- show performance profiles more prominent for easier configuration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5026 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 07:37:11 +00:00
f1ori
6952b13c08
* fix automatic decrementing accepted remote crawl limit:
...
-> http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1355
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5025 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-29 18:52:48 +00:00
f1ori
d02a26d642
* added lock icon to ConfigAppearance menu item
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5024 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-28 21:09:19 +00:00
f1ori
0baa8d651e
* marked some text as labels for checkboxes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5022 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 11:39:42 +00:00
lotus
f9fb2d0fee
hide memory tables by default
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5020 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 06:59:24 +00:00
lotus
d42eae25f8
yacyTray:
...
fix for unproper shutdown
some messages
installer:
start shortcuts minimized
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5014 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 06:49:30 +00:00
orbiter
5f41913043
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1347&hilit=&p=9216#p9216
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5012 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 21:52:51 +00:00
orbiter
c3d461d191
- removed superfluous copyright statement
...
- updated my email address
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 17:14:51 +00:00
orbiter
3ca98fee42
removed superfluous copyright statement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 00:21:07 +00:00
danielr
af616a92ff
fixed welcome message above image on custom search page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5007 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-18 13:41:06 +00:00
danielr
10d01fdd0d
addendum to 5002
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-16 09:47:48 +00:00
danielr
d14e8d348f
- times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5003 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-15 17:35:02 +00:00
danielr
b63a519456
fixed build problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5001 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 17:44:49 +00:00
danielr
e12438142e
- warning instead of NPE if urlHash is not in index of CrawResults
...
- times of LOCAL_SEARCH are shown in milliseconds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 09:12:58 +00:00
lulabad
5784070f6e
added user agent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4999 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 08:38:11 +00:00
lotus
b704cf1fbc
* no need to update the searchpage links anymore
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4994 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 07:55:20 +00:00
lotus
f8a1e3175e
new yacyTray
...
this will make a YaCy icon in the tray area on supported platforms
enabled by default
the search page will open on double click
used JDIC 0.9.4 from https://jdic.dev.java.net/
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4992 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 07:51:45 +00:00
daburna
4a7e5f377e
added translation for new customization pages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4991 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-12 12:27:33 +00:00
orbiter
f7aaeb3fad
created new main menu entry 'Customization and Integration'
...
- moved some already existing servlets to this menu
- renamed the skin servlet to appearance
- added a set-to-default-button to the search page appearance setting
- removed the peer profile servlet which is now replaced by a field in the new appearance servlet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4980 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-10 19:57:09 +00:00
orbiter
1e6d12f146
Major update to BLOB data structures:
...
- introduced a new BLOB file format: kelondroBLOBHeap. This is a flat file with an index in RAM.
very similar to the eco-tables, but with flexible value sizes. It will replace the kelondroBLOBTree,
which is based on a kelondroTree, a file-AVL-based index data structure.
- the HTCACHE header file was replaced by the new blob heap file structure
- the robots.txt file was replaced by the new blob heap file structure
- the robots parser was enhanced (bugfixing for double-loading of the same robots.txt)
- other BLOB-dependent data structures were prepared to use also the new BLOB heap
- fixed a bug in the snippet fetch process: the file header was not written to the header index
There should now be less IO during snippet fetch and during crawling
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4978 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-10 00:47:37 +00:00
orbiter
b38f467e3c
better SRU compliance
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4976 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-07 21:50:24 +00:00
f1ori
3980dd7554
* maske ampersan & Co. in xbel export
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4975 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-07 21:30:11 +00:00
orbiter
a6719dfd2b
- refactoring of robots parser
...
- no more keep-order parameter in remove (it was not possible to make this strict, and not useful)
- some small enhancements in balancer
- robots parser without references in switchboard
- changes synchronization in robots
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4969 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-05 00:35:20 +00:00
orbiter
e81be7d4f2
added many missing user-agent declarations for yacy http client connections.
...
the most important fix was the addition of the yacybot user-agent for robots.txt loading,
because web masters look for that access to see if the crawler behaves correctly.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4968 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-04 11:03:03 +00:00
orbiter
474e29ce4a
added options to configure the 'corporate identity'-icons, the home page link and the greeting line from
...
the skin menue. Additionally an example is given there how to integrate a search page with an iframe.
Please see the skin menu.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4967 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-03 23:37:04 +00:00
orbiter
474659a71f
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
...
- added option to set minimum crawl delta for domains in balancer
- added default values to crawl deltas in yacy.init
- added configuration for these deltas in performance queues
- enhanced performance setting computation (more time for indexing queue for a faster flush
- remote crawling is now enabled during local crawling if indexer has space and time for more links
- added database stub for new distributed file system
- refactoring of time computation to get an abstraction level that will be used by a TTL rule in new distributed file system
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4966 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-03 13:08:37 +00:00
lotus
1afc36d9a8
* update to JRE 6u6
...
* fix for proper translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4965 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-02 13:36:42 +00:00
orbiter
8e179f6588
removed option to do a re-crawl with a period of minutes. Such a short time does not make sense and it may cause endless indexing loops. The removing of the option will ensure that a misuse is prevented.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4964 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-01 23:47:33 +00:00
danielr
da917cf4b1
undo reduced menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4960 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-30 07:11:13 +00:00
danielr
0c1dc703e4
- set staticIP at startUp
...
- added setting for reduced menu (simpleMenu)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4959 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-29 18:35:15 +00:00
lotus
f6b92456c0
confirm bookmark delete
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4958 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-27 05:48:29 +00:00
lotus
4a53649ee7
fixed dht-urls and ranking distribution log statistics
...
* NOTE: please have in mind that there can be whitespaces in pathnames
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4956 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-26 07:12:03 +00:00
lotus
8d83185cb4
fixed dht-chunks/protocol log statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4955 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-25 08:15:07 +00:00
danielr
63eadfdf84
fixed unlimited FileSizeLimit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4954 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-24 19:11:27 +00:00
lotus
2dc7c00c1c
fixed indexing log statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4953 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-24 07:01:04 +00:00
low012
0a956d1b11
*) removes focus on text field on search result page ( http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1257 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4945 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-20 16:46:30 +00:00
danielr
01e9c7320e
PerformanceProfile: don't change peerPing, peerSeed and cleanUp
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4938 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-19 12:39:45 +00:00
orbiter
c998dc6556
- added security functions to flush url and search caches in case that memory is full
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4933 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-16 21:39:58 +00:00
lotus
877299cc74
better installer on Windows Vista
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4927 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-14 18:34:12 +00:00
danielr
68c38c2d34
- WatchCrawler shows status without JavaScript
...
- Performance can be scaled + DHT-profile
- names for pool-threads
- some small refactorings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4923 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-14 10:24:58 +00:00
lotus
fc79f013c4
better solution to update shortcut
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4920 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-12 20:04:32 +00:00
orbiter
994c609cf8
added new shell script to do a web search from the terminal
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4916 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-11 21:33:36 +00:00
lotus
48edbef5c7
* fix: display proper port on 1st startup
...
* new message on portchange
* first implementation of external link-update for search page (still inactive)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4915 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-11 19:04:39 +00:00
orbiter
f5ef7f222e
- fixed a bug in parser (directory paths had not been recognized)
...
- no access check when a search is made only local without snippet fetch
- added comment and status message in resourceObserver (this takes very long at startup time!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4911 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-11 09:54:58 +00:00
danielr
48f87db7f1
added performance profiles (to be fine-tuned)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4910 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-10 19:23:38 +00:00
daburna
73051ecb37
corrected wrong link
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4908 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-09 14:30:16 +00:00
det
af8f7b8bba
add image rising while mouse over in Collage
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4898 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-07 18:33:04 +00:00
lotus
260553c3a5
better messages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-07 14:24:11 +00:00