Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,144 Commits 1 Branch 20 Tags 836 MiB
4588b5a291
Commit Graph

7144 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
155d556568 - better memory protection 
- more logging
- little bit of refactoring

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-27 13:21:18 +00:00
mikeworks
a16e5e7a63 ConfigPortal.html: Added safe space character because empty <dt> produces a warning in HTML validator 
de.lng: Added translation for added ConfigPortal selection for target selection and WikiHelp changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7277 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-26 21:14:37 +00:00
f1ori
7d8de34778 * add a bit documentation to DigestURI, use DigestURI(string) instead of DigestURI(string, null) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-26 16:10:20 +00:00
orbiter
25a8e55bc9 more logging about bad seeds 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7275 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-26 15:00:22 +00:00
orbiter
959b8c6fa0 - allow greater seed size 
- more logging for bad seeds

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7274 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-26 14:40:19 +00:00
orbiter
e103419a56 - removed <3 peers barrier for peer ping feedback 
- more logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7273 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-26 13:08:09 +00:00
apfelmaennchen
d0e6c03b51 some updates to the new bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-25 22:44:05 +00:00
orbiter
facfd204e9 added a parent configuration option. 
see /ConfigPortal.html
requested here:
http://forum.yacy-websuche.de/viewtopic.php?p=21099#p21099

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7271 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-25 22:16:07 +00:00
orbiter
e3964f2c31 better catch of network definition load error; continue with secondary network load definition location 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7270 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-25 09:20:45 +00:00
apfelmaennchen
7adfe4a1c1 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=35#p21092 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7269 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-25 08:12:04 +00:00
low012
b8d6784410 *) WikiCode help page update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7268 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-25 00:30:10 +00:00
low012
65a0381f76 *) cleaning up code (still not done) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-24 23:57:07 +00:00
orbiter
e3e3b49d52 - enhanced main release recognition 
- yacybot user agent now includes the yacy network name (not the peer name!)
- refactoring and clean-up (mostly turned tab into spaces)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7266 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-24 21:43:01 +00:00
apfelmaennchen
9c94ebdee4 small changes to new bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-22 13:14:09 +00:00
apfelmaennchen
244b56e9d3 an update to the new bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7264 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-21 19:18:17 +00:00
mikeworks
96e625c541 AccessTracker: Fixed table output while no results are displayed --> all of AccessTracker should now validate XHTML 1.0 Strict, also tfoot must be defined before tbody 
Connections_p: Added static protocol "http" for incoming connections because only http pool is queried and -UNRESOLVED PATTERN- is not really useful
de.lng: Minor changes and removed one old line

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-19 03:26:18 +00:00
low012
dc40f51b8d *) added headlines as proposed by Vega 
*) <pre> will be displayed monospaced in wiki and blog again
*) bugfix for <pre> spanning multiple lines
*) replaced deprecated <s> tag with <span> equivalent

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7262 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 23:00:43 +00:00
apfelmaennchen
f035f257da added some more bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7261 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 21:09:41 +00:00
low012
22ed9c380c *) fixed bug which was introduced in r7226 (shame on me) which made wiki unusable (all entries were stored with empty subject as key -> edits were lost) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7260 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 21:06:23 +00:00
f1ori
60fd2e549d * log failures when writing config file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7259 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 15:00:29 +00:00
orbiter
58e74282af added a word counter statistic in condenser which is used by the did-you-mean to calculate best matches for given search words. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 11:35:09 +00:00
orbiter
2a0eb09e08 enhanced html id names and tag cloud visualization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 09:36:49 +00:00
orbiter
863065abc4 added user agent logging to access tracker 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7256 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-18 08:09:59 +00:00
mikeworks
61e87c0b14 IndexControlRWIs_p.html, IndexControlURLs_p.html, ViewFile.html/.java: changes to HTML output and &nbsp; in case of empty values for XHTML strict / transitional validation 
de.lng: Added missing translation for Show Content and changed existing line 
--> Index Administration should now correctly validate XHTML 1.0 Strict / Trans

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-17 16:51:29 +00:00
apfelmaennchen
a79728b97d some updates to experimental bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-17 09:58:50 +00:00
apfelmaennchen
ef782cd026 and even more experimental bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-16 10:20:41 +00:00
orbiter
ed4371dcf3 enhanced navigation implementation and enhanced tag cloud computation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7252 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-15 23:45:12 +00:00
orbiter
ca738ac924 - added a tag cloud to search results (using the topics) 
- some refactoring of score classes
- added default package for new classes add_ymark and delete_ymark

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-15 22:01:39 +00:00
apfelmaennchen
7aca763ca8 Some more experimental bookmark code... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-15 12:53:41 +00:00
apfelmaennchen
4270ed696c Experimental code (I need to transfer the code to my macbook, sorry) for the new bookmarks API based on the Tables concept (same as for crawl starts). Currently you can add a bookmark by api/ymarks/add_ymark.xml?url=http://www.yacy.net&title=YaCy and watch the result via the standard view Tables_p.html. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-15 05:40:19 +00:00
orbiter
e4d561971e added more score cluster options and made score cluster usage more transparent 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-14 11:40:02 +00:00
orbiter
e8f90201a5 fix for scheduling of rss feeds 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7247 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-13 13:00:36 +00:00
orbiter
7cd9d9d22a - enhanced DidYouMean computation using a faster count on index entries; this causes that results can be ranked better 
- added limitations on DidYouMean result sets according to input and output string length

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7246 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 22:02:10 +00:00
apfelmaennchen
beb65437d2 additional fix for the widget - now a second result page is loaded automatically in case of too little search results for the scroll event to trigger 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 21:55:24 +00:00
apfelmaennchen
2bb0c9b503 Fix for search widget keyup event handling. ESC will close the widget window and RIGHT will load additional search results, especially when the scroll event won't work because of too litte results. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7244 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 21:28:28 +00:00
orbiter
de722090b5 enhancements in did-you-mean guessing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7243 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 09:45:15 +00:00
orbiter
a59c885ee0 autocomplete and did-you-mean can now understand _all_ languages and can generate suggestions in all languages and character types 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7242 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 08:36:33 +00:00
orbiter
b7acd92ce4 Auto-Suggestions for YaCy Search: 
- added a suggest servlet according to opensearch and firefox standard
- integrated the suggest servlet into opensearch description file
- integrated a autocomplete plugin for jquery
- added a autocomplete addition to the yacy search windows showing autosuggest queries

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 01:23:49 +00:00
mikeworks
67b3b4b13b de.lng: Added translation for skin color picker on http://demo.zuum.net:8080/ConfigAppearance_p.html 
ConfigAppearance_p.html: Some HTML 1.0 Strict changes on the Customization page http://demo.zuum.net:8080/ConfigAppearance_p.html
--> Now all Customization pages should validate XHTML 1.0 strict

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7240 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-12 01:03:10 +00:00
orbiter
24f1cba7b2 performance hacks: 
- faster generation of index abstract compression during remote search
- less synchronization in IO record reading
- request index abstract generation only if necessary and faster time-out in remote search 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7239 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-11 12:44:07 +00:00
orbiter
6a166c2040 patches for bad proxy behaviour 
- accept ipv6 localhost clients
- index media files (url only)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7238 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-11 11:38:36 +00:00
orbiter
d607b30b6a performance enhancements for search and code review for database functions 
- removed read cache from Records data structure because the read cache had no cache hit during search operation
- copied old read-cache class to CachedRecords and the old, now new Records class does not have the cache any more and a code review checked that data structures and synchronization is clean
- removed unnecessary synchronization from Table class during get()

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7237 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-11 11:01:50 +00:00
orbiter
6d61b80fb6 added ColorPicker to WatchWebStructure 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7236 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-11 08:57:40 +00:00
orbiter
45b1ab3d07 custom + generic skins: 
- added a generic skin which is filled with actual color assignment using a servlet
- enabled css servlets
- added a generic color scheme in configuration file
- added configuration input in Customization/Appearance servlet
- added a jquery color picker widget
- placed color picked widget to input field of generic colour definition input fields

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-11 00:00:10 +00:00
mikeworks
41bf8ef9f9 de.lng: Added translation for Link List option in Crawl Site page http://localhost:8080/CrawlStartSite_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7234 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-10 10:44:15 +00:00
orbiter
fcd40cd30f - disabled domZones (buggy, must think about better solution) 
- increased time-out for dns resolver and isLocal property

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7233 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-09 10:17:50 +00:00
orbiter
ec38eca278 fix for new URI equal method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7232 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-09 09:27:31 +00:00
orbiter
0d363a94d7 more performance hacks 
this makes YaCy search results VERY fast for all verify=false search cases
and it enhances the search speed also for all other snippet-fetch cases.
With this change my peer performed 100 Queries Per Second (!!!) while doing 10 queries simultanously (!!!)
in an intranet index of 20000 URLs on my 16-core Mac

Check this yourself by doing:
cd bin
./searchtestmulti.sh
after finishing the run, divide 1000 by the given time per query (which is the qps for one thread)
and then multiply again by 10 (because 10 search threads has been started)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7231 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-09 08:55:57 +00:00
orbiter
b8aee6d402 performance hacks for better search performance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7230 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-08 23:50:28 +00:00
orbiter
11bebe356b fixed crawl start: with SVN 7225 the name of the crawl start url was not given in input field and therefore all crawl starts had contained the empty string as crawl start url 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7229 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-10-08 22:02:24 +00:00