Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
5,165 Commits 1 Branch 20 Tags 836 MiB
ff41da613e
Commit Graph

5165 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
ff41da613e removed exception printout during load of snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5484 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:30:19 +00:00
orbiter
814a28775f removed thread dump writing in case of invocation target exception in httpd (looked bad, not serious) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5483 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:27:01 +00:00
orbiter
bed38a5f8c fix for uncaught exception in RSSReader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:20:37 +00:00
orbiter
05c235de32 fix for npe 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5481 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:10:42 +00:00
low012
7608944081 *) bugfix for REMOTE_HOST environment variable in CGI code (shows hostname of client instead of hostname of YaCy peer now) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5480 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 22:15:00 +00:00
orbiter
a6b29cf72c reverted change of search event processing in SVN 5460. The new code did not work properly, 
it gave remote search requests too less time


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5479 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 15:06:22 +00:00
lotus
c7c291bc6b allow simultaneous inurl: site: and filetype: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5478 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 14:59:27 +00:00
lotus
d162cce6b4 classpath update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5477 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 13:39:04 +00:00
lotus
e54d588a15 "patterns as defined by match operator in java" as r5475 says 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5476 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 13:36:36 +00:00
orbiter
9ef77d57f5 added an access control to the search interface using white/blacklists: 
in the network configuration, you can configure a whiteliste and a blacklist
- blacklistet clients cannot search
- whitelistet client get never any search restrictions
- for all other clients: apply DoS search restrictions
Please see the example configuriation in yacy.network.freeworld.unit
by default, all clients from localhosts get whitlistet.
If you have your own YaCy network, please put all the IPs of your peers into the whitelist

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 10:55:48 +00:00
orbiter
ac89e8e84d removed unused search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5474 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 08:45:12 +00:00
apfelmaennchen
9b26dfec80 small fix to correct encoding of xml output 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5473 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:50:53 +00:00
orbiter
efe801173c better dht-in cache flush. see also: 
http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:39:49 +00:00
orbiter
941ab78d9b better termination for blocking threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5471 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:34:08 +00:00
apfelmaennchen
3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:39:51 +00:00
orbiter
e948df68ac longer timeout for queues during shutdown 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5469 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:10:09 +00:00
orbiter
2b32248079 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:02:50 +00:00
apfelmaennchen
cc207a979e - added new unified bookmark api to /xml/bookmarks/ 
the get_bookmarks api currently supports:
  .xml: posts, xbel, rss, flexigrid
  .json: posts, flexigrid
  .html: work in progress
- YaCy-UI: support for new bookmark api 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5467 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 12:29:19 +00:00
low012
c1330f5743 *) added environment variable DOCUMENT_ROOT 
*) caught exception

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5466 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 18:31:10 +00:00
low012
f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 12:58:35 +00:00
orbiter
b2a8c653ee small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:21:44 +00:00
orbiter
f675d47f86 better protection against database failures 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5463 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:19:46 +00:00
f1ori
37e1cb139d * some improvements of the initscript for debian 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5462 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 20:53:08 +00:00
orbiter
8632eebf60 - added api icon to the web structure visualization 
- removed fixed horizontal menu
- the api icon in the search results can only be seen when display=1

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5461 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:42:20 +00:00
orbiter
4f45605f04 small update for timing in search result processing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:28:45 +00:00
lotus
66818a2f2e smaller api banner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 10:27:04 +00:00
orbiter
9d119c6b61 migration of auto-update rules to new release strategy: 
next stable will be 0.7, development releases are 0.*x, experimental will be if x = 1, 2, 3

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5458 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 10:08:11 +00:00
orbiter
4d5b401f00 try to fix some performance problems with the internal index management: 
- ensuring that ordered indexes stay ordered during remove
- no unnecessary ordering checks
- better test logic in crawl stacker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5457 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 00:06:36 +00:00
lotus
4641ecd6d9 inurl: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5456 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-08 18:59:29 +00:00
orbiter
299189f1a9 added the API icon to the bookmarks, the network page and the search page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5455 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 23:45:20 +00:00
orbiter
a1bf687b3b added first API tooltip! 
- description of JSON search result in interactive search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5454 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 22:57:32 +00:00
lotus
0d1bd78674 * full site: syntax support e.g. site:de.wikipedia.org 
possible if dots in query would work yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5453 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 21:05:07 +00:00
borg-0300
a0605325bb fixed a NullPointer Exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5452 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 15:44:09 +00:00
orbiter
9bed4de280 fix for the search bug introduced in SVN 5449 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5451 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 23:16:10 +00:00
lotus
d6a5c98080 api banner concept draft 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5450 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 20:51:22 +00:00
orbiter
b2b7edae18 fixed interactive search 
- added dummy servlet class, because otherwise the template engine is not triggered.
thats so because the yacy httpd works much faster as normal file server without a scan
of the served pages. Therefore each page with templates must now have a class file associated to it.
- fixed json output format of yacysearch

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5449 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 20:04:09 +00:00
lotus
2be119f0df adjusted big peer to 28M links 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5448 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 18:20:06 +00:00
lotus
4ec1aacde1 prevent indexing from windows indexing service 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5447 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 18:17:53 +00:00
orbiter
c6880ce28b removed the permanent cache flush and replaced it with a periodic cache flush 
The cache is now flushed only for one second every ten seconds. During a crawl the cache
fills up completely, and is only flushed if space is needed for more documents.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5446 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 13:51:59 +00:00
orbiter
ef7fe537c5 fixed a cache-bug in cachedFileRA 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5445 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 10:51:56 +00:00
lotus
ca80930892 accept leading dots on filetype: and site: search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5444 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 10:04:24 +00:00
orbiter
6c7e83909b - refactoring of data access methods to be prepared for new cell data structure 
- removed a memory overhead in collections which prevent OOM Exception in low memory configurations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5443 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 09:38:08 +00:00
f1ori
5ce9d81955 * remove class-file from old location 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5442 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-05 21:19:30 +00:00
low012
1af728ae09 *) regex for site operator changed as proposed by Lotus 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5441 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-05 18:30:34 +00:00
lotus
c8451614f3 fix for overflow 
http://forum.yacy-websuche.de/viewtopic.php?p=11696#p11696

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5440 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-05 18:28:27 +00:00
low012
9e58ae036d *) added site operator which can be used to only show results from a certain domain. example: "test site:edu" shows only documents which contain the word test and which come from an edu domain 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5439 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 14:58:32 +00:00
low012
19e7c56f7f *) apply filter to dir list to only show .black files as blacklists 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5438 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 10:14:19 +00:00
orbiter
c4c4c223b9 fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5437 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 02:27:29 +00:00
orbiter
6072831235 no cr transmission for robinson peers 
see also: http://forum.yacy-websuche.de/viewtopic.php?p=10290#p10290

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5436 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-03 23:44:42 +00:00
low012
4bffe664ca *) moved entry field for new expressions to top of the list as requested in forum (http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1678) 
*) added some Javascript to disable list selection on bottom of list in cases it is not needed (edit, delete) and only enable it if needed (move), if JS is turned off everything will work as usual

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5435 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-03 10:18:48 +00:00