Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
5,219 Commits 1 Branch 20 Tags 836 MiB
fe77fc3d62
Commit Graph

3312 Commits

Author SHA1 Message Date
orbiter
fe77fc3d62 - added new property setting 'repositoryPath' 
which can be used to map any path to http://localhost:8080/repository/
  This can be used to do an intranet-indexing without the setting of
  symbolic links - which does not work in Windows environment.
  Now also Windows users can index their file system easily
  using the intranet use case.
- fixed some problems with the identification of the alternative
  path in DATA/HTDOCS in the httpd file server

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5538 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-30 13:30:36 +00:00
orbiter
6cbca1e508 extended last fix, preventing more sorts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5533 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 16:42:01 +00:00
orbiter
f9672d3f97 applied fix for inefficient put method as recommended by celle, see 
http://forum.yacy-websuche.de/viewtopic.php?p=12424#p12424

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5532 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-29 16:08:24 +00:00
apfelmaennchen
3484e55be4 - small fix for bookmarksDB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5527 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 06:57:11 +00:00
apfelmaennchen
6dd52422ea - added two dialogs to manage bookmark tags in YaCy-UI 
- fixed renameTag() in bookmarksDB
- added /api/bookmarks/tags/addTag.xml
- added /api/bookmarks/tags/editTag.xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5525 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-28 00:15:43 +00:00
orbiter
3154926311 some better memory protection and OOM prevention in EcoFS 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5523 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-26 20:29:20 +00:00
f1ori
aaafe05c02 * revert debug change 
* contains instead of startsWith, because there might me localizied strings
* decode punycode for every domainpart seperately (see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1749)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5516 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-24 00:33:38 +00:00
f1ori
5570fa817b * remove & from openBrowser command (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728&hilit=#p12321) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5515 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-23 22:37:00 +00:00
orbiter
419469ac27 added more methods to control the vertical DHT (not yet active .. ) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5514 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-23 15:32:27 +00:00
lotus
4ef6b15eb8 limit -Xmx setting to 1999m on win32. bigger values would never work. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5513 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-23 15:13:09 +00:00
orbiter
dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5511 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-22 00:03:54 +00:00
orbiter
b74159feb8 preparations to integrate the new 'cell' index data structure 
(this commit is just to move development files to my other computer, no functionality change so far)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5509 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-21 18:23:37 +00:00
orbiter
d399444e49 added debug information to class loader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5508 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-21 18:20:15 +00:00
orbiter
5080fc33bf fix for http://forum.yacy-websuche.de/viewtopic.php?p=12247#p12247 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5506 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-20 22:57:58 +00:00
orbiter
335d6ce8fc fix for class loading problem 
see also http://forum.yacy-websuche.de/viewtopic.php?p=12153#p12153

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5505 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-20 22:47:58 +00:00
low012
78778df464 *) this should adjust the Dev/Main detection of the updater to the new version numbers (0.7x is Dev, if x != 0) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5504 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-18 21:48:03 +00:00
orbiter
b423d0a036 moved all servlets from htroot/xml to htroot/api 
the file server contains a patch that temporary matches all xml paths to api,
that means all interfaces still work. Please adopt all your interfaces to the new path.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5497 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-15 23:52:58 +00:00
orbiter
91af105373 last changes before release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5493 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 23:49:08 +00:00
f1ori
7eade3f181 * fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5489 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 21:42:00 +00:00
orbiter
d1bace5e4d enhanced cleanup function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5488 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 15:34:11 +00:00
orbiter
cb76d9e0e4 more synchronized in BLOBHeap (will not fix problem with Runtime-Error as reported in forum) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5487 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 13:22:29 +00:00
orbiter
ff41da613e removed exception printout during load of snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5484 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:30:19 +00:00
orbiter
814a28775f removed thread dump writing in case of invocation target exception in httpd (looked bad, not serious) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5483 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:27:01 +00:00
orbiter
bed38a5f8c fix for uncaught exception in RSSReader 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5482 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:20:37 +00:00
orbiter
05c235de32 fix for npe 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5481 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-13 00:10:42 +00:00
low012
7608944081 *) bugfix for REMOTE_HOST environment variable in CGI code (shows hostname of client instead of hostname of YaCy peer now) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5480 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 22:15:00 +00:00
orbiter
a6b29cf72c reverted change of search event processing in SVN 5460. The new code did not work properly, 
it gave remote search requests too less time


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5479 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 15:06:22 +00:00
orbiter
9ef77d57f5 added an access control to the search interface using white/blacklists: 
in the network configuration, you can configure a whiteliste and a blacklist
- blacklistet clients cannot search
- whitelistet client get never any search restrictions
- for all other clients: apply DoS search restrictions
Please see the example configuriation in yacy.network.freeworld.unit
by default, all clients from localhosts get whitlistet.
If you have your own YaCy network, please put all the IPs of your peers into the whitelist

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5475 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-12 10:55:48 +00:00
orbiter
efe801173c better dht-in cache flush. see also: 
http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:39:49 +00:00
orbiter
941ab78d9b better termination for blocking threads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5471 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 22:34:08 +00:00
apfelmaennchen
3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:39:51 +00:00
orbiter
e948df68ac longer timeout for queues during shutdown 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5469 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:10:09 +00:00
orbiter
2b32248079 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5468 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-11 19:02:50 +00:00
low012
c1330f5743 *) added environment variable DOCUMENT_ROOT 
*) caught exception

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5466 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 18:31:10 +00:00
low012
f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 12:58:35 +00:00
orbiter
b2a8c653ee small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5464 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:21:44 +00:00
orbiter
f675d47f86 better protection against database failures 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5463 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-10 09:19:46 +00:00
orbiter
4f45605f04 small update for timing in search result processing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 15:28:45 +00:00
orbiter
9d119c6b61 migration of auto-update rules to new release strategy: 
next stable will be 0.7, development releases are 0.*x, experimental will be if x = 1, 2, 3

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5458 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 10:08:11 +00:00
orbiter
4d5b401f00 try to fix some performance problems with the internal index management: 
- ensuring that ordered indexes stay ordered during remove
- no unnecessary ordering checks
- better test logic in crawl stacker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5457 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-09 00:06:36 +00:00
borg-0300
a0605325bb fixed a NullPointer Exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5452 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-07 15:44:09 +00:00
orbiter
b2b7edae18 fixed interactive search 
- added dummy servlet class, because otherwise the template engine is not triggered.
thats so because the yacy httpd works much faster as normal file server without a scan
of the served pages. Therefore each page with templates must now have a class file associated to it.
- fixed json output format of yacysearch

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5449 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 20:04:09 +00:00
lotus
2be119f0df adjusted big peer to 28M links 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5448 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 18:20:06 +00:00
orbiter
c6880ce28b removed the permanent cache flush and replaced it with a periodic cache flush 
The cache is now flushed only for one second every ten seconds. During a crawl the cache
fills up completely, and is only flushed if space is needed for more documents.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5446 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 13:51:59 +00:00
orbiter
ef7fe537c5 fixed a cache-bug in cachedFileRA 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5445 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 10:51:56 +00:00
orbiter
6c7e83909b - refactoring of data access methods to be prepared for new cell data structure 
- removed a memory overhead in collections which prevent OOM Exception in low memory configurations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5443 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-06 09:38:08 +00:00
lotus
c8451614f3 fix for overflow 
http://forum.yacy-websuche.de/viewtopic.php?p=11696#p11696

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5440 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-05 18:28:27 +00:00
orbiter
c4c4c223b9 fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5437 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-04 02:27:29 +00:00
orbiter
6072831235 no cr transmission for robinson peers 
see also: http://forum.yacy-websuche.de/viewtopic.php?p=10290#p10290

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5436 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-03 23:44:42 +00:00
low012
afe98bc11c *) added changes as proposed by Halborinda in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1674 
*) changed indention

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5434 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-01-03 08:24:08 +00:00