Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,707 Commits 1 Branch 20 Tags 836 MiB
f9fb2d0fee
Commit Graph

4707 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
lotus
f9fb2d0fee hide memory tables by default 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-27 06:59:24 +00:00
lotus
5f77f55ed7 possible fix for negative speed values 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-27 06:58:35 +00:00
danielr
79dba5445d init-script: fixed some variables to general defaults 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5018 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-24 19:04:35 +00:00
danielr
785688ef82 - creating pid-file under linux 
- added modified init-script (using startYACY.sh instead of doing the same thing)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-24 18:56:29 +00:00
orbiter
50ef5c406f - refactoring of robots parser (removed opaque Objects[] result vector) 
- added Allow-component to robots result object

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-24 11:54:37 +00:00
danielr
7913bdb75b Flextable: filename in errormessage if inconsistent 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-24 08:22:36 +00:00
lotus
d42eae25f8 yacyTray: 
fix for unproper shutdown
some messages

installer:
start shortcuts minimized

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-24 06:49:30 +00:00
danielr
7cec908813 dont't show HTTPC debug messages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5013 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-23 17:08:40 +00:00
orbiter
5f41913043 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1347&hilit=&p=9216#p9216 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5012 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-20 21:52:51 +00:00
orbiter
c3d461d191 - removed superfluous copyright statement 
- updated my email address

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-20 17:14:51 +00:00
orbiter
3ca98fee42 removed superfluous copyright statement 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-20 00:21:07 +00:00
danielr
c049d80fbd fixed login problem with yacy as proxy (POST and Cookies) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5009 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-19 15:10:00 +00:00
lotus
62afea0c9f some improvements for yacyTray 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5008 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-18 14:17:52 +00:00
danielr
af616a92ff fixed welcome message above image on custom search page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5007 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-18 13:41:06 +00:00
danielr
7c110e07f0 removed debug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-16 12:39:38 +00:00
danielr
10d01fdd0d addendum to 5002 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-16 09:47:48 +00:00
danielr
eadc204130 gzip POST wiederholbar gemacht (macht transferURL stabiler) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5004 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-16 09:46:25 +00:00
danielr
d14e8d348f - times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5003 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-15 17:35:02 +00:00
lotus
28c39e2aa4 fix for new starter files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-14 18:41:11 +00:00
danielr
b63a519456 fixed build problem 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5001 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-14 17:44:49 +00:00
danielr
e12438142e - warning instead of NPE if urlHash is not in index of CrawResults 
- times of LOCAL_SEARCH are shown in milliseconds


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-14 09:12:58 +00:00
lulabad
5784070f6e added user agent 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-14 08:38:11 +00:00
lulabad
3e26aca356 added startYACY_debug.bat to dist Target 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4998 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 20:32:28 +00:00
lotus
fa695c2d9f tray is now only shown on Windows and doesn't block on linux 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 19:03:38 +00:00
lotus
d77ed28e2f temporary disabled tray because of flaws on only-shell-linux 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4996 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 08:41:39 +00:00
lotus
adeb881288 fix for building Windows installer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4995 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 08:17:20 +00:00
lotus
b704cf1fbc * no need to update the searchpage links anymore 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4994 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 07:55:20 +00:00
lotus
0bb7c42bc8 rename of Windows start scripts 
* startYACY.bat -> startYACY_debug.bat
* startYACY_noconsole.bat -> startYACY.bat

changes for Windows Installer
* do not set shortcuts to the YaCy search page because we have a tray icon now. the user will not get an error if yacy doesn't run.
* do not set a shortcut do debug start. usual users don't care about logs.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4993 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 07:54:51 +00:00
lotus
f8a1e3175e new yacyTray 
this will make a YaCy icon in the tray area on supported platforms
enabled by default
the search page will open on double click

used JDIC 0.9.4 from https://jdic.dev.java.net/

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-13 07:51:45 +00:00
daburna
4a7e5f377e added translation for new customization pages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-12 12:27:33 +00:00
orbiter
05c26d58d9 fixed missing remove operation in balancer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 12:03:18 +00:00
orbiter
606b323a2d fixed bug that appeared when a new crawl ist started 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4989 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 10:59:06 +00:00
orbiter
38eb5bd1ee fixed a bug in kelondroBLOBHeap. The following files are probably inconsistent and should be deleted: 
DATA/HTCACHE/responseHeader.heap
DATA/PLASMADB/crawlRobotsTxt.heap

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4988 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 10:38:20 +00:00
orbiter
28d5703f8a - fixed a bug in Robots.txt loader which could have caused that robots.txt files had been loaded from the same domain more than once 
- patch in BLOBHeap to prevent OOM during startup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4987 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 09:12:54 +00:00
orbiter
7b1c9e6aee discovered and removed a (possibly large) memory leak: 
many classes used the kelondroMapDataMining (was: kelondroMapObjects) which adds statistical
functions to the kelondroMap (was: kelondroObjects), but these functions were not used by these
classes. Especially the HTCACHE and robots.txt database allocate a very large number of objects
for statistical use, but never used them. By replacing the kelondroMapDataMining with the
kelondroMap object for these classes now less memory is allocated.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4986 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 07:34:48 +00:00
orbiter
0f5fe8cc53 refactoring of method calling for objects from kelondroMapDataMining 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4985 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 07:15:46 +00:00
orbiter
01d1ae6676 patch for negative time in case that the time of the computer is changed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4984 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 07:05:08 +00:00
lotus
bac758bc5a * update to JRE 6u7 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4983 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-11 05:26:55 +00:00
orbiter
4acf0a61cd refactoring of kelondroObjects (mainly renaming to kelondroMap) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4982 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-10 22:08:16 +00:00
orbiter
441e9c861e fix for npe in HTCache cleaning process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4981 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-10 21:30:39 +00:00
orbiter
f7aaeb3fad created new main menu entry 'Customization and Integration' 
- moved some already existing servlets to this menu
- renamed the skin servlet to appearance
- added a set-to-default-button to the search page appearance setting
- removed the peer profile servlet which is now replaced by a field in the new appearance servlet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4980 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-10 19:57:09 +00:00
lotus
5488543b8f disabled disk usage logpoints 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4979 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-10 07:30:50 +00:00
orbiter
1e6d12f146 Major update to BLOB data structures: 
- introduced a new BLOB file format: kelondroBLOBHeap. This is a flat file with an index in RAM.
  very similar to the eco-tables, but with flexible value sizes. It will replace the kelondroBLOBTree,
  which is based on a kelondroTree, a file-AVL-based index data structure.
- the HTCACHE header file was replaced by the new blob heap file structure
- the robots.txt file was replaced by the new blob heap file structure
- the robots parser was enhanced (bugfixing for double-loading of the same robots.txt)
- other BLOB-dependent data structures were prepared to use also the new BLOB heap
- fixed a bug in the snippet fetch process: the file header was not written to the header index
There should now be less IO during snippet fetch and during crawling


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4978 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-10 00:47:37 +00:00
orbiter
81f75f5056 - removed unnecessary classes (these objects are much easier to handle using generics) 
- generalized BLOB referencing. This is the preparation to use another BLOB class, the kelondroHeap


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4977 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-07 23:52:53 +00:00
orbiter
b38f467e3c better SRU compliance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4976 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-07 21:50:24 +00:00
f1ori
3980dd7554 * maske ampersan & Co. in xbel export 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4975 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-07 21:30:11 +00:00
orbiter
7052f2f61f - added copyright header of ResourceObserver 
- commented/removed some code to eliminate code warnings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4974 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-07 00:40:45 +00:00
orbiter
1400cdc91e - refactoring of resourceObserver (moved it to crawler) 
- partly redesign of diskUsage: little bit more functional behavior, less side effects, better error case handling
- the resourceObserver can now show a error message if the diskUsage is 'out of order'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4973 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-07 00:03:37 +00:00
f1ori
f0012554de * improved localsearch.sh: 
* read port from DATA/SETTINGS/yacy.conf
  * use curl or wget, depending on what is available


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4972 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-06 16:48:41 +00:00
f1ori
b6301a54fa * added class ListDirs to provoid generic listing of directories in systemdirectories and jar-files 
* yacy runs, when classes are in a jar-file (->build-jar ant-target)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4971 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-07-06 14:11:40 +00:00