Commit Graph

5604 Commits

Author SHA1 Message Date
orbiter
5fb77116c6 added a submenu to index administration to import a wikimedia dump (i.e. a dump from wikipedia) into the YaCy index: see
http://localhost:8080/IndexImportWikimedia_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5930 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-08 07:54:10 +00:00
hermens
df733af4fa Try not to loose content from ram during IndexCell.delete by moving ram.delete after the dangerous operations on the array (array.get and array.delete)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5929 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-06 12:53:17 +00:00
hermens
ac72005f2f Let IndexCell.remove remove entries from the ram portion of the DB as well.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5928 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-06 12:32:34 +00:00
orbiter
8ba7ff5353 a fix and another speed enhancement for the RWI cache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5927 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 22:40:40 +00:00
orbiter
05f077e85f added stack trace output to solve problem in
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2076&hilit=&p=14612#p14612

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5926 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 20:24:20 +00:00
orbiter
71a4cadf31 better and more performant synchronization in SimpleARC, the caching object for word hashes. Speeds up indexing.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5925 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 20:19:51 +00:00
orbiter
e6773cbb33 better handling of RWI cache for concurrency and less overhead when writing new entries -> even more indexing speed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5924 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 20:08:23 +00:00
low012
ae334c7b83 *) -l and -d enable asserts now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5923 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 18:49:51 +00:00
orbiter
c097531e3d added a catch Exception to all thread to check if any of them silently dies without any other notification
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5922 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 06:31:35 +00:00
orbiter
083533e5ec fix for bugs in IODispatcher
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5921 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-04 21:37:59 +00:00
orbiter
21fbca0410 better scaling of HEAP dump writer for small memory configurations;
should prevent OOMs during cache dumps

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5920 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-04 08:29:44 +00:00
orbiter
6e0b57284d better care for states of the IODispatcher
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5919 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-03 22:54:47 +00:00
orbiter
1db9cdd4e4 fixed bug in writing of robots.txt entries in case that host names exceeded 64 characters and some other problems
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5918 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-03 19:35:10 +00:00
apfelmaennchen
492165338d small addition for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5917 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 12:12:33 +00:00
f1ori
bde88b684a * splitt off yacyRelease from yacyVersion
* added some gui infos about signatures


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5916 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 12:12:22 +00:00
apfelmaennchen
ac3139a1fd fix for live-search positioning in header.template
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5915 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 11:56:55 +00:00
orbiter
057ce14c8e more fixes (character encoding, parser exceptions, http client failure, blob writing)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5914 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 07:43:03 +00:00
lulabad
c3cd70b461 better human readable date format
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5913 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 06:56:08 +00:00
orbiter
d2ac0aa682 - fixed possible bugs in Stack (may affect Crawler reset) and RandomAccess handling
- increased default memory size to 180MB
- fixed possible bug in http client reset (there was a deadlock)
- bug in BOBHeap marked, but not solved, cause is still unknown.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5912 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 01:40:03 +00:00
apfelmaennchen
acfd79ab4a yacyui-portalsearch: added keyboard controlls
ESC: close window
PageDown: next search result page
PageUp: prev. page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5911 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 10:34:56 +00:00
apfelmaennchen
f490eab6ba yacyui-portalsearch: clear input on window close
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5910 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 10:06:24 +00:00
lotus
1351d903a1 don't follow links like mailto:
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5909 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 08:53:50 +00:00
orbiter
e88a66bcae temporary disabling computation of all sublinks (check needed)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5908 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 07:30:53 +00:00
low012
ff5f82d780 *) removed description of removed commands from wikiHelp ([= =])
*) used format function of Netbeans for wikiCode to make it more readable, no functional changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5907 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 07:28:59 +00:00
orbiter
eacf95213a fix for crawling of mailto-links
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5906 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-01 07:25:55 +00:00
orbiter
9c6ac43f66 fixes for wiki parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5905 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-30 22:03:35 +00:00
orbiter
3a64c9d02f - fix for problem with concurrency when computing word hashes
- fix for search in case that a urlfilter was used and zero results were returned

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5904 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 22:14:12 +00:00
orbiter
d3f8aa5a2a set of small fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5903 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 21:36:20 +00:00
low012
78ffb61297 *) got rid of unnecessary variable which might also fix IndexOutOfBoundsException
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5902 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 21:08:44 +00:00
apfelmaennchen
84518710d0 small fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5901 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 19:51:42 +00:00
apfelmaennchen
63097513ae maybe this smoothens the timing problems yacyui-portalsearch.js a little bit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5900 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 18:52:20 +00:00
orbiter
d31e6f9c14 fix for http://forum.yacy-websuche.de/viewtopic.php?p=14457#p14457
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5899 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-29 11:18:17 +00:00
lotus
0e01e846ef small fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5898 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-28 18:59:56 +00:00
lotus
d8fca85c11 fixed search: allow dots in operators
added new operator "tld:" which was the former "site:"
"site:" uses fast site operator introduced in r5770

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-28 17:12:31 +00:00
orbiter
8d6212233b fix for IODispatcher
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5896 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-28 07:24:28 +00:00
orbiter
f678472f46 fix for quote problem in json output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5895 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 22:27:02 +00:00
orbiter
d079d6dfdb small changes in surrogate reader, wiki code and portal test
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5894 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 20:30:43 +00:00
orbiter
07f09742bb set of small fixes and comments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 15:29:50 +00:00
orbiter
d9e62508e5 fixed a NPE bug (from SVN 5888)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 12:52:12 +00:00
borg-0300
06ed4ef7b3 * better picture handling
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5891 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 11:19:15 +00:00
orbiter
5a634cab23 removed generation of anchor link sets in document types that describe container formats.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5890 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-27 08:46:11 +00:00
orbiter
50e96ee894 - moved live search window in yacy to different location
- changed div id for live seach from 'yacy' to 'yacylivesearch'

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5889 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 21:04:31 +00:00
apfelmaennchen
dd489fcce0 fixed some json encoding problems in yacysearchitem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5888 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 19:17:36 +00:00
apfelmaennchen
0b4e4bbddd fixed css interferance for previous posts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5887 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 18:46:05 +00:00
apfelmaennchen
ed4fb3bf75 small fix to portal search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5886 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 18:30:21 +00:00
apfelmaennchen
753affca4b - request: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=2041#p14336
- integrated portal search in yacy web interface


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 18:22:28 +00:00
apfelmaennchen
4cf8b08eec Portal Search:
- request: http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&start=50#p14350
- window closes for empty query
- example for fancy input field

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5884 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 17:44:11 +00:00
apfelmaennchen
42d936288e small update for RichClient LogViewer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 17:20:08 +00:00
low012
f1244264b8 *) hopefully fixed bug reported in http://forum.yacy-websuche.de/viewtopic.php?t=2057
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5882 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 16:18:14 +00:00
lotus
2714ff034b avoid undefined in rssTerminal
thanks to freq.9! http://forum.yacy-websuche.de/viewtopic.php?p=14288

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-04-26 11:45:36 +00:00