Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-22 00:00:59 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
5,739 Commits 1 Branch 20 Tags 836 MiB
f348190566
Commit Graph

2621 Commits

Author SHA1 Message Date
orbiter
f348190566 tried to insert a database dump import method to the phpBB3 import function. Reason: imports or large database dumps are cannot be handled with phpMyAdmin and this should be an easy way to the database dumps into a mySQL database where it can be exported again with the phpBB3 content integration adapter. Completion or removal of this function stub will follow before next main release. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 23:03:40 +00:00
orbiter
945777aa80 replaced rwi term counting method by one that computes the maximum of the blobs that contibute to the RWI. An addition of the blob sizes is wrong/incorrect and does not reflect the real size. Truncation the size operation to the maximum of all blobs is also incorrect, but not as wrong as the sum of all blob sizes wich double-counts many rwi entries. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6064 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 22:59:54 +00:00
apfelmaennchen
303ccda69f small fix for "did you mean" 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6063 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 11:11:30 +00:00
orbiter
7c4d1d471c hand-over of more specific object 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6062 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 10:22:25 +00:00
apfelmaennchen
9150bc0f7d - don't show empty "did you mean" 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6061 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 07:02:50 +00:00
apfelmaennchen
6c116be536 - set default &meanCount=5 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6060 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 06:49:17 +00:00
apfelmaennchen
09acfa66d1 - improved "did you mean" 
- added &meanCount= to query string
- &meanCount=0 ==> no suggestion, no performance loss
- sorting suggestions by sb.indexSegment.termIndex().count()

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6059 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-13 06:20:05 +00:00
apfelmaennchen
54a48b4184 - added "did you mean" to search page 
- currently works for single word queries only!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6057 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-12 20:36:03 +00:00
apfelmaennchen
31360ba40c - Updated ConfigLiveSearch.html 
- added documentation for load_js and load_css

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6056 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-12 05:57:08 +00:00
apfelmaennchen
ab09d8ebb3 - small noscript fix 
- noscript is now functionall but ugly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6055 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-11 22:10:02 +00:00
apfelmaennchen
55ef9ae12a small fix for last post 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-11 21:42:34 +00:00
apfelmaennchen
36dc9b09ac - partial update to jquery-1.3.2 
- partial update to jquery-ui-1.7.2
- yacyportalsearch fixed sidebar for navigators


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6053 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-11 21:34:39 +00:00
orbiter
cffef67dc5 added a short info line about the latency monitor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6048 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-10 23:03:29 +00:00
orbiter
733385cdd7 enahnced database access times by removal of unnecessary synchronization. 
added also more hacks that resulted from high-volum query testing

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6047 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-10 23:02:42 +00:00
apfelmaennchen
5a7dec880e - some improvements for: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15668 
- portalsearch: introduced yconf.load_js and yconf.load_css
- yacysearch.html still having problems with focus after sidebar is loaded
- yacysearchtrailer.json seems not to be valid json for ?nav=all

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-10 22:11:31 +00:00
orbiter
b21e9149f5 another fix for navigation results, the json result format and searches with yacyinteractive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6041 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-10 12:41:15 +00:00
orbiter
15c5406b9c fixed yacyinteractive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6040 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-10 07:24:45 +00:00
orbiter
e0b3984805 added navigation keys for site and author facets to remote search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6038 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-09 09:07:52 +00:00
orbiter
27fa6a66ad - completed the author navigation 
- removed some unused variables

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6037 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-08 23:30:12 +00:00
orbiter
a9a8b8d161 - added display of author navigation (usage of that navigator not yet implemented 
- added a synchronization in pdf parser which should help to avoid deadlocks that occur when displaying several search results pointing to pdf sources
- fixed smaller bugs in navigation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6036 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-08 22:01:26 +00:00
orbiter
c879783008 added steering of navigator computation: 
- by default the navigator computation if off for servlet yacysearch.html, but:
- the servlet is called by default with a option to switch navigator results on
this will prevent that metasearch users will get slow results that are caused by unnecessary computations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6035 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-07 22:51:15 +00:00
orbiter
c079b18ee7 - refactoring of IntegerHandleIndex and LongHandleIndex: both classes had been merged into the new HandleMap class, which handles (key<byte[]>,n-byte-long) pairs with arbitraty key and value length. This will be useful to get a memory-enhanced/minimized database table indexing. 
- added a analysis method that counts bytes that could be saved in case the new HandleMap can be applied in the most efficient way. Look for the log messages beginning with "HeapReader saturation": in most cases we could save about 30% RAM!
- removed the old FlexTable database structure. It was not used any more.
- removed memory statistics in PerformanceMemory about flex tables and node caches (node caches were used by Tree Tables, which are also not used any more)
- add a stub for a steering of navigation functions. That should help to switch off naviagtion computation in cases where it is not demanded by a client

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6034 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-07 21:48:01 +00:00
orbiter
a0c53abbe1 - wait until local results are computed during search, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2167&hilit=&p=15521#p15521 
- show only x+1 pages in page navigator

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6022 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-04 20:58:47 +00:00
orbiter
94f3d90af2 added a hint about regular expressions in crawl start 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6021 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-04 20:03:26 +00:00
orbiter
1c77db670f re-designed response format for navigation: 
- changed json and rss response templates


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-04 10:54:49 +00:00
orbiter
15fad767c0 some refactoring of topic generation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6018 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-03 23:49:06 +00:00
orbiter
f28f62fb21 added servlet for easy wiki content and search window integration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-03 22:22:20 +00:00
lotus
efe97f446a better proxy configuration in case of remote proxy 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-03 19:03:03 +00:00
orbiter
cc49aedf12 - fixed problem with remote search NPE 
- more abstraction for search requests

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-03 08:49:54 +00:00
apfelmaennchen
55ff919b5d - yacysearchtrailer.html ... just an idea for a timeline 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6012 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 16:47:39 +00:00
orbiter
ab06a6edd2 renamed topwords to topics and enhanced computation methods of topics 
topics will now only be computed using the document title, not the document url,
because the host navigator is now responsible for statistical effects of urls.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6011 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 15:20:10 +00:00
lotus
61d9e131b4 better/new proxy auto config 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 12:18:29 +00:00
apfelmaennchen
0d44a6d503 - yacy portalsearch experiments with navigation in sidebar (topwords & domains) 
- not yet functional ...

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6009 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 11:02:36 +00:00
apfelmaennchen
9f9a1b4ad8 - yacysearchtrailer.html small temporary work around for jquery-css display bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6008 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 09:08:34 +00:00
apfelmaennchen
b0e2d854e0 - fixed sidebar for yacysearch.html & yacysearchtrailer.html 
- @orbiter: please do not use <h2> or <h1> tags in the context of the sidebar!!!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6007 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-02 07:32:45 +00:00
orbiter
a5d481eab1 enhanced navigation 
- fixed too early computation of navigation
- moved navigation rendering to yacysearchtrailer
- added more asserts

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-01 22:45:28 +00:00
orbiter
3ca1f109c4 added more jquery themes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6005 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-01 21:49:18 +00:00
orbiter
3ea399ec91 fix for absolute paths for repository path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6004 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-01 10:54:41 +00:00
lotus
6b92155eb6 corrected spelling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6003 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-01 09:48:08 +00:00
orbiter
5eac607166 fixed configuration of repository path 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-06-01 00:13:23 +00:00
apfelmaennchen
daee735ad7 - fix for yacysearch.html 
- navigation/sidebar JavaScript is now also triggerd by #(navigation)# instead of display=3

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6001 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-31 07:29:24 +00:00
apfelmaennchen
8fe69da2bb - some fixes for prev. post 
- better resizing and dragging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6000 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-30 17:06:47 +00:00
apfelmaennchen
0eb3bffe97 - added 'drawer' (sidebar) for future navigational items to yacyui-portalsearch.js 
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15311

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-30 14:32:29 +00:00
apfelmaennchen
34af8b4877 - yacysearch.html compromise for positioning the sidebar 
- position is now fixed on the right top side
- should scale down to window width 800px, smaller windows will cause distortions
- see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15293

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:57:09 +00:00
orbiter
4522c13ee7 added option for a table prefix when importing phpbb3 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5996 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:29:02 +00:00
orbiter
3d5f2ff544 - added new servlets to support search portal administrators for the integration of yacy search fields in their web pages 
- moved some servlets from here to there..
- changed menu structure
- removed yacyui-portaltest.html which contained an example for the live search which is now integrated on all pages in yacy. The code snippet example from that page is integrated into the ConfigLiveSearch.html servlet


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5994 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 14:16:03 +00:00
orbiter
88426912ad more refactoring to make the segment object easier to use and to be prepared to integrate author navigation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-29 10:03:35 +00:00
orbiter
99bf0b8e41 refactoring of plasmaWordIndex: 
divided that class into three parts:
- the peers object is now hosted by the plasmaSwitchboard
- the crawler elements are now in a new class, crawler.CrawlerSwitchboard
- the index elements are core of the new segment data structure, which is a bundle of different indexes for the full text and (in the future) navigation indexes and the metadata store. The new class is now in kelondro.text.Segment

The refactoring is inspired by the roadmap to create index segments, the option to host different indexes on one peer.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-28 14:26:05 +00:00
orbiter
fec6f9054f some refactoring of search methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5988 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 23:51:34 +00:00
orbiter
4b4bddca00 added new submenu to crawler menu: import of phpbb3 forum postings from mysql 
- yacy can import phpbb3 posts without crawling
- all data is written as surrogate
- indexed surrogate files can be re-used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5985 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2009-05-27 14:53:23 +00:00