Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
11,040 Commits 1 Branch 20 Tags 836 MiB
338f574bdc
Commit Graph

11040 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Peter Christen
338f574bdc no sorting if http/www unique fields are not demanded (makes query 
faster) and some code restrucuring
 2014-08-04 12:59:38 +02:00
Michael Peter Christen
1609763be5 toString fix 2014-08-04 12:58:39 +02:00
Michael Peter Christen
b983e68254 more retries, less sleep 2014-08-04 08:29:35 +02:00
Michael Peter Christen
1503ba7794 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-08-04 08:24:31 +02:00
reger
8f77719091 fix "Ljava.lang.String" in crawl queue anchor name 
(e.g. IndexCreateQueues_p.html?stack=LOCAL with images in queue)
 2014-08-04 02:38:58 +02:00
Michael Peter Christen
0ceeceb35e more logic on Solr queries; usage of the query terms in posprocessing, 
saving one query for double document detection now per document
 2014-08-04 02:35:38 +02:00
reger
3963bca3b6 catch IndexControlRWIs_p error if RWI not connected 2014-08-04 00:03:42 +02:00
orbiter
38864ae004 Merge branch 'master' of git@gitorious.org:yacy/rc1.git 2014-08-03 22:44:49 +02:00
orbiter
4099296b45 added new classes which shall reduce call overhead to Solr (stub) 2014-08-03 22:44:22 +02:00
reger
d0c02e1de7 adjust rss lat/lon to double 
(common format across other classes)
 2014-08-03 20:09:23 +02:00
orbiter
3491ab4c38 removed unused images from webgraph edge computation 2014-08-01 13:21:16 +02:00
orbiter
2371d6b8db target linktexts must be string to enable search facets on these fields 2014-08-01 13:20:25 +02:00
Michael Peter Christen
001e05bb80 do not store failure of loading of robots.txt into the index as a fail 
document
 2014-08-01 12:15:14 +02:00
Michael Peter Christen
05d58e4df0 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-08-01 12:04:25 +02:00
Michael Peter Christen
98f45c9032 fix for image alt attachment to AnchorURLs in html parser. 2014-08-01 12:04:15 +02:00
orbiter
22ce4fb4dd better error handling for remote solr queries and exists-checks 2014-08-01 11:00:10 +02:00
reger
b510b182d8 - update Maven pom 
- add ppt parser test case
 2014-08-01 01:47:53 +02:00
Marc Nause
3dcfc717eb This hopefully fixes http://mantis.tokeek.de/view.php?id=424 2014-07-29 22:02:11 +02:00
Marc Nause
9df14fc126 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-07-29 21:26:43 +02:00
Marc Nause
477be17c51 Replaced old UPNP library with Weupnp. UPNP should 
work now, at least it does on my network. UPNP code in YaCy can still
be improved though (see TODO comment: make port on gateway configurable
or find free one).

*) removed old code
*) added new lib
*) changed code to work with new lib
 2014-07-29 21:26:27 +02:00
orbiter
738989aab7 reverted commit f94c91315b because the 
webgraph has not enough performance for that
 2014-07-29 18:49:42 +02:00
orbiter
e9163e7e10 fix for malformed hostpath names in crawl balancer 2014-07-29 11:18:45 +02:00
orbiter
161a11070c yacystats is gone :( 2014-07-29 11:12:01 +02:00
Michael Peter Christen
c115f3869c enhanced snippet computation and test method in ViewFile 2014-07-28 15:42:57 +02:00
reger
6c10b59f3e move bootstrap peers test systems to its test class 
var assignment not needed  elsewhere.
 2014-07-27 04:13:07 +02:00
reger
7328c2883b fix type in .init description 
http://mantis.tokeek.de/view.php?id=430
 2014-07-26 00:38:53 +02:00
reger
94819f0797 set .ini default boost fields to same as assigned by button "reset to default" 
(in RankingSolr_p)
- fix typo http://mantis.tokeek.de/view.php?id=430
 2014-07-26 00:17:41 +02:00
reger
b4b937a046 update to pdfbox 1.8.6 2014-07-25 23:55:10 +02:00
orbiter
1027f3d04a fix for the usage of ready-prepared solr queries, some queries are 
formulated as edismax query but this was not set as query attribut. The
defType=edismax property needs a qf-field, so this was added as well. Do
not remove that field again! This fixes also a problem with title-unique
computation.
 2014-07-25 18:53:13 +02:00
Michael Peter Christen
f94c91315b if the webgraph is used, then use it also for reference computation to 
avoid contradictions with references_i in the collection index.
 2014-07-24 15:35:53 +02:00
Michael Peter Christen
6e1dc444c3 added a snippet test function in ViewFile: you can now search for a 
specific word on the document; the servlet returns the snippet in the
same way as it would be shown in a search result.
 2014-07-24 14:59:37 +02:00
Michael Peter Christen
c63e93df46 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-07-24 00:04:56 +02:00
Michael Peter Christen
1bf605b6d1 toString() fix 2014-07-24 00:04:46 +02:00
orbiter
4b06adb751 fix for file urls 2014-07-23 17:54:31 +02:00
orbiter
08409ec680 no idea why the words max was an ordered one. This change increaes speed 
dunring document processin a bit
 2014-07-23 17:54:16 +02:00
reger
dd311ddac9 Merge origin/master 2014-07-22 22:01:01 +02:00
reger
e5854a5cdb fix localhost link to opensearchdescription.xml 2014-07-22 21:57:38 +02:00
reger
29d1945c16 fix double &query parameter (index.html) 
?query=word&query=
 2014-07-22 21:54:46 +02:00
Marc Nause
172d7e68da Updated commandline reconfiguration tool. 
*) fixed "set HTTP port" (root cause was sloppy implementation of method
which gets values from config file)
*) added "set HTTPS port"
 2014-07-22 21:52:53 +02:00
Michael Peter Christen
b44626e55b fixed target_alt_t in webgraph 2014-07-22 18:24:10 +02:00
Michael Peter Christen
504327b15c fix for condition for writing the webgraph 2014-07-22 00:59:08 +02:00
Michael Peter Christen
542c20a597 changed handling of crawl profile field crawlingIfOlder: this should be 
filled with the date, when the url is recognized as to be outdated. That
field was partly misinterpreted and the time interval was filled in. In
case that all the urls which are in the index shall be treated as
outdated, the field is filled now with Long.MAX_VALUE because then all
crawl dates are before that date and therefore outdated.
 2014-07-22 00:23:17 +02:00
Michael Peter Christen
4eec1a7452 refactoring (change Metadata name of load time data structure to avoid 
confusion with Node data which is also called metadata)
 2014-07-21 23:54:23 +02:00
reger
c95ba52cf0 improve logexception info 
- log a message or class name insted of msgtxt "null"
 2014-07-21 22:13:34 +02:00
reger
7f0e757bb5 fix bookmark.rss 
- channel end tag postion
- link with html entity
 2014-07-21 19:26:12 +02:00
orbiter
e441831a24 reverted toString() change in AnchorURL to prevent mistakenly used 
toString(). This fixes also the update link bug.
 2014-07-21 15:58:29 +02:00
reger
697b9743e7 Add link to RemoteCrawl_p 
suggestion http://mantis.tokeek.de/view.php?id=277
 2014-07-21 02:00:05 +02:00
reger
47f201a6b8 Add Solr default query fields (&qf) to select servlet 
according to the ranking profiles boost fields defined by the peer (if df/qf is not specified in query).
This allows for pretty simple queries ( q=word) without the need to know about the specific index configuration.
Making sure all relevant fields (as determined by the index owner) are searched, still maintaining the option to query specific fields
and does not relay on the duplication of text to text_t.
- add author to reset-default boost fields (support results for author nav)
 2014-07-21 00:47:14 +02:00
reger
f96cfdc84d prevent array out of bound exception on getRankingProfile(x) 
on faulty &profileNr=  query parameter
 2014-07-21 00:04:54 +02:00
Michael Peter Christen
970368359b Merge branch 'master' of ssh://gitorious.org/yacy/rc1 2014-07-20 22:35:40 +02:00