Michael Peter Christen
528d6763fa
- added new solr fields:
...
title_count_i, title_chars_val, title_words_val
description_count_i, description_chars_val, description_words_val
- added many asserts to ensure data type correctness from YaCy to Solr
and vice versa
- made many fixes according to new findings from these asserts (!)
2012-08-31 10:30:43 +02:00
Michael Peter Christen
3142e675e8
fixed problems with GSA api:
...
- better FS attribute
- highlightning of searched words in title
2012-08-29 16:48:53 +02:00
Michael Peter Christen
3b19fe7b52
- fixed num parameter in GSA api
...
- changed FS attribute in GSA api
2012-08-29 16:28:32 +02:00
Michael Peter Christen
2ddc33646a
added new field for solr:
...
url_paths_sxt
url_parameter_i
url_parameter_key_sxt
url_parameter_value_sxt
url_chars_i
2012-08-29 16:11:23 +02:00
Michael Peter Christen
75d5e3475d
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-08-29 10:13:51 +02:00
cominch
a2841261bd
content control: apply filter if enabled to crawls
2012-08-29 09:52:14 +02:00
cominch
dc468dad01
add content control features for custom filter lists
2012-08-29 09:04:28 +02:00
Michael Peter Christen
316b5fe116
- added a solr type definition verifier
...
- fixed type definition found by the verifier
- added multivalue-string fields for solr with extension 'sxt'
- added multivalue-integer fields for solr with extension 'val'
- renamed some solr attributes from txt to sxt
- changed solr query line to an explicit AND/OR structure
- added a country code second level domain list to Domains class; with
parser
- added a host string parser to get domain class name, country-code
second-level domain and subdomain out of it
- removed old coordinate attributes
2012-08-28 16:58:06 +02:00
orbiter
a3d5959981
Merge commit '65d49df865f60511d22d86fb15c33a082176e7ab'
2012-08-27 16:56:22 +02:00
Michael Peter Christen
4521d63c92
added boosts to solr search queries
2012-08-27 15:25:25 +02:00
Michael Peter Christen
4c79ddb91e
switched off some solr logging
2012-08-27 14:41:47 +02:00
Michael Peter Christen
e8acd542b5
- added faceted drill-down for host and geolocation to solr queries
...
- added a new geolocation field to index schema, the old values are
migrated if possible
2012-08-27 14:41:33 +02:00
Michael Peter Christen
f00168ecc5
added gsa result attribute 'has'
2012-08-27 12:15:42 +02:00
reger
65d49df865
security fix: clear automtic password only if adminAccountForLocalhost=false to prevent remote access to protected pages after restart.
...
if adminAccountForLocalhost=true leave automatic password unchanged so access from local host is granted but remote access is preventet from the 1st second.
2012-08-26 22:28:14 +02:00
reger
52a62af184
Merge branch 'master' of git://gitorious.org/yacy/rc1.git
2012-08-26 22:12:59 +02:00
orbiter
2094df2e4e
- correct length computation for BStringObject (bugfix suggested by
...
apfelmaennchen)
- using ASCII for string conversion for Strings generated from Integer
2012-08-26 17:46:40 +02:00
reger
2d2be546fe
fix path to env/grafics to display api icon on meta data page
2012-08-26 04:36:52 +02:00
orbiter
6d03433cda
- added hack to prevent that stream servlet paths are not parsed wrongly
...
if the path contains a dot.
- added also warnings if documents are requests which do not exist.
2012-08-25 19:08:42 +02:00
orbiter
a1227879a9
release 1.1
2012-08-24 23:59:10 +02:00
orbiter
7ac259477f
added a direct access to solr search api to enhance the visibility if
...
the embedded solr
2012-08-24 23:04:19 +02:00
orbiter
67f2866cd0
small fixes
2012-08-24 21:44:22 +02:00
orbiter
ce156a01ba
Merge commit 'c2341a175fdd755a34965ff63c7ea437b380352d'
2012-08-24 18:24:24 +02:00
David Rubio
c2341a175f
Fixed a bug that prevented Yacy from indexing files with non ASCII filenames in FTP servers.
...
Previously Yacy could read file listings in UTF-8, but couldn't send commands to the FTP server in UTF-8 (the second byte of every multi-byte character was ignored), which caused a lot of errors on the server side.
Now it handles UTF-8 correctly.
2012-08-24 17:45:14 +02:00
orbiter
3ebc4264c5
fixed concurrent query
2012-08-24 14:15:40 +02:00
orbiter
29171e2f6c
fixed generation of ontologies from index enumerations
2012-08-24 14:13:42 +02:00
orbiter
7cd302de3e
omit xml parsing when using the embedded solr server
2012-08-24 12:18:30 +02:00
orbiter
787e1c6836
added the
...
QueryResponse query(SolrParams params)
method to the SolrServerConnector which is necessary to use facets in
solr search.
2012-08-23 11:53:54 +02:00
orbiter
01a63ef595
redesign of YaCySchema and SolrDoc handling
2012-08-23 09:51:45 +02:00
orbiter
479bfca571
refctoring
2012-08-23 09:30:11 +02:00
Michael Peter Christen
48a82bc705
log queries anonymous from gsa+solr requests
2012-08-22 23:50:40 +02:00
Michael Peter Christen
ab6ec4ec52
added snippet computation to solr/rss and gsa result writer
2012-08-22 17:37:34 +02:00
Michael Peter Christen
4716546ef5
- reduced memory usage in index transmission using a transformation of
...
Node to Row objects
- removed peerDeparture in solr remote search in case that peer does not
answer (this may be normal because it is allowed to switch this off)
2012-08-22 16:30:33 +02:00
Michael Peter Christen
af764c106c
re-activated audio and video search because they obviously work (!)
2012-08-22 01:56:13 +02:00
Michael Peter Christen
06b0081fdc
fix for NPE during host navigation computation
2012-08-22 01:55:39 +02:00
Michael Peter Christen
feb99bc291
fixed GSA format
2012-08-22 00:48:37 +02:00
Michael Peter Christen
653645c1cf
corrected solr query syntax
2012-08-22 00:48:03 +02:00
Michael Peter Christen
08ae142a3d
- enhanced caching after search queries to solr
...
- reduced caching after short memory
2012-08-22 00:31:14 +02:00
orbiter
716ea0cfe2
sorted the solr schema into mandatory and optional fields; reduced
...
number of used field to reduce solr index size
2012-08-21 23:52:56 +02:00
orbiter
9b8c8c0f47
fix from gaston in
...
http://forum.yacy-websuche.de/viewtopic.php?p=26909#p26909
2012-08-21 21:03:26 +02:00
orbiter
acb9f04e80
removed unused classes
2012-08-21 18:18:30 +02:00
Michael Peter Christen
0ad52ac4c3
gsa bugfix for date parser
2012-08-21 02:39:28 +02:00
Michael Peter Christen
3ce4c2f937
fixes for gsa result format
2012-08-21 01:57:46 +02:00
Michael Peter Christen
2d5fdfeb65
added authorization-based maximum results limitation to solr and gsa
...
search
2012-08-20 17:10:48 +02:00
Michael Peter Christen
67d235fae9
added gzip encoding to solr2sor http interface, client side (server
...
already works)
2012-08-20 16:53:21 +02:00
Michael Peter Christen
a049761e0c
fixed double-check
2012-08-20 14:16:37 +02:00
Michael Peter Christen
6fc5400f91
added a tooltip for search navigation to mention that search pages can
...
be navigated using the TAB key
2012-08-20 13:02:29 +02:00
Michael Peter Christen
f42a57cd7d
gsa format update
2012-08-20 12:50:51 +02:00
Michael Peter Christen
b3aad6cc35
bugfix for remote search when search is done to solr
2012-08-20 12:21:36 +02:00
Michael Peter Christen
ff3eaa21b0
added remote search to solr on YaCy peers!
...
- when doing a remote search, node peers are selected for solr queries
- the solr query is done concurrently to the standard YaCy rwi search
- the solr search result is feeded into the same data structure that
prepares the rwi search result
- the same remote seach that is done to several outside peers is done to
the local solr index
- the search process works now also without any 'old' RWI data using
solr
2012-08-20 12:16:11 +02:00
Michael Peter Christen
a06123aec6
more abstraction and less parameter overhead for remote search
2012-08-20 01:29:15 +02:00