Michael Peter Christen
316b5fe116
- added a solr type definition verifier
...
- fixed type definition found by the verifier
- added multivalue-string fields for solr with extension 'sxt'
- added multivalue-integer fields for solr with extension 'val'
- renamed some solr attributes from txt to sxt
- changed solr query line to an explicit AND/OR structure
- added a country code second level domain list to Domains class; with
parser
- added a host string parser to get domain class name, country-code
second-level domain and subdomain out of it
- removed old coordinate attributes
2012-08-28 16:58:06 +02:00
Michael Peter Christen
4521d63c92
added boosts to solr search queries
2012-08-27 15:25:25 +02:00
Michael Peter Christen
4c79ddb91e
switched off some solr logging
2012-08-27 14:41:47 +02:00
Michael Peter Christen
e8acd542b5
- added faceted drill-down for host and geolocation to solr queries
...
- added a new geolocation field to index schema, the old values are
migrated if possible
2012-08-27 14:41:33 +02:00
Michael Peter Christen
f00168ecc5
added gsa result attribute 'has'
2012-08-27 12:15:42 +02:00
orbiter
2094df2e4e
- correct length computation for BStringObject (bugfix suggested by
...
apfelmaennchen)
- using ASCII for string conversion for Strings generated from Integer
2012-08-26 17:46:40 +02:00
orbiter
6d03433cda
- added hack to prevent that stream servlet paths are not parsed wrongly
...
if the path contains a dot.
- added also warnings if documents are requests which do not exist.
2012-08-25 19:08:42 +02:00
orbiter
a1227879a9
release 1.1
2012-08-24 23:59:10 +02:00
orbiter
7ac259477f
added a direct access to solr search api to enhance the visibility if
...
the embedded solr
2012-08-24 23:04:19 +02:00
orbiter
67f2866cd0
small fixes
2012-08-24 21:44:22 +02:00
orbiter
ce156a01ba
Merge commit 'c2341a175fdd755a34965ff63c7ea437b380352d'
2012-08-24 18:24:24 +02:00
David Rubio
c2341a175f
Fixed a bug that prevented Yacy from indexing files with non ASCII filenames in FTP servers.
...
Previously Yacy could read file listings in UTF-8, but couldn't send commands to the FTP server in UTF-8 (the second byte of every multi-byte character was ignored), which caused a lot of errors on the server side.
Now it handles UTF-8 correctly.
2012-08-24 17:45:14 +02:00
orbiter
3ebc4264c5
fixed concurrent query
2012-08-24 14:15:40 +02:00
orbiter
29171e2f6c
fixed generation of ontologies from index enumerations
2012-08-24 14:13:42 +02:00
orbiter
7cd302de3e
omit xml parsing when using the embedded solr server
2012-08-24 12:18:30 +02:00
orbiter
787e1c6836
added the
...
QueryResponse query(SolrParams params)
method to the SolrServerConnector which is necessary to use facets in
solr search.
2012-08-23 11:53:54 +02:00
orbiter
01a63ef595
redesign of YaCySchema and SolrDoc handling
2012-08-23 09:51:45 +02:00
orbiter
479bfca571
refctoring
2012-08-23 09:30:11 +02:00
Michael Peter Christen
48a82bc705
log queries anonymous from gsa+solr requests
2012-08-22 23:50:40 +02:00
Michael Peter Christen
ab6ec4ec52
added snippet computation to solr/rss and gsa result writer
2012-08-22 17:37:34 +02:00
Michael Peter Christen
4716546ef5
- reduced memory usage in index transmission using a transformation of
...
Node to Row objects
- removed peerDeparture in solr remote search in case that peer does not
answer (this may be normal because it is allowed to switch this off)
2012-08-22 16:30:33 +02:00
Michael Peter Christen
af764c106c
re-activated audio and video search because they obviously work (!)
2012-08-22 01:56:13 +02:00
Michael Peter Christen
06b0081fdc
fix for NPE during host navigation computation
2012-08-22 01:55:39 +02:00
Michael Peter Christen
feb99bc291
fixed GSA format
2012-08-22 00:48:37 +02:00
Michael Peter Christen
653645c1cf
corrected solr query syntax
2012-08-22 00:48:03 +02:00
Michael Peter Christen
08ae142a3d
- enhanced caching after search queries to solr
...
- reduced caching after short memory
2012-08-22 00:31:14 +02:00
orbiter
716ea0cfe2
sorted the solr schema into mandatory and optional fields; reduced
...
number of used field to reduce solr index size
2012-08-21 23:52:56 +02:00
orbiter
9b8c8c0f47
fix from gaston in
...
http://forum.yacy-websuche.de/viewtopic.php?p=26909#p26909
2012-08-21 21:03:26 +02:00
orbiter
acb9f04e80
removed unused classes
2012-08-21 18:18:30 +02:00
Michael Peter Christen
0ad52ac4c3
gsa bugfix for date parser
2012-08-21 02:39:28 +02:00
Michael Peter Christen
3ce4c2f937
fixes for gsa result format
2012-08-21 01:57:46 +02:00
Michael Peter Christen
2d5fdfeb65
added authorization-based maximum results limitation to solr and gsa
...
search
2012-08-20 17:10:48 +02:00
Michael Peter Christen
67d235fae9
added gzip encoding to solr2sor http interface, client side (server
...
already works)
2012-08-20 16:53:21 +02:00
Michael Peter Christen
a049761e0c
fixed double-check
2012-08-20 14:16:37 +02:00
Michael Peter Christen
6fc5400f91
added a tooltip for search navigation to mention that search pages can
...
be navigated using the TAB key
2012-08-20 13:02:29 +02:00
Michael Peter Christen
f42a57cd7d
gsa format update
2012-08-20 12:50:51 +02:00
Michael Peter Christen
b3aad6cc35
bugfix for remote search when search is done to solr
2012-08-20 12:21:36 +02:00
Michael Peter Christen
ff3eaa21b0
added remote search to solr on YaCy peers!
...
- when doing a remote search, node peers are selected for solr queries
- the solr query is done concurrently to the standard YaCy rwi search
- the solr search result is feeded into the same data structure that
prepares the rwi search result
- the same remote seach that is done to several outside peers is done to
the local solr index
- the search process works now also without any 'old' RWI data using
solr
2012-08-20 12:16:11 +02:00
Michael Peter Christen
a06123aec6
more abstraction and less parameter overhead for remote search
2012-08-20 01:29:15 +02:00
Michael Peter Christen
f00733186b
code simplifications
2012-08-19 13:17:03 +02:00
Michael Peter Christen
755f5e76cf
removed strange assert statements and simplified code in metadata
...
transformation
2012-08-19 08:44:39 +02:00
Michael Peter Christen
db0d438709
fix for http://bugs.yacy.net/view.php?id=206
2012-08-19 08:43:56 +02:00
orbiter
404b0aab09
refactoring in remote search and stub for remote node peer selection
2012-08-18 23:59:25 +02:00
orbiter
d7ea45f698
- get nice text_t values from metadata conversions that are stored into
...
solr as fulltext search index.
- added slow migration from old metadata to solr index entries: each
entry from the old metadata is removed from that data structure and
written into solr.
2012-08-18 19:36:21 +02:00
orbiter
99ef57f103
reduced sleep times
2012-08-18 17:48:20 +02:00
orbiter
780f8974e7
added ramaining iteration methods for solr in fulltext class
2012-08-18 15:39:14 +02:00
orbiter
acd2dc3575
hack to removed StringBuilder overhead in query construction
2012-08-18 14:22:00 +02:00
orbiter
db6863db77
reduced solr cache sizes to check if that solves memory problems a bit
2012-08-18 13:45:37 +02:00
orbiter
6f01542aaa
explicit double-check in transferURL
2012-08-18 13:18:51 +02:00
orbiter
ee01c12e56
fixes for putDocument and putMetadata
2012-08-18 13:05:27 +02:00
