Michael Peter Christen
a0f1decd82
- added loading of the dbpedia pnd triplestore in the dictionary loader
...
- renamed the dictionary loader to knowledge loader
- some refactoring in the library provider method names
2012-06-15 19:19:18 +02:00
cominch
3c255c025b
Show tags in search results (if activated in ConfigPortal_p.html)
2012-06-15 10:43:05 +02:00
Michael Peter Christen
16d8f33795
added objectlink generation to vocabulary generation and editor
2012-06-14 18:50:35 +02:00
cominch
56b0115054
Triplestore: modify routines to access per user store
2012-06-14 15:44:27 +02:00
cominch
a95127c9af
Triplestore: initalize per-user triplestores
2012-06-14 11:46:53 +02:00
Michael Peter Christen
b8b3c87ba7
- renamed localization to location (that was confusing)
...
- renamed 'Locale' navigator to 'Location'
- produce Location navigation only if geolocation libraries are loaded
2012-06-14 09:44:14 +02:00
Michael Peter Christen
e89747bb67
- added automated generation of vocabularies from url stubs
...
- added clear of all terms for vocabularies
- added deletion of vocabularies
2012-06-13 15:53:18 +02:00
Michael Peter Christen
79464189a4
The 'Locale' vocabulary, which is generated by geo data, has now the
...
objectspace "http://dbpedia.org/resource/ "
2012-06-13 13:05:41 +02:00
Michael Peter Christen
eca38c53e7
added a vocabulary editor
2012-06-13 12:12:20 +02:00
Michael Peter Christen
61bb52d55c
- using http://purl.org/dc/terms/references to refer from an
...
auto-annotated document to a 'pseudo-linked' document which has an url
created with an object-prefix as defined in the vocabulary file
2012-06-12 14:23:51 +02:00
Michael Peter Christen
2bbb6c52cf
added option to clean the triplestore when deleting the index
2012-06-12 01:54:36 +02:00
Michael Peter Christen
c02d742e53
proper namespaces in triplestore dump
2012-06-12 00:20:11 +02:00
Michael Peter Christen
8b53771db2
changed behavior of navigation processing:
...
- vocabulary annotation is not done any more into the metadata of urldb
- vocabularies are written into the jena triplestore using a rdf
vocabulary
- vocabularies for rdf tripel must be updated; refactoring done
- with the new navigation tags in the triplestore a faster
pre-urldb-lookup is possible: navigation is processed now within the RWI
during pre-ranking retrieval
- added also a Owl vocabulary stub to add the plain-text url to the
triplestore using the owl:sameas predicate
2012-06-11 23:49:30 +02:00
Michael Peter Christen
5fc6524ca8
- moved triple store to net.yacy.cora.lod (should be generalized there
...
later
- added abstract add, delete, get methods in the triplestore
- added generation of triples after auto-annotation
- migrated all MultiProtocolURI objects to DigestURI in the parser since
the url hash is needed as subject value in the triples in the triple
store
2012-06-11 16:48:53 +02:00
Michael Peter Christen
26301a538d
bugfix in Domains - dns-lookup
2012-06-09 10:59:45 +02:00
Michael Peter Christen
701b9a28a0
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
...
Conflicts:
htroot/PerformanceMemory_p.java
2012-06-08 09:16:16 +02:00
Michael Peter Christen
ab7107b34b
fixed RWIProcess queue limits: now discovering hidden results for mass
...
result retrieval
2012-06-08 09:14:54 +02:00
Michael Peter Christen
96e9d77270
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
...
Conflicts:
source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java
2012-06-06 20:13:28 +02:00
Michael Peter Christen
00f2df1120
a variety of possible memory leak fixes
2012-06-06 18:23:18 +02:00
Michael Peter Christen
461a0ce052
removed warnings
2012-06-05 20:03:43 +02:00
Michael Peter Christen
62ae9bbfda
allow more POIs, get more at once
2012-06-05 18:29:54 +02:00
Michael Peter Christen
5aee19daa4
added show from cache in search results (not yet finished)
2012-06-04 23:44:26 +02:00
Michael Peter Christen
964406ad17
added concurrency enhancement to xml parser
2012-06-04 23:35:56 +02:00
Michael Peter Christen
9b4c699526
ehanced location search:
...
- search request are now made using a map boundary
- search results are only computed for the map boundary
- the number of results is adopted to the results in the visible range
- added a double-buffering for the search result markers
- added a search query option for the search results:
/radius/<lat>/<lon>/<radius>
2012-05-31 22:39:53 +02:00
Michael Peter Christen
c70aaccdc9
better location to generate a guid for rss messages
2012-05-30 17:14:25 +02:00
Michael Peter Christen
f8a0cf6d7c
RSSMessages do not need a concurrent hash map -> removed overhead
2012-05-30 16:44:03 +02:00
Michael Peter Christen
07ca7e4dd1
enhanced RSS parsing by ensuring that it is parsed with a buffered input
...
stream
2012-05-30 16:40:37 +02:00
sixcooler
56087c1f23
bump to httpclient- httpcore-, httpmime- 4.2
2012-05-30 14:46:21 +02:00
Michael Peter Christen
c846e9ca14
redesign of the crawler monitor page: show crawled pages instead of
...
queue of urls that shall be crawled
2012-05-25 01:45:38 +02:00
Michael Peter Christen
c15fcde1c8
add-on to latest commit
2012-05-21 17:52:30 +02:00
Michael Peter Christen
cf47d94888
performance hack to parse numbers inside of substrings without actually
...
generating a substring. This avoids the allocation of a String object
ech time a substring is parsed. Should affect CPU load during RWI
transmission.
2012-05-21 13:40:46 +02:00
Michael Peter Christen
acf8d521a2
fix for http://bugs.yacy.net/view.php?id=126
2012-05-19 00:21:03 +02:00
Michael Peter Christen
bb88878b4d
the last commit was incomplete..
2012-05-18 22:33:16 +02:00
Michael Peter Christen
3e1bc9477f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
2012-05-17 13:58:09 +02:00
Roland 'Quix0r' Haeder
b3ae2aa41f
With or without 'final'? At least please try it in other methods
...
Conflicts:
source/de/anomic/tools/tarTools.java
2012-05-17 06:00:49 +02:00
Michael Peter Christen
89142d1e8d
removed (not all) warnings
2012-05-16 13:42:32 +02:00
Michael Peter Christen
5deebd02ea
added serialization
2012-05-15 23:10:47 +02:00
reger
b2175ea4ef
Add possibility to set custom Solr field names for the YaCy default Solr attributes.
...
- Changing the format of YaCy's solr.key.list while maintainig backward compatibility
Federated index config screens adjusted accordingly
- modified the Solr update request to use a 3 min Solr autocommit intervall
2012-05-15 22:34:02 +02:00
Michael Peter Christen
1795a7325b
made HandleSet serializable
2012-05-15 12:55:15 +02:00
Michael Peter Christen
f150bc218b
fixed bug in solr error document
2012-05-14 14:56:21 +02:00
Michael Peter Christen
cb54c1737b
solrj connector bugfix
2012-05-14 11:56:04 +02:00
Roland 'Quix0r' Haeder
a093ccf5eb
Now used synchronization in all close() methods to make sure all objects
...
are 'closed' in an ordered way
Conflicts:
source/de/anomic/http/server/ChunkedInputStream.java
source/de/anomic/http/server/ChunkedOutputStream.java
source/de/anomic/http/server/ContentLengthInputStream.java
source/net/yacy/cora/protocol/Domains.java
source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java
source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
source/net/yacy/document/content/dao/PhpBB3Dao.java
source/net/yacy/document/parser/html/AbstractTransformer.java
source/net/yacy/kelondro/blob/BEncodedHeap.java
source/net/yacy/kelondro/blob/HeapReader.java
source/net/yacy/kelondro/index/RAMIndexCluster.java
source/net/yacy/kelondro/io/ByteCountInputStream.java
source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java
source/net/yacy/kelondro/table/SQLTable.java
2012-05-14 07:41:55 +02:00
Michael Peter Christen
0d58fea210
made multiple connector default
2012-05-12 10:39:01 +02:00
Michael Peter Christen
7740c02c56
- enhanced the solr connector
...
- added new multiple connector (to replace singleConnector)
2012-05-12 10:32:42 +02:00
Michael Peter Christen
acc6db28ff
added missing classes for solr interface
2012-05-09 23:43:12 +02:00
Michael Peter Christen
adeb33bb36
better abstraction for solr objects
2012-05-09 17:21:19 +02:00
Michael Peter Christen
c00efc2717
made the solr connection more generic
2012-05-09 16:46:45 +02:00
Michael Peter Christen
ba6aaabc51
refactoring + parser bugfixes
2012-05-04 17:28:27 +02:00
Michael Peter Christen
942896fe46
removed methods not supported by new solrj connector for httpclient 4
...
Error was:
java.lang.UnsupportedOperationException: Client was created outside of
HttpSolrServer
at
org.apache.solr.client.solrj.impl.HttpSolrServer.setDefaultMaxConnectionsPerHost(HttpSolrServer.java:614)
at
net.yacy.cora.services.federated.solr.SolrSingleConnector.<init>(SolrSingleConnector.java:128)
at
net.yacy.cora.services.federated.solr.SolrShardingConnector.<init>(SolrShardingConnector.java:55)
at net.yacy.search.Switchboard.<init>(Switchboard.java:657)
at net.yacy.yacy.startup(yacy.java:222)
at net.yacy.yacy.main(yacy.java:1018)
2012-04-27 18:26:36 +02:00
Michael Peter Christen
22e1f68c0b
solrj user authentication patch
2012-04-27 17:53:45 +02:00