Michael Peter Christen
|
508a81b86c
|
added solr field 'refresh_s' which stores the refresh url contained in
the meta-refresh html header field.
|
2012-06-28 13:27:45 +02:00 |
|
Michael Peter Christen
|
3fd4a01286
|
added option to record urls that are forwarded to the solr index
|
2012-06-26 13:54:48 +02:00 |
|
Michael Peter Christen
|
8bee1472c9
|
there is no noindex, only nofollow in links
|
2012-01-31 23:46:35 +01:00 |
|
Michael Peter Christen
|
987b412491
|
updated solr scheme: generic declaration of solr schemes
|
2012-01-13 11:25:15 +01:00 |
|
orbiter
|
1b45e33f04
|
added robots tag parser to solr scheme
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7986 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-09-30 13:39:01 +00:00 |
|
orbiter
|
2c3161b4ac
|
refactoring:
RankingProcess -> RWIProcess
ResultFetcher -> SnippetProcess
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7974 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-09-26 21:42:28 +00:00 |
|
orbiter
|
1c007188ad
|
bugfixes in html parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7912 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-08-31 16:02:06 +00:00 |
|
orbiter
|
5dd2efc9a2
|
- bugfixes in html parser
- new fields in solr
- extended file viewer to debug parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7897 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-08-25 15:52:25 +00:00 |
|
orbiter
|
e7c7598923
|
docfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7828 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-07-04 10:48:01 +00:00 |
|
orbiter
|
b84089ff04
|
fix for solr scheme list definition
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7826 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-07-03 22:59:43 +00:00 |
|
orbiter
|
2d4bb139d3
|
- added counting of links with noindex tag for solr index
- bugfixes for solr index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7820 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-07-03 06:40:05 +00:00 |
|
orbiter
|
bda3eec0ff
|
added parsing of canonical link element to html parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7812 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-07-01 16:38:01 +00:00 |
|
orbiter
|
b6f09a475d
|
- added an index profile editor in the /indexFederated_p.html servlet for solr indexes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7811 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-06-30 15:49:21 +00:00 |
|
orbiter
|
6deef60bc0
|
added keyword list for solr index attributes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7807 6c8d7289-2bf4-0310-a012-ef5d649a1542
|
2011-06-29 15:33:27 +00:00 |
|