Commit Graph

5218 Commits

Author SHA1 Message Date
Michael Peter Christen
197f7449e5 All entities of crawl profiles are now editable in the crawl profile
editor.
2015-05-28 16:07:40 +02:00
reger
1d8e1e4bac - Image search expand box, adjust javascript hs padtominsize parameter, to make sure expand box doesn't shrink on small images
- asure ImageResult.imagetext has value for the link text (use filename if no alt text given)
2015-05-27 02:31:13 +02:00
reger
000dde9511 Eleminate duplication of values for search ResultEntry
by instatiation from URIMetadataNode, by eleminating differentiation of ResultEntry/URIMetadataNode.
- moved remaining ResultEntry functionallity to URIMetadataNode
   - for 1:1 functionallity added a function makeResultEntry() 
- removed ResultEntry 
- refactored related code

Main difference is after makeResultEntry the text_t content is removed and alternative title/url strings for display are calculated.


Main difference left is, that
2015-05-26 04:15:00 +02:00
reger
3d53da8236 refactor ResultEntry to be based on MetadataNode/SolrDocument
to share/reuse common access routines
2015-05-25 21:28:48 +02:00
reger
17e820cfd7 use doctype() in ViewFile to choose display routines
in preference of getfileExtension()
2015-05-25 00:08:38 +02:00
reger
aa83931765 Convert content charset for display via CacheResource_p
Cached resource charset encoding might not fit to internal handling (using utf-8),
convert resource to utf-8
see http://mantis.tokeek.de/view.php?id=576
2015-05-23 20:31:37 +02:00
reger
3e742d1e34 Init remote crawler on demand
If remote crawl option is not activated, skip init of remoteCrawlJob to save the resources of queue and ideling thread.
Deploy of the remoteCrawlJob deferred on activation of the option.
2015-05-23 02:06:39 +02:00
Michael Peter Christen
dbf9e3503d Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-22 11:39:00 +02:00
Michael Peter Christen
8b1a30be50 removed a -UNRESOLVED_PATTERN- 2015-05-22 11:22:36 +02:00
Michael Peter Christen
9938c81378 fix for division by zero 2015-05-22 11:15:53 +02:00
reger
ace71a8877 Initial (experimental) implementation of index update/re-crawl job
added to IndexReIndexMonitor_p.html
Selects existing documents from index and feeds it to the crawler.
currently only the field fresh_date_dt is used determine documents for recrawl (fresh_date_dt:[* TO NOW-1DAY]
Documents are  added in small chunks (200) to the crawler, only if no other crawl is running.
2015-05-16 01:23:08 +02:00
Michael Peter Christen
f810915717 added crawl start from a clone with very, very large url: they are now
encoded as post submit form inside a javascript creation function.
2015-05-11 16:30:41 +02:00
reger
609c52e987 refactor getBookmark
to consistenly check existance by != null (w/o throwing exception on not found)
2015-05-11 00:37:04 +02:00
reger
5f4d35437e add bookmark.query to edit form 2015-05-10 15:30:21 +02:00
reger
89124335c4 update bookmark autosearch description
- add german translation
2015-05-10 02:29:08 +02:00
Michael Peter Christen
213401a446 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-08 13:48:29 +02:00
Michael Peter Christen
97930a6aad added must-not-match filter to snapshot generation.
also: fixed some bugs
2015-05-08 13:46:27 +02:00
reger
b47267b79c precaution against NPE on createorgetBookmark on search result 2015-05-07 03:25:19 +02:00
Michael Peter Christen
75879e051b Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-05-03 03:03:45 +02:00
reger
8a5b8f8789 on bookmaring of search result, remember orig. query in separate bookmark property
(instead of using the description field)
- adjust display and autosearch
- don't overwrite existing bookmark but combine info
2015-05-03 02:31:50 +02:00
reger
cf1fc7f700 harmonize filesearch input box layout 2015-05-01 19:24:14 +02:00
Michael Peter Christen
e334a06370 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-04-29 10:51:09 +02:00
reger
579303a04e add additional links to crawl queue pages 2015-04-25 02:45:05 +02:00
Michael Peter Christen
99718dc09a don't record dump generation calls since that
- is not a change of the index
- happens very often within self-backup strategies from the outside
(i.e. cronjobs)
2015-04-23 18:17:28 +02:00
Michael Peter Christen
5b59477415 update to bootstrap.css 3.3.4 2015-04-23 06:36:57 +02:00
Michael Peter Christen
0d365e67a5 Merge pull request #2 from Scarfmonster/master
English Synonyms and small fixes
2015-04-20 10:24:34 +02:00
Eugene Kuligin
8ae3229306 add vertical margin to the search cloud block 2015-04-20 05:24:50 +03:00
Eugene Kuligin
f9408dfa48 fix RSS icon displaying 2015-04-20 05:19:37 +03:00
reger
f7b0148f6a fix NPE in Vocabulary_p servlet
called w/o parameter
2015-04-20 00:01:14 +02:00
Ryszard Goń
ca1a70aec8 fix for Accept '?' URLs column in Crawl Profile List 2015-04-19 15:55:49 +02:00
Ryszard Goń
b0cd0212fd SynonymLibrary status check fix for multiple files 2015-04-17 17:38:48 +02:00
Ryszard Goń
f3f1b2e899 added English synonyms 2015-04-17 17:32:54 +02:00
reger
296e97c78e put https port in peers dna
as we flag if a peer is accesible via https, we need to know the port if we want to use is (e.g. for interYaCy communication)
start to provide / tansport the port by recording it in peers dna.
- add https link on the Network.html lock symbol
2015-04-16 02:36:12 +02:00
Michael Peter Christen
088853c1e8 Merge branch 'master' of git@github.com:yacy/yacy_search_server.git 2015-04-15 13:17:37 +02:00
Michael Peter Christen
fed26f33a8 enhanced timezone managament for indexed data:
to support the new time parser and search functions in YaCy a high
precision detection of date and time on the day is necessary. That
requires that the time zone of the document content and the time zone of
the user, doing a search, is detected. The time zone of the search
request is done automatically using the browsers time zone offset which
is delivered to the search request automatically and invisible to the
user. The time zone for the content of web pages cannot be detected
automatically and must be an attribute of crawl starts. The advanced
crawl start now provides an input field to set the time zone in minutes
as an offset number. All parsers must get a time zone offset passed, so
this required the change of the parser java api. A lot of other changes
had been made which corrects the wrong handling of dates in YaCy which
was to add a correction based on the time zone of the server. Now no
correction is added and all dates in YaCy are UTC/GMT time zone, a
normalized time zone for all peers.
2015-04-15 13:17:23 +02:00
reger
f6a55f9279 incoming connection count/text fix
improvement on http://mantis.tokeek.de/view.php?id=570
2015-04-15 02:16:53 +02:00
Michael Peter Christen
3e338e0987 Merge pull request #1 from Scarfmonster/master
Search navigation fix
2015-04-14 10:33:43 +02:00
reger
702c30e619 add info text icon next to Augmented Browsing check-box
with hint to config page
2015-04-14 03:19:27 +02:00
reger
4c907bec89 show "Augmented Browsing" link in search result only if urlproxy allowed and option switched on in layout
(AugmentedBrowsing_p.html, ConfigSearchPage_p.html)
as user only gets a error page if the option is not enabled
2015-04-14 02:07:02 +02:00
Ryszard Goń
6d78a6d06e Search navigation fix 2015-04-13 23:32:06 +02:00
Michael Peter Christen
a08a3c5f29 reverted json syntax for facet results to version from january 2015-04-13 16:18:15 +02:00
Michael Peter Christen
d8cc773d05 fix for not valid json in case that topics are switched off 2015-04-11 12:20:29 +02:00
Michael Peter Christen
1df6492019 enhanced suggestions 2015-04-10 15:59:18 +02:00
Michael Peter Christen
c7fdde3bd1 replaced "fork me" banner with github banner 2015-04-10 15:10:18 +02:00
Michael Peter Christen
876cdb083f Merge branch 'master' of github.com:yacy/yacy_search_server 2015-04-09 14:31:16 +02:00
Michael Peter Christen
2e88028c1a when selecting collections in navigation, do show the un-selected
collections in search result. When selecting one of them in another
search, switch off the previously selected collection. This actually
turns the collection navigation modifier into a radio-button like
behaviour
2015-04-07 13:13:58 +02:00
reger
2f592a8063 add SynonymLibrary status to DictionaryLoader_p servlet
http://mantis.tokeek.de/view.php?id=564
2015-04-04 00:24:16 +02:00
reger
c59ebde083 show location nav as selectable nav in search page layout
- switch automatically on upon load of geodata provider
- but allow switch on also without geodata file (and display the location nav if search result has lat/lon location)
2015-04-02 02:10:00 +02:00
Michael Peter Christen
5bc1e5cfbf use a cursor hand on facet headline to show that this is clickable 2015-04-01 18:37:45 +02:00
Michael Peter Christen
40389987ec Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2015-04-01 18:18:05 +02:00