Commit Graph

10677 Commits

Author SHA1 Message Date
orbiter
3c1274057d fixed thread dump in case of wrong seeds 2014-04-04 10:54:56 +02:00
orbiter
18f9c40302 moved Edge class out of linkstructure servlet as this does not work on
non-eclipse driven environments (all non-dev cases)
2014-04-04 10:54:11 +02:00
orbiter
de95e5e524 reduced search activity corona strength in network image 2014-04-04 10:08:44 +02:00
reger
da413af664 move baseurl after parsing orig source in urlproxyservlet
to calculate absolute href links for rewrite from unmodified source.
2014-04-04 03:11:16 +02:00
reger
af6ad20728 fix: remove obsolete ref to yacy.home
(use Switchboard instead)
2014-04-04 02:45:04 +02:00
Michael Peter Christen
a6bb9be97e - added d3.js for visualizations using embedded svg
- added a servlet api/linkstructure.json which generates a link graph
information in json
- added a javascript link graph renderer hypertree.js using d3 and the
new servlet linkstructure.json
- embedded the new link graph in the crawler monitor and the host
browser
2014-04-03 14:51:19 +02:00
Michael Peter Christen
74ab094587 fix for solr query size; too many documents had been retrieved in case
that less than _pagesize_ had been requested.
2014-04-03 13:42:10 +02:00
Michael Peter Christen
c64c10ef00 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-04-03 01:58:06 +02:00
Michael Peter Christen
48fbfa60c1 bugfix to inbound/outbound identification 2014-04-03 01:21:43 +02:00
reger
227c42bc96 eleminate obsolete URIMetaDataRow class
by joining it with/into URIMetaDataNode.
2014-04-03 00:35:15 +02:00
Michael Peter Christen
cca851a417 introduced new solr field crawldepth_i which records the crawl depth of
a document. This is the upper limit for the clickdepth_i value which may
be shorter in case that the crawler did not take the shortest path to
the document.
2014-04-02 23:37:01 +02:00
Michael Peter Christen
d321b0314e added missing servlet html 2014-04-02 17:37:21 +02:00
orbiter
b1ba764d81 fix for first start options and added german translation for popup texts 2014-04-02 17:10:59 +02:00
orbiter
043d274af5 fixed crawl start path for cloned crawls 2014-04-02 16:06:29 +02:00
orbiter
429a874222 - added COLS field in GSA response (non-gsa standard by customer
request)
- updated document link in GSA response writer
2014-04-02 16:05:44 +02:00
Michael Peter Christen
1b9ec9a1c5 - added popover to p2p/stealth mode button to explain the peer mode and
privacy issues.
- added popover to first-time use case to explain that specific servlets
are only visible after customization and/or crawl starts
2014-04-02 13:33:43 +02:00
Michael Peter Christen
8d35fcb1c7 transition.js is also included in bootstrap.js 2014-04-02 12:19:26 +02:00
Michael Peter Christen
3abc3c4c4c removed alert.js, modal.js and tooltip.js as these libraries are all
included in bootstrap.js
2014-04-02 12:18:33 +02:00
Michael Peter Christen
898f78258e fix for naming bug 2014-04-02 04:06:35 +02:00
Michael Peter Christen
62a36fa584 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-04-02 03:27:08 +02:00
reger
c9f92abddc fix: application link count
(URIMetadataNode)
2014-04-02 03:21:51 +02:00
Michael Peter Christen
a267c46e1a Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-04-02 02:35:58 +02:00
Michael Peter Christen
5b83887da8 npe fix 2014-04-02 02:34:55 +02:00
Michael Peter Christen
63c9fcf3e0 free configuration of postprocessing clickdepth maximum depth and time 2014-04-02 02:34:39 +02:00
Michael Peter Christen
39b641d6cd added tutorial mode - some menu items will only appear if you 'qualify'
for them. Thus, the first-time user will only see four menu items. The
other items will unfold as the user interacts.
2014-04-02 02:33:17 +02:00
sixcooler
f06775850f fix receiving DHT / parse pultipart
+ another close to fix possible resource leak warning
2014-04-02 01:24:15 +02:00
Michael Peter Christen
7a49f72480 fix for crawler column width 2014-04-02 01:16:34 +02:00
Michael Peter Christen
ac5340ba1d Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
Conflicts:
	locales/ru.lng
2014-04-01 21:37:30 +02:00
malykhin.dmitry
344e7d4d1c Update russian translation 2014-04-01 22:01:22 +04:00
Michael Peter Christen
46a1a15441 added more bootstrap libraries 2014-04-01 17:18:26 +02:00
Michael Peter Christen
5ccbfeb803 show host list by default in host browser 2014-04-01 16:55:22 +02:00
Michael Peter Christen
8a77f318f4 fix for paths in locale files 2014-04-01 15:55:20 +02:00
Michael Peter Christen
aac70fea2b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-04-01 13:20:03 +02:00
reger
49e76a1c55 make use of detected charset in htmlParser if none is given. 2014-04-01 04:02:34 +02:00
reger
71649bf22d add test case htmlParser.parse - getCharset
(which fails)
2014-04-01 02:55:22 +02:00
Michael Peter Christen
ba0e3fb0dc fixed crawl start links after renaming them in latest commit 2014-04-01 00:35:58 +02:00
orbiter
d29b6db270 made crawl start pages public since they do not reveal individual
information and they are also not used as servlet to actually start the
crawl (which is Crawler_p.html).
2014-03-31 20:42:39 +02:00
Michael Peter Christen
e41db47cac added (again) underline to a tags 2014-03-31 18:25:11 +02:00
Michael Peter Christen
ff82a80eb3 Integrated HostBrowser back to administration interface; it can appear
with and without navigation bar.
2014-03-31 18:19:24 +02:00
Michael Peter Christen
94366ba2e5 added template for latest commit 2014-03-31 16:00:13 +02:00
Michael Peter Christen
701df02ead Complete redesign of administration top-level menu. This follows two
principles:
- provide an easy tutorial-like "what should I do first" menu
- provide all elements which are subject to most first questions to YaCy
exibition people on top level: Resource limitation, Parser and Ranking
settings
I apologize to everyone who are used to the old style and need to find
the menu items (again) after this change. I hope that this will make the
interface more usable for new users who see a web indexer/crawler the
first time.
2014-03-31 15:47:58 +02:00
Michael Peter Christen
a3b7366aee Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git 2014-03-31 03:21:02 +02:00
Michael Peter Christen
6b66bb7109 redesign of search page integration menu structure 2014-03-31 03:18:38 +02:00
reger
92811d7850 fix: 3 more links pointing to old /xml path 2014-03-31 02:58:43 +02:00
reger
c183d66d40 fix: blacklist xml export path to xml template 2014-03-31 02:48:28 +02:00
Michael Peter Christen
656e2ce62a replacing direct html table cellspacing with css set-up for cellspacing 2014-03-31 01:15:35 +02:00
reger
e11504309f adding a hint to javascript browser short cut on Url-Proxy page (AugmentedBrowsing_p.html) 2014-03-30 05:11:42 +02:00
reger
b12200cafe alternative UrlProxyServlet (for /proxy.html) using different url rewrite rules
- use JSoup parser for selective rewrite of html body <a href=  links only,
instead of regex which rewrites also header href/src links
- this improves display of pages which use header <base> tag
- tags with src attribute are taken from original location (like css) improving display and are not routed trough the indexer
Disadvantage: scripting links will drop out of proxy

Setting of the servlet through web.xml exclusivly (in case one would like to quickly switch back to the YaCyProxyServlet,
leaving the existing code of YaCyProxyServlet untouched available)
2014-03-30 04:04:02 +02:00
reger
7f29eee9ac fix: cut-off button in WatchWebStructure_p.html
(by header css dd  hight/line-hight)
2014-03-30 00:23:54 +01:00
reger
2953ebe701 fix: port in local target adress
& button style
2014-03-29 00:34:01 +01:00