Commit Graph

13858 Commits

Author SHA1 Message Date
Elias Ojala
4a126881bb
Improved formatting of markdown 2018-11-05 09:27:17 +02:00
luccioman
260ac11c65 Limit length of initially visible text in link structure graph nodes
To improve a bit readability of graphs having a large number of nodes.
2018-10-31 07:43:42 +01:00
luccioman
5a8d9abd8a Upgraded d3js dependency from 3.4.4 to 5.7.0 2018-10-28 10:07:46 +01:00
luccioman
9f8e1994a4 Added missing CSS width units to some HostBrowser.html styling 2018-10-26 09:11:23 +02:00
luccioman
0b1d2cb0dd Fixed "TypeError: table.tBodies[0] is undefined" host browser JS error
Traced in browser console when a host details table is empty.
2018-10-26 08:55:25 +02:00
luccioman
fcf6b16db4 Added new crawler attribute for finer control over Media Type detection
New "Media Type detection" section in the advanced crawl start page
allow to choose between :
- not loading URLs with unknown or unsupported file extension without
checking the actual Media Type (relying Content-Type header for now).
This was the old default behavior, faster, but not really accurate.
- always cross check URL file extension against the actual Media Type.
This lets properly parse URLs ending with an apparently odd file
extension, but which have actually a supported Media Type such as
text/html.

Sample URLs with misleading file extensions added as documentation in
the crawl start page.

fixes issue #244
2018-10-25 10:42:12 +02:00
luccioman
88d0ed676c Render http status instead of null responses on snapshot api errors 2018-10-19 10:12:10 +02:00
luccioman
a83a56473e Added suport for PDF snapshots generation when running on MS Windows 2018-10-18 12:41:57 +02:00
luccioman
18d07538ad Upgraded Apache Ant from 1.10.1 to 1.10.5 in Docker alpine image flavor 2018-10-17 10:04:48 +02:00
luccioman
053df1f312 Added support for snapshots generation to Docker images 2018-10-17 08:42:31 +02:00
luccioman
92e10d7d1c Added a crawl start hint message on availability or not of wkhtmltopdf
As this tool is required to produce pdf snapshots
2018-10-16 08:02:43 +02:00
luccioman
8852c97cee Added basic styling for cleaner rendering of missing image snapshots
For the output of the Solr snapshots writer
2018-10-15 18:19:57 +02:00
luccioman
746e0e788d Render a relevant HTTP status code on snapshot image rendering error
Instead of a null response body which is not very helpful.
2018-10-14 10:30:30 +02:00
luccioman
50b6edfcf5 Updated Solr snapshots writer for a cleaner html head 2018-10-13 10:36:39 +02:00
luccioman
f366f43d6b Made snapshots size customizable in Solr snapshots response writer 2018-10-13 10:22:47 +02:00
luccioman
7a62fc0e66 Fixed concurrency issue in custom classloader used for template classes
As reported in issue #241, the problem is only critical (random but
complete crash of the JVM) when upgrading to JDK11.
2018-10-11 18:34:39 +02:00
luccioman
0eb52f8c72 Added documentation hint about JVM option useful to debug JVM crashes 2018-10-11 18:28:08 +02:00
luccioman
753bda1409 Fixed remaining blacklist entries improper decoding of '+' character
In the blacklist cleaner and import/export administration pages.
2018-10-08 16:50:02 +02:00
luccioman
61c337f29a Decode blacklist entries for easier edition of non ascii chars
Not using the JDK URLDecoder.decode() function, as it strips '+'
characters when they occur after '?' (both characters having regular
expression semantics when used in blacklist path patterns)
2018-10-04 09:33:58 +02:00
luccioman
ed93221fa1 Improved normalization of blacklist path patterns having non ascii chars
Normalize blacklist path patterns using percent-encoding, at pattern
edition in web interface and at loading from configuration files.

Fixes issue #237
2018-10-02 14:36:13 +02:00
luccioman
d42f079c2d Additional modifications for typo fix in Bookmarks.html from PR #240 2018-10-02 07:32:36 +02:00
luccioman
d23578efc3
Merge pull request #240 from ivanhercaz/fixEnglishBookmarksPage
Fix English Bookmarks.html
2018-10-02 07:27:47 +02:00
ivanhercaz
8a8208c7e2 typo fix 2018-10-01 00:37:08 +01:00
ivanhercaz
a651358cce cleaning the file of entries in German already translated to Spanish 2018-10-01 00:36:09 +01:00
ivanhercaz
dc09f240e7 changin all «» to "" to avoid confusions 2018-10-01 00:28:58 +01:00
ivanhercaz
07dae68ab0 ConfigHeuristics_p.html translated 2018-10-01 00:22:08 +01:00
ivanhercaz
102c1cc4a9 ConfigHTCache_p.html translated 2018-09-30 14:33:09 +01:00
ivanhercaz
41684ba559 adding Spanish to the interface language list 2018-09-30 02:10:42 +01:00
ivanhercaz
1714805092 ConfigAccounts_p.html translated 2018-09-30 02:00:06 +01:00
ivanhercaz
91ac9c652a Collage.html translated 2018-09-30 01:37:35 +01:00
ivanhercaz
2d393e8f07 Bookmarks.html translated 2018-09-30 01:16:56 +01:00
ivanhercaz
1dafc85d33 typo fix in Bookmarks.html 2018-09-30 01:00:43 +01:00
ivanhercaz
275cff0cb7 removing duplicated entry (the one in German) for Translator_p.html 2018-09-28 15:06:01 +01:00
ivanhercaz
39fb80e84a BlogComments.html translated 2018-09-28 15:04:38 +01:00
ivanhercaz
7f5121a0ec Translator_p.html translated 2018-09-28 14:45:37 +01:00
ivanhercaz
59ea245e8b Blog.html translated 2018-09-28 00:30:54 +01:00
ivanhercaz
d221ddcbc8 Blacklist_p.html translated 2018-09-27 23:54:56 +01:00
ivanhercaz
843f0bb48f BlacklistTest_p.html translated and forgotten string in BlacklistImpExp_p.html 2018-09-27 20:21:24 +01:00
ivanhercaz
729a09d45d BlacklistImpExp_p.html translated 2018-09-27 20:10:17 +01:00
ivanhercaz
c45324f086 BlacklistCleaner_p.html translated 2018-09-27 19:04:50 +01:00
ivanhercaz
1be4c84ed7 Autocrawl_p.html translated 2018-09-27 18:33:41 +01:00
ivanhercaz
c0f7aa92e4 AccessTracker_p.html translated 2018-09-27 13:16:46 +01:00
ivanhercaz
7aa7ba689c AccessGrid_p.html translated 2018-09-27 10:11:50 +01:00
luccioman
3d14fb51c5 Removed now unused Java import in addition to modification from PR #239 2018-09-26 08:47:13 +02:00
luccioman
d5ec706604
Merge pull request #239 from otteresk/master
Display correct time in Rejected URLs overview
2018-09-26 08:43:48 +02:00
otter
8820d8d7c7 replace current date by FailDate 2018-09-25 20:43:58 +02:00
Andreas
3c65a158e1
Merge pull request #4 from yacy/master
Fork update #4
2018-09-25 10:22:50 +02:00
ivanhercaz
4f37c9f0ba starting the Spanish translation 2018-09-25 01:45:59 +01:00
luccioman
6c3e140083 Upgraded Solr and Lucene dependencies from 6.6.3 to 6.6.5 2018-09-22 14:40:18 +02:00
luccioman
982179a7eb Upgraded BouncyCastle dependencies from jdk15:1.46 to jdk15on:1.60 2018-09-21 12:07:57 +02:00