Commit Graph

6582 Commits

Author SHA1 Message Date
orbiter
353a924760 - changed default memory to 500m
- now xms is lower than xmx (lets try what happens)
- removed default path for intranet crawl starts to avoid confusion as seen on linuxtag
- added time-out to upnp request (i have a new router which may need that)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6916 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-14 21:36:40 +00:00
mikeworks
0f3a3e34e1 Updated German translation de.lng and fixed typos in html files (english)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6915 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-11 13:51:49 +00:00
mikeworks
5251a18e65 de.lng: Added new Network.html German translations
Network.html: shortened some <br /> tags to <br/>
ConfigBasic.html fixed some typo cann for German translation file

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6914 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-11 00:17:23 +00:00
orbiter
a33f39832e - small change in display of use cases
- explain usage of ftp, smb and file search domains

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6913 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-06 23:26:04 +00:00
orbiter
c71d829bb5 more time-out properties for http connection manager
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6912 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-01 23:37:43 +00:00
orbiter
1610c81dff fixes for embedded search / search widget
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6911 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-01 22:09:17 +00:00
orbiter
60e71876ad - more abstraction (HashMap -> Map)
- more concurrency-awareness (HashMap -> ConcurrentHashMap)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6910 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-01 13:02:11 +00:00
orbiter
a83772c71b fixes and enhancements for balancer:
- crawl lists for each domain now uses a HandleSet which should use less memory than LinkedLists
- but: fill more entries into the domain lists (all available entries)
- fixes to selection criteria (best domain selection)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6909 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-06-01 09:30:23 +00:00
orbiter
9cde05418f fixed url crawl list display
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6908 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-31 00:27:00 +00:00
orbiter
2eea806005 less errors in image parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6907 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-30 11:18:05 +00:00
orbiter
30b337fa9f fixes to balancer when crawling filesystem (problem was: host == null)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6906 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-30 11:17:38 +00:00
orbiter
844853243a fixed balancer time guessing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6905 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-30 10:28:42 +00:00
suessthomas
2e679b1302 Small Fixes - no functional Changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6904 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-27 21:01:22 +00:00
orbiter
3f93a0cc8f redesign of remote proxy settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6903 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-26 00:01:16 +00:00
orbiter
11639aef35 - added new protocol loader for 'file'-type URLs
- it is now possible to crawl the local file system with an intranet peer
- redesign of URL handling
- refactoring: created LGPLed package cora: 'content retrieval api' which may be used externally by other applications without yacy core elements because it has no dependencies to other parts of yacy

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6902 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-25 12:54:57 +00:00
orbiter
2fd795207c adaptive network peer counter table
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6901 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-24 22:41:14 +00:00
orbiter
6950d8a33d fixes to SMB crawler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6900 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-23 01:17:44 +00:00
orbiter
0eafd94b22 corrected colors of network legend
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6899 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-22 23:09:19 +00:00
orbiter
9977fb9cf5 more enhancements to Network servlet: own peer in overview
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6898 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 23:50:39 +00:00
orbiter
bfdb9f4e06 extended statistics on Network servlet page
- added number of online peers at the last day and the last week
- changed design of statistic table
- network picture now shows exactly those peers that are counted in the statistic overview for one day

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 23:27:32 +00:00
orbiter
431852f0a7 testing new 'seach on map' image (slightly larger)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6896 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 13:12:47 +00:00
orbiter
e40542579e fixes for wrong attribut name search->query (SRU)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6895 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 13:02:35 +00:00
orbiter
903ff21478 increased default time-out
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6894 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 09:09:26 +00:00
orbiter
98c1d65415 - show up to 10 locations (maps) after search (instead of a max of 5)
- order locations by (primary) population and (secondary) longitude (reverse ordering, both)
- added population from GeoNames, OpenGeoDB does not have that information
- changed default viewpoint of map to (30,15); shows more land and europe in the center

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 08:18:04 +00:00
orbiter
9842fab6e4 - fixes to query parameter
- replaced/removed search query attribute (was old style, new is 'query' according to SRU)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 22:05:04 +00:00
orbiter
6ec9ced4cd - fix for multi-word search for locations
- changed description text to 'title' entity (subject is a list of keywords and was very messed)
- added ViewFile in location pop-up

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6891 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 15:07:57 +00:00
mikeworks
7f35e1955e Added alt tag and width and height properties to earthsearch.png in yacysearchtrailer.html for HTML validity
Added alt tag to page tabs in yacysearch.java for HTML validity
Added new German translations for geo search phrase in de.lng

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6890 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 06:36:02 +00:00
orbiter
1defd580bc - added option to localization search to distinguish between a search for a location according to the search word only or for the relation between a web search results and locations found in the metadata fields
- used that to display two layers on map: cities and search result locations
- added many marker grafics for the display of the markers on the map
- some refactoring of the yacy news code plus bugfixes for latest move from Tree to Table data structure

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6889 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-19 12:53:09 +00:00
low012
ad823a4716 *) minor changes (only cosmetics, no functional changes)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6888 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 21:31:59 +00:00
low012
dcac90d2f9 *) removed unnecessary import
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6887 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 21:09:41 +00:00
orbiter
1e8c6cefae - added 'search on map' - Link to search result page
- added default search option to location search
- show default search in search window on location search page
- added icon for location search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6886 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 14:48:54 +00:00
orbiter
227ebc6651 - added more map layers to the new location search: openstreetmap (mapnik, osmarender, cycle map)
- cycle map is default because it looks best at 'world view'
- added control elements to map
- increased map size
- added deletion of search results for each time when a new search is done
- moved search box up and added yacy icon in such a way that the search page looks exaclty the same as the standard search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 13:52:15 +00:00
orbiter
bd0a9df895 fix for bad location double check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6884 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 11:54:30 +00:00
orbiter
b7556893c6 removed terminate buttons for build-in crawl profiles in crawl profile editor
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 07:08:01 +00:00
low012
a5ec7db4ab *) Oops!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6882 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-17 19:44:02 +00:00
low012
b02078b58c *) added visualization of GeoRSS search (very basic, but it's a start...)
*) removed double code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-17 19:39:41 +00:00
orbiter
bd2587954a ?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6880 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-16 01:05:45 +00:00
orbiter
e43e61e502 added another geolocalization data source: GeoNames
- added downloader option in DictionaryLoader
- added generalization (interfaces and overarching localization)
- more abstraction using the libraries

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6879 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 23:49:30 +00:00
low012
c9862e0ca9 *) removed unnecessary imports
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6878 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 01:17:45 +00:00
low012
76aea981ec *) added W3C geo GeoRSS (see http://en.wikipedia.org/wiki/Georss)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6877 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 01:11:03 +00:00
orbiter
118d589eff replaced the very very old data structure 'Records' with a simple table to fix the problem from
http://forum.yacy-websuche.de/viewtopic.php?p=20066#p20066

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6876 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 00:59:02 +00:00
low012
734298facd *) added missing namespace declarations in yacysearch.rss
*) minor change in yacysearchtrailer.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6875 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 00:09:53 +00:00
orbiter
2a8f70f0ca - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 23:50:07 +00:00
orbiter
2126c03a62 - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer
- migrated the opengeodb downloader to a new version of the opengeodb-dump


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6873 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 18:30:11 +00:00
orbiter
3661cb692c added dictionary loader servlet that can be used to get the geolocalization file:
/DictionaryLoader_p.html
Will also be used for more dictionary files in the future

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6872 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 09:52:53 +00:00
orbiter
90fa8fd4d4 - support gpx file extension
- non-blocking location search (time-out handling was wrong)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6871 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-12 08:49:20 +00:00
low012
b0927d26e0 *) fix for "more options" link
*) removed suplus code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6870 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-12 00:48:24 +00:00
orbiter
439b44be9e removed exit from computation in ReferenceContainerArray.get merge method
an warning is still given, but method computes at normal operation
see also: http://forum.yacy-websuche.de/viewtopic.php?p=20038#p20038

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6869 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 23:36:40 +00:00
orbiter
7b880d73d0 adjustments to granted query size
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6868 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 23:28:43 +00:00
orbiter
4cd56d3966 - fix for http://forum.yacy-websuche.de/viewtopic.php?p=20036#p20036
- enhancement to kml search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6867 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 23:06:39 +00:00