Commit Graph

2943 Commits

Author SHA1 Message Date
orbiter
bfdb9f4e06 extended statistics on Network servlet page
- added number of online peers at the last day and the last week
- changed design of statistic table
- network picture now shows exactly those peers that are counted in the statistic overview for one day

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 23:27:32 +00:00
orbiter
431852f0a7 testing new 'seach on map' image (slightly larger)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6896 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 13:12:47 +00:00
orbiter
e40542579e fixes for wrong attribut name search->query (SRU)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6895 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 13:02:35 +00:00
orbiter
903ff21478 increased default time-out
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6894 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 09:09:26 +00:00
orbiter
98c1d65415 - show up to 10 locations (maps) after search (instead of a max of 5)
- order locations by (primary) population and (secondary) longitude (reverse ordering, both)
- added population from GeoNames, OpenGeoDB does not have that information
- changed default viewpoint of map to (30,15); shows more land and europe in the center

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-21 08:18:04 +00:00
orbiter
9842fab6e4 - fixes to query parameter
- replaced/removed search query attribute (was old style, new is 'query' according to SRU)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 22:05:04 +00:00
orbiter
6ec9ced4cd - fix for multi-word search for locations
- changed description text to 'title' entity (subject is a list of keywords and was very messed)
- added ViewFile in location pop-up

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6891 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 15:07:57 +00:00
mikeworks
7f35e1955e Added alt tag and width and height properties to earthsearch.png in yacysearchtrailer.html for HTML validity
Added alt tag to page tabs in yacysearch.java for HTML validity
Added new German translations for geo search phrase in de.lng

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6890 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-20 06:36:02 +00:00
orbiter
1defd580bc - added option to localization search to distinguish between a search for a location according to the search word only or for the relation between a web search results and locations found in the metadata fields
- used that to display two layers on map: cities and search result locations
- added many marker grafics for the display of the markers on the map
- some refactoring of the yacy news code plus bugfixes for latest move from Tree to Table data structure

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6889 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-19 12:53:09 +00:00
orbiter
1e8c6cefae - added 'search on map' - Link to search result page
- added default search option to location search
- show default search in search window on location search page
- added icon for location search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6886 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 14:48:54 +00:00
orbiter
227ebc6651 - added more map layers to the new location search: openstreetmap (mapnik, osmarender, cycle map)
- cycle map is default because it looks best at 'world view'
- added control elements to map
- increased map size
- added deletion of search results for each time when a new search is done
- moved search box up and added yacy icon in such a way that the search page looks exaclty the same as the standard search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 13:52:15 +00:00
orbiter
b7556893c6 removed terminate buttons for build-in crawl profiles in crawl profile editor
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-18 07:08:01 +00:00
low012
a5ec7db4ab *) Oops!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6882 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-17 19:44:02 +00:00
low012
b02078b58c *) added visualization of GeoRSS search (very basic, but it's a start...)
*) removed double code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-17 19:39:41 +00:00
orbiter
bd2587954a ?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6880 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-16 01:05:45 +00:00
orbiter
e43e61e502 added another geolocalization data source: GeoNames
- added downloader option in DictionaryLoader
- added generalization (interfaces and overarching localization)
- more abstraction using the libraries

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6879 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 23:49:30 +00:00
low012
c9862e0ca9 *) removed unnecessary imports
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6878 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 01:17:45 +00:00
low012
76aea981ec *) added W3C geo GeoRSS (see http://en.wikipedia.org/wiki/Georss)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6877 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 01:11:03 +00:00
low012
734298facd *) added missing namespace declarations in yacysearch.rss
*) minor change in yacysearchtrailer.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6875 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-15 00:09:53 +00:00
orbiter
2a8f70f0ca - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 23:50:07 +00:00
orbiter
2126c03a62 - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer
- migrated the opengeodb downloader to a new version of the opengeodb-dump


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6873 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 18:30:11 +00:00
orbiter
3661cb692c added dictionary loader servlet that can be used to get the geolocalization file:
/DictionaryLoader_p.html
Will also be used for more dictionary files in the future

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6872 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-14 09:52:53 +00:00
orbiter
90fa8fd4d4 - support gpx file extension
- non-blocking location search (time-out handling was wrong)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6871 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-12 08:49:20 +00:00
low012
b0927d26e0 *) fix for "more options" link
*) removed suplus code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6870 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-12 00:48:24 +00:00
orbiter
7b880d73d0 adjustments to granted query size
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6868 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 23:28:43 +00:00
orbiter
4cd56d3966 - fix for http://forum.yacy-websuche.de/viewtopic.php?p=20036#p20036
- enhancement to kml search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6867 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 23:06:39 +00:00
orbiter
586bc4d920 - remove superfluous entries in remote search tracker handles
- avoid concurrent access from same client
this is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=20045#p20045

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6866 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 22:26:18 +00:00
orbiter
789c6b26ce added a location search service: using the following servlet/example:
http://localhost:8080/yacysearch_location.kml?query=berlin&maximumTime=2000&maximumRecords=100

This will open any application that can consume kml data (which will probably be google earth) on your computer and displays the search result as positions on a map


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6865 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 12:58:05 +00:00
orbiter
cf43bdc87e This is a large bugfix and enhancement commit to support a better location detection for data
- fixes to http file server session handling
- fixes and enhancements to metadata date/time handling
- added dc:publisher metadata field and updated all document parser
- fixed bug in metdata read procedure
- enhanced dublin core and rss parser to understand more fields more properly
- enhanced url selection in case that multiple urls are given in surrogates
- fix for condenser; failure when last word does not end with termination symbol

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6863 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-11 11:14:05 +00:00
orbiter
c45117f81f fixed dates in metadata
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6860 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-08 22:09:36 +00:00
orbiter
a7d038bb7a The oai ListFriends source list becomes configurable: just write them into defaults/oaiListFriendsSource.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6857 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-06 10:01:37 +00:00
orbiter
06ff0c5b06 fixes for metadata retrieval and presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6855 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-05 22:45:54 +00:00
suessthomas
5c5e6accdb Fixes for (X)HTML compatibility.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6854 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-05 21:12:58 +00:00
orbiter
5d87379be6 fix for yacy search urls in compare search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6853 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-05 15:44:40 +00:00
orbiter
31f30f0925 added compare search for OAIster and oai.yacy.net
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6852 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-05 15:32:36 +00:00
orbiter
7ab207d93a better presentation of search result metadata and fixes to htcache loading
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6851 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-04 20:57:09 +00:00
orbiter
5fbf866cae - fixed resumption token generation for oai-pmh import
- relaxed dublin core parsing: the dc:reference tag may replace dc:identifier if this does not contain a valid url
- parsing of completeRecords number and presentation in the download list of oai import

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6850 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-02 22:20:24 +00:00
suessthomas
af13a02307 YaCySearchhtmlFF.html - fixes for XHTML compatibility.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6849 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-05-02 21:03:40 +00:00
orbiter
5efc0dce0b fix for domain options in search box
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6848 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-30 21:53:20 +00:00
orbiter
fc5efcc05a enhanced and fixed OAI-PMH import
- now importing OAI-PMH server list fron two sources
- simultanous import from several servers (even > 2000)
- check buttons on OAI-PMH server list to select multiple servers for import start
- it is possible to select all servers at once for import
- imported XML data is gzipped after import from surrogate reader

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6847 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-30 14:03:51 +00:00
orbiter
90c3e5d6f6 - cleanup, removed unused imports
- added crawling queue sizes to /api/status_p.xml, syntax same as in queues_p.html
- fixed a bug in queue enumeration that caused a out of bounds exception

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6842 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-27 21:47:41 +00:00
orbiter
b18a7606a0 some performance hacks and fixed after reading dump in
http://forum.yacy-websuche.de/viewtopic.php?p=19920#p19920

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6837 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-25 21:37:36 +00:00
orbiter
b7efbe55cf i guess these documents are here by mistake
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6833 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-23 07:03:31 +00:00
mikeworks
7417425e6a Added (b)log notice in header of table in Network.html
Added some missing translations for German de.lng in Network.html page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6818 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-17 08:16:42 +00:00
orbiter
1a8a134e0c continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790
The result should be a less usage of new String() and less memory usage (since a String-encapsulated byte[] has 40 bytes overhead)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6815 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-15 13:22:59 +00:00
orbiter
0d04ab1422 new access tracking data type strategy; previous data types may have caused deadlocks of httpd when performing statistic cleanups
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6809 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-14 16:18:04 +00:00
orbiter
55d8e686ea performance hacks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6807 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-13 23:29:55 +00:00
orbiter
5d8238680f better thread dump statistic evaluation in threaddump servlet when creating multiple dumps for profiling: no distinguishing between thread states
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6803 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-13 12:19:09 +00:00
low012
2bc459252e *) changes for better code readability
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6797 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-13 01:16:09 +00:00
hermens
4ec0092677 more null == proxy fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6794 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-04-10 18:31:12 +00:00