Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,555 Commits 1 Branch 20 Tags 836 MiB
1defd580bc
Commit Graph

6555 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
1defd580bc - added option to localization search to distinguish between a search for a location according to the search word only or for the relation between a web search results and locations found in the metadata fields 
- used that to display two layers on map: cities and search result locations
- added many marker grafics for the display of the markers on the map
- some refactoring of the yacy news code plus bugfixes for latest move from Tree to Table data structure

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6889 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-19 12:53:09 +00:00
low012
ad823a4716 *) minor changes (only cosmetics, no functional changes) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6888 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 21:31:59 +00:00
low012
dcac90d2f9 *) removed unnecessary import 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 21:09:41 +00:00
orbiter
1e8c6cefae - added 'search on map' - Link to search result page 
- added default search option to location search
- show default search in search window on location search page
- added icon for location search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6886 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 14:48:54 +00:00
orbiter
227ebc6651 - added more map layers to the new location search: openstreetmap (mapnik, osmarender, cycle map) 
- cycle map is default because it looks best at 'world view'
- added control elements to map
- increased map size
- added deletion of search results for each time when a new search is done
- moved search box up and added yacy icon in such a way that the search page looks exaclty the same as the standard search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 13:52:15 +00:00
orbiter
bd0a9df895 fix for bad location double check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 11:54:30 +00:00
orbiter
b7556893c6 removed terminate buttons for build-in crawl profiles in crawl profile editor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-18 07:08:01 +00:00
low012
a5ec7db4ab *) Oops! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-17 19:44:02 +00:00
low012
b02078b58c *) added visualization of GeoRSS search (very basic, but it's a start...) 
*) removed double code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-17 19:39:41 +00:00
orbiter
bd2587954a ? 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-16 01:05:45 +00:00
orbiter
e43e61e502 added another geolocalization data source: GeoNames 
- added downloader option in DictionaryLoader
- added generalization (interfaces and overarching localization)
- more abstraction using the libraries

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6879 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-15 23:49:30 +00:00
low012
c9862e0ca9 *) removed unnecessary imports 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-15 01:17:45 +00:00
low012
76aea981ec *) added W3C geo GeoRSS (see http://en.wikipedia.org/wiki/Georss) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6877 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-15 01:11:03 +00:00
orbiter
118d589eff replaced the very very old data structure 'Records' with a simple table to fix the problem from 
http://forum.yacy-websuche.de/viewtopic.php?p=20066#p20066

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6876 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-15 00:59:02 +00:00
low012
734298facd *) added missing namespace declarations in yacysearch.rss 
*) minor change in yacysearchtrailer.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6875 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-15 00:09:53 +00:00
orbiter
2a8f70f0ca - fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles 
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-14 23:50:07 +00:00
orbiter
2126c03a62 - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer 
- migrated the opengeodb downloader to a new version of the opengeodb-dump


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-14 18:30:11 +00:00
orbiter
3661cb692c added dictionary loader servlet that can be used to get the geolocalization file: 
/DictionaryLoader_p.html
Will also be used for more dictionary files in the future

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6872 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-14 09:52:53 +00:00
orbiter
90fa8fd4d4 - support gpx file extension 
- non-blocking location search (time-out handling was wrong)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-12 08:49:20 +00:00
low012
b0927d26e0 *) fix for "more options" link 
*) removed suplus code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6870 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-12 00:48:24 +00:00
orbiter
439b44be9e removed exit from computation in ReferenceContainerArray.get merge method 
an warning is still given, but method computes at normal operation
see also: http://forum.yacy-websuche.de/viewtopic.php?p=20038#p20038

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 23:36:40 +00:00
orbiter
7b880d73d0 adjustments to granted query size 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 23:28:43 +00:00
orbiter
4cd56d3966 - fix for http://forum.yacy-websuche.de/viewtopic.php?p=20036#p20036 
- enhancement to kml search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6867 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 23:06:39 +00:00
orbiter
586bc4d920 - remove superfluous entries in remote search tracker handles 
- avoid concurrent access from same client
this is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=20045#p20045

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6866 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 22:26:18 +00:00
orbiter
789c6b26ce added a location search service: using the following servlet/example: 
http://localhost:8080/yacysearch_location.kml?query=berlin&maximumTime=2000&maximumRecords=100

This will open any application that can consume kml data (which will probably be google earth) on your computer and displays the search result as positions on a map


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6865 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 12:58:05 +00:00
orbiter
f23cbd2dab more bugfixes to date parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6864 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 11:32:46 +00:00
orbiter
cf43bdc87e This is a large bugfix and enhancement commit to support a better location detection for data 
- fixes to http file server session handling
- fixes and enhancements to metadata date/time handling
- added dc:publisher metadata field and updated all document parser
- fixed bug in metdata read procedure
- enhanced dublin core and rss parser to understand more fields more properly
- enhanced url selection in case that multiple urls are given in surrogates
- fix for condenser; failure when last word does not end with termination symbol

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-11 11:14:05 +00:00
orbiter
6eba2cb96b fix in bmp parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6862 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-09 13:27:58 +00:00
lotus
c6d9a12a99 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2810 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-09 11:21:11 +00:00
orbiter
c45117f81f fixed dates in metadata 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6860 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-08 22:09:36 +00:00
orbiter
0a5fd15703 :-( 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-06 22:06:31 +00:00
orbiter
ac16f582aa fix for http://forum.yacy-websuche.de/viewtopic.php?p=20017#p20017 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6858 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-06 22:04:30 +00:00
orbiter
a7d038bb7a The oai ListFriends source list becomes configurable: just write them into defaults/oaiListFriendsSource.xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6857 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-06 10:01:37 +00:00
orbiter
cf13c65bdd added another network definition file for the open access (decentral OAI) search network 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6856 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-05 22:47:03 +00:00
orbiter
06ff0c5b06 fixes for metadata retrieval and presentation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6855 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-05 22:45:54 +00:00
suessthomas
5c5e6accdb Fixes for (X)HTML compatibility. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-05 21:12:58 +00:00
orbiter
5d87379be6 fix for yacy search urls in compare search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-05 15:44:40 +00:00
orbiter
31f30f0925 added compare search for OAIster and oai.yacy.net 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-05 15:32:36 +00:00
orbiter
7ab207d93a better presentation of search result metadata and fixes to htcache loading 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6851 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-04 20:57:09 +00:00
orbiter
5fbf866cae - fixed resumption token generation for oai-pmh import 
- relaxed dublin core parsing: the dc:reference tag may replace dc:identifier if this does not contain a valid url
- parsing of completeRecords number and presentation in the download list of oai import

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6850 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-02 22:20:24 +00:00
suessthomas
af13a02307 YaCySearchhtmlFF.html - fixes for XHTML compatibility. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6849 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-05-02 21:03:40 +00:00
orbiter
5efc0dce0b fix for domain options in search box 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6848 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-30 21:53:20 +00:00
orbiter
fc5efcc05a enhanced and fixed OAI-PMH import 
- now importing OAI-PMH server list fron two sources
- simultanous import from several servers (even > 2000)
- check buttons on OAI-PMH server list to select multiple servers for import start
- it is possible to select all servers at once for import
- imported XML data is gzipped after import from surrogate reader

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6847 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-30 14:03:51 +00:00
sixcooler
c2098f9399 close unused connections if there to many for DHT 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6846 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-29 23:38:50 +00:00
orbiter
455a763d7c performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6845 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-28 08:38:57 +00:00
orbiter
40a8d132d9 tried to fix 100% CPU when calling Balancer.top() 
see also: http://forum.yacy-websuche.de/viewtopic.php?p=19978#p19978

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6844 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-27 22:37:50 +00:00
orbiter
b6cce08019 fixed a bug in rwi storage data size allocation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6843 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-27 22:22:16 +00:00
orbiter
90c3e5d6f6 - cleanup, removed unused imports 
- added crawling queue sizes to /api/status_p.xml, syntax same as in queues_p.html
- fixed a bug in queue enumeration that caused a out of bounds exception

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6842 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-27 21:47:41 +00:00
orbiter
3aad50d38e :-( 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6841 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-26 15:26:08 +00:00
orbiter
9edd38fbc5 connectionCount limit too low? 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6840 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-04-26 15:24:47 +00:00