Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,016 Commits 1 Branch 20 Tags 836 MiB
cc6499bf8d
Commit Graph

7016 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
cc6499bf8d - added http://blekko.com as search heuristic (like scroogle). This was easy since they deliver their search results also as rss feed 
- renamed YaCys search result modifications keywords for RECENT, NEAR and language: to the blekko slashtag naming scheme. YaCy now supports the following blekko-like slash built-in slashtags:
/date
 - for search results ordered by date (most recent up)
 /near
 - for search results where search words appear near to each other (closest up)
 /language/<lang>
 - for a sorting by language where the wanted language gets up. Example: /language/de
  

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 18:08:20 +00:00
orbiter
a9f754c45f removed unused CR accumulation and distribution process 
this was never used and extended in the last years. The resulting YBR ranking criteria
is still a good idea and will be used in the future. Possible generation methods for YBR
ranking are:
- "trust-rank" using the link structure as can be discovered in a single crawl (idea from FSCONS)
- "block-rank" calculated from the local link structure
- a distributed "block-rank" using the xml API to the link structure from other peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7349 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 11:07:42 +00:00
orbiter
3d945bb442 fix for ftp client: suppress bad directory listing time-out 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 08:41:29 +00:00
orbiter
d4a1a1850b removed warnings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7347 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 07:52:10 +00:00
low012
3b5830b7d4 *) Fixed typo. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7346 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-28 03:05:22 +00:00
low012
9b3fae9496 *) cleaning up the code a little bit 
*) program to interface, not implementation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7345 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-28 02:57:31 +00:00
orbiter
7bb4b001ed - view image files from cache 
- fixed generic header settings; affects CORS functionality

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7344 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-27 09:16:16 +00:00
low012
e7552bd719 *) cleaning up the code a little bit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7343 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-27 00:54:59 +00:00
low012
a9741cc876 *) HTML fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 22:38:08 +00:00
low012
01ddb6d2ef *) HTML fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 22:19:31 +00:00
orbiter
321eb012fe removed two warnings and reverted one change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7340 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 11:15:42 +00:00
apfelmaennchen
737aaf6952 various small changes to ymarks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7339 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-25 21:16:47 +00:00
apfelmaennchen
8a50670546 some code clean up for the last post 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7338 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 23:40:55 +00:00
apfelmaennchen
442497868d another step towards an auto tagging function for YMarks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7337 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 23:26:29 +00:00
low012
dad5818b40 *) cleaning up the code a little bit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 01:31:41 +00:00
low012
9057e4d58c *) hopefully fixed bug described in http://www.yacy-forum.org/viewtopic.php?f=12&t=385 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7335 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-23 23:10:45 +00:00
f1ori
741a87a3e9 * make .yacy-domains crawlable (.yacy-domains are local domains, so only in custom networks/peers) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7334 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-22 19:12:51 +00:00
f1ori
fd74bc388c * fix small bug in sessionid-removal 
* add testcase for seesionid-removal

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7333 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 23:55:40 +00:00
f1ori
dca9e16f51 * don't index pages, which redirect, twice 
* there fore auto-redirection of HTTPClient for crawling is disabled and the old code is reactivated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 22:46:12 +00:00
low012
eb79b952ef *) cleaner code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7331 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 03:39:53 +00:00
low012
38fdf43587 *) renamed classes according to standard Java coding conventions 
*) String.isEmpty() was introduced in Java 1.6, but we still use Java 1.5

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7330 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 01:29:32 +00:00
low012
8281d12305 *) Ooops! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:41:45 +00:00
low012
025e3f4790 *) renamed classes according to standard Java coding conventions 
*) removed unsused code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:39:21 +00:00
low012
3b9aa0504e *) removed unsused code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7327 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:28:32 +00:00
low012
db3db0fdb9 *) trying to make this class less confusing (probably failing) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7326 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:13:08 +00:00
apfelmaennchen
54e63b556e intermediate step for a YMark auto-tagging function based on word frequencies. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7325 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-17 15:17:29 +00:00
apfelmaennchen
403ee9c014 added a drill-down for metadata and word count to /api/ymarks/test_treeview.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7324 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-16 00:48:38 +00:00
f1ori
a025b1da89 * fix bug when browsing local filesystem (e. g. repository) with yacy 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7323 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-15 14:47:16 +00:00
mikeworks
28a290336d de.lng: Started translation of YMark feature here http://localhost:8080/Table_YMark_p.html 
Table_YMark_p.html: removed some labels because columns is not filled yet and added ids for other label references and added full enabled="enabled" tags because SHORTTAG is not specified in XHTML 1.0 Strict

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-15 01:48:54 +00:00
lotus
25426c6548 change language immediately 
there is a bad behaviour:
if language is changed, servlets are translated but the returning servlet is yet the old one. therefore the page is loaded again after language changed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7321 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 14:27:30 +00:00
apfelmaennchen
11ae5b108e enabled rebuildIndex for /Table_YMark_p.html (rebuilds the tags and folders index) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 13:02:56 +00:00
apfelmaennchen
f147a022f8 enabled YMark Import for /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7319 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 10:32:37 +00:00
apfelmaennchen
2726606fc8 slightly enhanced interface for /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7318 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-12 21:13:27 +00:00
sixcooler
b87bf88ac8 using less memory on merging and rewriting blobs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7317 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-12 16:02:20 +00:00
apfelmaennchen
94a9be18a4 added a ymark table administration: /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7316 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-10 22:53:27 +00:00
apfelmaennchen
25339f93c7 more updates to ymarks 
- working xbel import/export
- exported xbel includes yacy specific metadata but still validates against PUBLIC DTD


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7315 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-09 17:01:31 +00:00
f1ori
d62e449a11 * fix FilterEngine, forgot comparision-operator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7314 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-08 09:37:44 +00:00
apfelmaennchen
cdd65aca71 update to ymarks 
- get_xbel.xml is almost working
- startet ymark api documentation info.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-07 20:03:01 +00:00
apfelmaennchen
808edffaf6 ymarks 
- some refactoring
- working xbel and html import (/api/ymarks/test_import.html)
- working treeview (/api/ymarks/test_treeview.html)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7312 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-06 20:26:13 +00:00
f1ori
2c539b514a * add domaincheck (local/global/domainlist) to urlcleaner 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7311 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-06 16:50:33 +00:00
f1ori
442bebca2b * %0 does not belong to the IPv6-Address -> entry does not work on some systems 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7310 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-06 15:09:28 +00:00
orbiter
9fc940aa35 release 0.99 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7309 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-05 13:20:51 +00:00
orbiter
117fc86b3d fix for http://forum.yacy-websuche.de/viewtopic.php?p=21199#p21199 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-05 13:19:37 +00:00
orbiter
441fbc26e2 security patch for WeakPriorityBlockingQueue (produced a deadlock) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7307 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-05 09:38:31 +00:00
orbiter
5dcb838293 - removed thread overhead when calling dns services 
- fixed localsearch (changed it by accident)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7306 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-05 00:29:32 +00:00
orbiter
4c50d3428e smaller file size for array stacks to support smaller deletion sizes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7305 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-04 13:29:19 +00:00
orbiter
09badc697b - low-memory patch for crawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7304 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-04 13:26:27 +00:00
f1ori
6ac4f8142e * allow proxy requests from localhost via ipv6 
(%0 does not belong to the address)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7303 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-04 10:52:54 +00:00
mikeworks
274d5b3a87 de.lng: Added missed translation string in SVn 7301 
ConfigHTCache_p.html: Added missing id for label pointing to actualCacheSize in span tag for XHTML 1.0 Strictness

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7302 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-04 07:30:00 +00:00
mikeworks
9239ac1e56 de.lng: Added translation for new page http://localhost:8080/ConfigHTCache_p.html and old one http://localhost:8080/IndexControlRWIs_p.html 
ConfigHTCache_p.html: Removed additional </form> and changed title text

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7301 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-04 00:53:25 +00:00