Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,177 Commits 1 Branch 20 Tags 836 MiB
af87af0d4c
Commit Graph

7177 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
49b5a206cd - better caclculation of search result size 
- predefined search recommendations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7361 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-02 12:19:59 +00:00
orbiter
4e2c14efbb fixed bugs in parser and ftp client 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7360 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-02 11:05:04 +00:00
orbiter
d78e322e84 added a directory-structure reader to ftp client 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-02 08:08:01 +00:00
orbiter
f0651e5f2f added image search to yacyinteractive.html 
this causes that the search result view switches from list format to image preview format when a search is restricted to png, gif or jpg documents

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7358 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-01 18:48:21 +00:00
orbiter
fffb91447a fixed crawl queue delete function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7357 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-01 14:55:40 +00:00
orbiter
4e771e2063 enhanced interactive search: 
- better table design
- less enumeration of same table structure (prepared now for streaming)
- added a 'remove filetype' link

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7356 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-12-01 14:43:07 +00:00
orbiter
b769cce433 - added a catch-all parser for all documents that cannot be parsed: they will contributed with their document url for the search index only 
- enhanced the pdf and torrent parser: better documents titles
- enhanced the ftp client: more time-out time
- fixed bugs in json for search results
- enhanced yacyinteractive.html: added a file type navigator and a download-script generator for search result files

Please have a look at yacyinteractive.html: this will become the hacker-download tool for 27c3!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7355 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-30 16:13:55 +00:00
lotus
6692e862ae do not reset language on config change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7354 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 20:09:53 +00:00
orbiter
21e84539e8 one more fix to Domains 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7353 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 19:49:57 +00:00
orbiter
e192d61972 fix for latest commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7352 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 19:32:47 +00:00
orbiter
22453b13ad implemented local host address discovery as posted in 
http://forum.yacy-websuche.de/viewtopic.php?p=21310#p21310

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7351 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 19:18:44 +00:00
orbiter
cc6499bf8d - added http://blekko.com as search heuristic (like scroogle). This was easy since they deliver their search results also as rss feed 
- renamed YaCys search result modifications keywords for RECENT, NEAR and language: to the blekko slashtag naming scheme. YaCy now supports the following blekko-like slash built-in slashtags:
/date
 - for search results ordered by date (most recent up)
 /near
 - for search results where search words appear near to each other (closest up)
 /language/<lang>
 - for a sorting by language where the wanted language gets up. Example: /language/de
  

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 18:08:20 +00:00
orbiter
a9f754c45f removed unused CR accumulation and distribution process 
this was never used and extended in the last years. The resulting YBR ranking criteria
is still a good idea and will be used in the future. Possible generation methods for YBR
ranking are:
- "trust-rank" using the link structure as can be discovered in a single crawl (idea from FSCONS)
- "block-rank" calculated from the local link structure
- a distributed "block-rank" using the xml API to the link structure from other peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7349 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 11:07:42 +00:00
orbiter
3d945bb442 fix for ftp client: suppress bad directory listing time-out 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 08:41:29 +00:00
orbiter
d4a1a1850b removed warnings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7347 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-29 07:52:10 +00:00
low012
3b5830b7d4 *) Fixed typo. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7346 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-28 03:05:22 +00:00
low012
9b3fae9496 *) cleaning up the code a little bit 
*) program to interface, not implementation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7345 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-28 02:57:31 +00:00
orbiter
7bb4b001ed - view image files from cache 
- fixed generic header settings; affects CORS functionality

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7344 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-27 09:16:16 +00:00
low012
e7552bd719 *) cleaning up the code a little bit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7343 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-27 00:54:59 +00:00
low012
a9741cc876 *) HTML fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 22:38:08 +00:00
low012
01ddb6d2ef *) HTML fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 22:19:31 +00:00
orbiter
321eb012fe removed two warnings and reverted one change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7340 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-26 11:15:42 +00:00
apfelmaennchen
737aaf6952 various small changes to ymarks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7339 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-25 21:16:47 +00:00
apfelmaennchen
8a50670546 some code clean up for the last post 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7338 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 23:40:55 +00:00
apfelmaennchen
442497868d another step towards an auto tagging function for YMarks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7337 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 23:26:29 +00:00
low012
dad5818b40 *) cleaning up the code a little bit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-24 01:31:41 +00:00
low012
9057e4d58c *) hopefully fixed bug described in http://www.yacy-forum.org/viewtopic.php?f=12&t=385 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7335 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-23 23:10:45 +00:00
f1ori
741a87a3e9 * make .yacy-domains crawlable (.yacy-domains are local domains, so only in custom networks/peers) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7334 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-22 19:12:51 +00:00
f1ori
fd74bc388c * fix small bug in sessionid-removal 
* add testcase for seesionid-removal

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7333 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 23:55:40 +00:00
f1ori
dca9e16f51 * don't index pages, which redirect, twice 
* there fore auto-redirection of HTTPClient for crawling is disabled and the old code is reactivated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7332 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 22:46:12 +00:00
low012
eb79b952ef *) cleaner code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7331 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 03:39:53 +00:00
low012
38fdf43587 *) renamed classes according to standard Java coding conventions 
*) String.isEmpty() was introduced in Java 1.6, but we still use Java 1.5

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7330 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 01:29:32 +00:00
low012
8281d12305 *) Ooops! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7329 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:41:45 +00:00
low012
025e3f4790 *) renamed classes according to standard Java coding conventions 
*) removed unsused code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:39:21 +00:00
low012
3b9aa0504e *) removed unsused code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7327 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:28:32 +00:00
low012
db3db0fdb9 *) trying to make this class less confusing (probably failing) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7326 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-21 00:13:08 +00:00
apfelmaennchen
54e63b556e intermediate step for a YMark auto-tagging function based on word frequencies. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7325 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-17 15:17:29 +00:00
apfelmaennchen
403ee9c014 added a drill-down for metadata and word count to /api/ymarks/test_treeview.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7324 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-16 00:48:38 +00:00
f1ori
a025b1da89 * fix bug when browsing local filesystem (e. g. repository) with yacy 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7323 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-15 14:47:16 +00:00
mikeworks
28a290336d de.lng: Started translation of YMark feature here http://localhost:8080/Table_YMark_p.html 
Table_YMark_p.html: removed some labels because columns is not filled yet and added ids for other label references and added full enabled="enabled" tags because SHORTTAG is not specified in XHTML 1.0 Strict

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7322 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-15 01:48:54 +00:00
lotus
25426c6548 change language immediately 
there is a bad behaviour:
if language is changed, servlets are translated but the returning servlet is yet the old one. therefore the page is loaded again after language changed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7321 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 14:27:30 +00:00
apfelmaennchen
11ae5b108e enabled rebuildIndex for /Table_YMark_p.html (rebuilds the tags and folders index) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 13:02:56 +00:00
apfelmaennchen
f147a022f8 enabled YMark Import for /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7319 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-13 10:32:37 +00:00
apfelmaennchen
2726606fc8 slightly enhanced interface for /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7318 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-12 21:13:27 +00:00
sixcooler
b87bf88ac8 using less memory on merging and rewriting blobs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7317 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-12 16:02:20 +00:00
apfelmaennchen
94a9be18a4 added a ymark table administration: /Table_YMark_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7316 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-10 22:53:27 +00:00
apfelmaennchen
25339f93c7 more updates to ymarks 
- working xbel import/export
- exported xbel includes yacy specific metadata but still validates against PUBLIC DTD


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7315 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-09 17:01:31 +00:00
f1ori
d62e449a11 * fix FilterEngine, forgot comparision-operator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7314 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-08 09:37:44 +00:00
apfelmaennchen
cdd65aca71 update to ymarks 
- get_xbel.xml is almost working
- startet ymark api documentation info.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-07 20:03:01 +00:00
apfelmaennchen
808edffaf6 ymarks 
- some refactoring
- working xbel and html import (/api/ymarks/test_import.html)
- working treeview (/api/ymarks/test_treeview.html)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7312 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2010-11-06 20:26:13 +00:00