Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,796 Commits 1 Branch 20 Tags 836 MiB
694defb257
Commit Graph

2539 Commits

Author SHA1 Message Date
low012
694defb257 *) better compatibility with OpenSolaris 5/07, updates should work now 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4050 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-17 15:26:34 +00:00
orbiter
16c203f759 fixed remote search access tracker 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4048 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-16 11:44:18 +00:00
orbiter
344911bfaa shorter minimum delay values for intranet crawl targets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4047 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-15 23:18:12 +00:00
orbiter
f890cc86aa inserted forwarding patch from fuchs 
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=233

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-15 22:25:48 +00:00
orbiter
b5346141b3 made the plasmaHTCache static (there is only one internet, so we need only one cache) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4045 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-15 21:31:31 +00:00
orbiter
947fc46904 refactoring of search process: 
- re-designed remote request result processing
- re-designed local result accumulation, will be further enhanced with snippet fetcher
- removed search process handling in switchboad
- made snippet class static (there is no need for multiple snippet objects)
- removed some redundant tasks in server-side search process, should be a little bit faster now


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-15 11:36:59 +00:00
orbiter
3ca8f71cbb refactoring of dbtest to create separated kelondro sql connector interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-11 22:40:24 +00:00
orbiter
61f93cbf14 some code-cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4040 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-11 00:42:04 +00:00
orbiter
e76e996737 fixed umlaute-problem 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4039 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-10 14:10:57 +00:00
orbiter
4798044708 fixed compile problem with svn 4037 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4038 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-10 14:03:07 +00:00
orbiter
24e25e1141 enhanced SSI server-side support: 
- SSIs may now refer to servlets, not only files
- calling a servlet, the servlet/SSI engine is called recursively
- SSIs now work also for non-chunked-encoding supporting clients
This will support the new search page functionality, to show search results
dynamically without using javascript. To test this method, a test page has been added
http://localhost:8080/ssitest.html
..calls dynamicalls 3 servlets, which produce some delays during their execution
please verify that you can see the result step-by-step on your browser
To implement this feature, some refactoring had been taken place, mostly code
had been made static and will execute faster.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4037 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-09 21:58:38 +00:00
low012
c8e5a4a6b7 *) fixed bug described by Huppi in http://forum.yacy-websuche.de/viewtopic.php?t=239 
*) added a preview function to message system
*) removed some old comments, I hope that's OK


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4036 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-08 18:23:45 +00:00
orbiter
5c1b444690 some redesign of min/max and normalization computation during search result ordering 
this saves about 1 millisecond for each URL reference, which has some good effect
on the search result computation if a word is searched that appears very often
(speed-up of 1 second and more)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4033 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-06 12:50:11 +00:00
orbiter
9678d1b282 fixed new EcoRecords-Nodes. Here I omitted object content copying before 
to avoid massive System.arraycopy. That did obviously not protect enough the Node objects


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4032 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-06 10:10:33 +00:00
orbiter
1af0e3bd84 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4031 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-06 00:56:56 +00:00
orbiter
5605887571 refactoring of search processes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4030 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-05 23:57:25 +00:00
orbiter
62347b50f4 added security layer for ViewImage: 
- images may be requested by localhost and authorized users only, if the request is done using a clear-text URL
- the image may be requested also using a code that can be a license to retrieve a URL for everyone
- some servelets produce URL licenses for ViewImage, like image search results


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4027 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 23:06:53 +00:00
orbiter
9a860cf397 bugfix for wrong record tracker message 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4026 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 12:24:52 +00:00
orbiter
69d640b041 added missing synchronization in crawl balancer 
to avoid that the synchronization is triggered during many-time-used size() operation
a notEmpty method was added that can avoid the synchronization many times

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4025 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 12:21:46 +00:00
orbiter
9628db6cdc enhanced memory allocation during database access: 
- refactoring of kelondroRecords; this class is now divided into
  kelondroAbstractRecords, kelondroRecords, kelondroCachedRecords, kelondroHandle and kelondroNode
- better abstraction of kelondroNodes, such nodes may now be crated by different classes
- a new Node defining class kelondroEcoRecords defines Nodes that do not need so much allocation and System.arraycopy
- there is less memory transfer on the bus, especially for collection index
- now half of memory needed for web index access


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-03 11:44:58 +00:00
orbiter
57a5b6fa71 some generalization of remote proxy configuration and setting handling in httpc 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4023 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-02 00:42:37 +00:00
orbiter
367fc28928 corrected Brausse->Brausze 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-08-01 22:15:51 +00:00
low012
ea05c7d463 *) characters are saved in ASCII-safe notation in language data files now ('\u0063' instead of 'a'), this hopefully avoids lots of problems 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 21:27:28 +00:00
orbiter
757703a938 synchronization of access tracker to avoid java-internal loop in TreeMap during shutdown 
see http://forum.yacy-websuche.de/viewtopic.php?p=1178#p1178

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4017 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:42:11 +00:00
orbiter
beb2e062a7 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=192&p=1129#p1129 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:17:39 +00:00
orbiter
e76fe1c078 - replaced unicode characters in copyright holder name ('Brausse') 
- more logging for bootstrap seedlist loading
- larger DHT chunks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-31 10:00:17 +00:00
orbiter
31023dbc7a added package declaration for language package 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 22:53:51 +00:00
low012
255e754257 *) Removed unnecessary condition (always true). 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4013 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 21:03:07 +00:00
low012
a42d233944 *) Filename for output file is created from language code + .ldf now (e.g. en-GB.ldf) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4012 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 21:00:42 +00:00
low012
ffc607d65d *) Fixed a small bug found by Lotus. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4011 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-30 13:03:10 +00:00
low012
33e2423bde *) Tool to find out the percentage of letters in a text. First step to build a tool which detects the language a text is written in. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-29 22:05:20 +00:00
low012
3ee9a26ef2 *) deleted unused program 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4009 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-29 15:30:29 +00:00
low012
d36786bf37 *) startYACY.sh is compatible with OpenSolaris now (see http://forum.yacy-websuche.de/viewtopic.php?t=203 for details) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4007 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-27 21:56:49 +00:00
orbiter
8d6aa7a66d replaced detailed search page by ranking definition page (this is what it essentially is) 
the ranking definition there will influence the normal web search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-25 14:04:36 +00:00
orbiter
7ff4357184 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=206&hilit=&p=1130#p1130 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4004 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 18:11:30 +00:00
orbiter
75d1437340 fix for http://forum.yacy-websuche.de/viewtopic.php?p=1123#p1123 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 13:39:53 +00:00
orbiter
9ca46a8c69 indexing of local (intranet) urls enabled 
To do this, one must create a separate YaCy network that has a local URL domain
A description how to do this is here: http://www.yacy-websuche.de/wiki/index.php/De:Netzdefinition

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4001 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-24 00:46:17 +00:00
orbiter
c48c9735cb bugfix for property table loader (did not exclude comment lines) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4000 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 13:38:17 +00:00
orbiter
6758beae9c fix for http://forum.yacy-websuche.de/viewtopic.php?p=1092#p1092 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 09:54:12 +00:00
orbiter
511dcbb172 fixed encoding bug made in SVN 3993 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3998 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-23 00:50:57 +00:00
orbiter
ec817a2ff5 removed JAR command from ftpc - produces warnings and is not used by YaCy 
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=193&hilit=

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-22 20:08:09 +00:00
orbiter
f5a4efb76e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=192&hilit=&p=1034#p1034 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3996 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-20 08:06:21 +00:00
orbiter
bf6f6820ec fix for another BMP parser problem. This is not a bug, I guess it was caused by a corrupted graphics file. 
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=180&hilit=&p=1017#p1017

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3995 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-19 22:11:48 +00:00
orbiter
40b0547611 - documentaton changes (removed old forum links) 
- different handling of link quotation
- different handling of link normalization
- enhanced html/unicode en/de-coding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3993 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-19 15:32:10 +00:00
orbiter
dcb8687904 fix to update cycle 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 22:45:29 +00:00
orbiter
cff019464e fix for BMP/ICO magic detection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 13:08:24 +00:00
orbiter
557f8d80e4 - better logging 
- fixed bugs in auto-update

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 13:03:20 +00:00
orbiter
f323e1813d added commons.logging again (is used by mimeTypeParser) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3989 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-18 11:47:19 +00:00
michitux
a695c93662 Fix of the Status-page for IE: 
- reverted revision 3982 and 3979
- added a real fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=163


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3988 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-17 22:06:06 +00:00
orbiter
b6d9cca67e - fixed problem with yacyVersion and own version generation 
- within this context: generalized date format handling
- extended Update interface:
 * a version lookup can be triggered manually
 * a complete lookup + download + re-boot process can be triggered with one click

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3986 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-07-16 23:47:21 +00:00