Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,868 Commits 1 Branch 20 Tags 836 MiB
029e16b653
Commit Graph

4868 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
lotus
029e16b653 replaced some put(String, String) by putHTML(String, String) on serverObjects respond 
in htroot/ root
didn't touch htroot/xml/
this should solve potential xss issues

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5184 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-19 11:45:11 +00:00
apfelmaennchen
5b2a57bfd0 - /xml/util/getpageinfo_p.xml added <desc> and <lang> tags 
- changed htmlFilterContentScraper.getKeywords() to split either space or comma charater not both

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5183 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-18 21:01:23 +00:00
orbiter
e1f67262f7 - added and removed some debugging output 
- fixed a bug with merge method
- patched wrong output of language identification (not fixed, only patched!)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5181 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-18 14:12:15 +00:00
orbiter
ce2a7ed116 integrated language detection classes into condenser environment 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5180 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-18 13:12:33 +00:00
orbiter
2b13705839 fixed a mistake in indexing queue processing: documents had been parsed before it was checked if they should be indexed or not. parsing was not necessary for this check, so the check was moved in the queue in front of the document parsing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5179 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-18 11:36:09 +00:00
orbiter
ea5de7436d added Sciencenet to the compare search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5178 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-18 10:56:18 +00:00
orbiter
21dbb39afa switched two balancer cases 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5177 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-17 22:13:25 +00:00
orbiter
1bbf362cef update to the crawl balancer: better organization and better crawl delay prediction 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-17 21:45:21 +00:00
orbiter
538991ff2f release 0.60 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 23:07:52 +00:00
orbiter
ddcf285499 - fixed a bug in performance setting (did not work with german translation) 
- reduced maximum number of error url references to save some memory (this was actually a small memory leak)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5174 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 23:04:24 +00:00
orbiter
0cd0fee546 fixed bug with wrong proxy result enqueueing. See: 
http://forum.yacy-websuche.de/viewtopic.php?p=8130#p8130
- removed the online status property. This influenced the proxy behavior and created some complexity that was not needed because the online status was never used as it was ceated for (offline browsing)
- checked all proxy identification procedures during crawling and enhanced transparency and error checking
- fixed a proxy identification routine that caused the wrong selection of the proxy result queue

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5173 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 21:56:23 +00:00
apfelmaennchen
e071f759d2 YaCy-UI: small optical changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5172 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 21:39:14 +00:00
apfelmaennchen
bbacf86fe8 - added /xml/bookmarks/posts/add_p.xml 
- security fix to /xml/bookmarks/posts/delete_p.xml
- YaCy-UI: added 'add' and 'delete' bookmarks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5171 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 21:38:13 +00:00
apfelmaennchen
cd1ac5bb90 - fixed security issue with /xml/util/ynetSearch.xml 
- hopefully fixed YaCy-UI local search with async=false for Ajax-request

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5170 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-16 05:55:31 +00:00
orbiter
c73cf05ddd tried to fix local search in yacy-ui 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5169 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 21:56:53 +00:00
apfelmaennchen
2468155e48 YaCy-UI: update to German translation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5168 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 21:02:35 +00:00
apfelmaennchen
99ff478d63 YaCy-UI: small optical fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5167 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 20:30:33 +00:00
orbiter
c8b6fbe900 translation update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5166 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 19:14:57 +00:00
orbiter
7e24c51fd5 - removed alternative search page in main menue in favor of rich client search page 
- added necessary option to search request of yacy-ui to get snippets

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5165 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 19:00:22 +00:00
orbiter
670244849d fix for http://forum.yacy-websuche.de/viewtopic.php?p=9835#p9835 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5164 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 18:29:37 +00:00
lotus
fd9233244e configurable free disk space via disk.free 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 17:33:06 +00:00
apfelmaennchen
7c5867a832 Major update to YaCy-UI 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5162 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 17:18:07 +00:00
orbiter
25a62cdc3f small fixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5161 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 15:11:59 +00:00
lotus
73f233bb11 * set resource observer to 1000MB 
* transparent favicon

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5160 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 12:41:27 +00:00
orbiter
1be24158a2 small fix / rendering option 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 10:22:05 +00:00
orbiter
105be67998 - some bugfixes to compare search 
- redesigned input boxes: smaller, more space for result page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5158 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 09:43:51 +00:00
orbiter
693fa2a157 - renamed Comparison to compare_yacy 
- added more search engines
- some refactoring and added a list that is used to present the search engine list in a specific order
- added simpleheader and no-header options
- added the compare search to the simple header
- added default compare search page selection storage - after re-start you get the same default search engines as you selected before

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5157 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-15 09:17:05 +00:00
orbiter
78ad58cd42 the UseConcMarkSweepGC option caused a full CPU usage - bug on Darwin (Mac OS X) 
but it was reported that the same option causes a good performance on Solaris
Therefore it is now only used if YaCy runs on solaris.
Pleas make comparisment tests with/without this option on linux and change start script
if it is obvious that the option causes the linux JVM to work better. (with Java 1.5 !)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5156 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 20:35:50 +00:00
orbiter
5fbccfd75e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1366&p=9348#p9348 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5155 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 20:10:43 +00:00
orbiter
a28faabfd2 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5154 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 20:03:59 +00:00
daburna
44a4e2815a translation update 
// so, das fehlte wohl

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5153 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 19:09:28 +00:00
daburna
c536212317 translation update 
// hoffe, dass ich nichts zerstoert habe, da mir vorherige updates fehlten. wenn ja, wird gleich repariert

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5152 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 19:07:50 +00:00
apfelmaennchen
7b63c66a08 - bugfix in bookmarksDB.Tag.hasPublicItems() 
- this anoying little bug prevented display of public items without admin login for /xml/bookmarks/...

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5151 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 18:45:08 +00:00
lotus
6216105ca5 small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5150 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 18:12:26 +00:00
lotus
5e5178b5e8 please use putHTML to avoid XSS 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5149 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 18:08:39 +00:00
low012
b33a6cbb77 *) less disturbing elements in yacy frame 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5148 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 17:58:08 +00:00
f1ori
98d902b972 * remember last searchwords in Comparison_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5147 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 15:21:57 +00:00
orbiter
bd45c5a2bc integrated the comparison page into the main menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5146 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-14 10:40:01 +00:00
low012
5e0390a24c *) Ooooooooops! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5145 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-13 17:14:41 +00:00
low012
dc56c35289 *) added page to compare results of 2 search engines 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5144 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-13 16:50:01 +00:00
orbiter
1fb1665e71 increased dht interval to avoid peer selection failure 
(maybe too less peers available to fill the big gaps)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5143 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-12 13:38:27 +00:00
lotus
880d1a83e2 do not change memory and some non-defined tasks with performance profiles 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5142 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-12 11:54:25 +00:00
orbiter
1eb813bd43 shifted index deletion-on-exit rule to the class where the errors are produced 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5141 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-12 11:51:48 +00:00
f1ori
ba76995d2c * fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1415 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5140 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-12 10:54:11 +00:00
f1ori
bea6c13139 * with r5137 robotParser didn't work at all -> fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5139 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-12 09:06:38 +00:00
lotus
3ded1efe84 kelondroExceptionCounter didn't work 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5138 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-11 18:51:47 +00:00
f1ori
ae677e1738 * fix problem in robotparser, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1421&p=9742 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5137 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-11 18:12:17 +00:00
lotus
383d89481e count errors before deleting collection.index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5136 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-10 16:40:20 +00:00
lotus
0bb4fbc403 delete corrupted collecion.index on exit for rebuild on next start 
see http://forum.yacy-websuche.de/viewtopic.php?p=9725#p9725

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5135 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-10 12:55:14 +00:00
lotus
b68d06a6e8 performance settings based on network's remote crawl speed 
removed some _pro values from config

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5134 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-09-10 12:52:17 +00:00