Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,421 Commits 1 Branch 20 Tags 836 MiB
7bd8601f04
Commit Graph

4421 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
danielr
7bd8601f04 delete old releases compatible with java 1.5 ;) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4728 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-23 07:22:20 +00:00
orbiter
e90282da1c added experimental javascript terminal for rss feeds (not used yet anywhere yet, expect the worst) 
.. possibly to be used as content for iframes within monitoring pages
not ready yet!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4727 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-22 23:09:24 +00:00
danielr
da386a1924 fixed deleteOldDownloads if there are no downloads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4726 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-22 21:36:52 +00:00
danielr
21418a22a3 removed DEBUG output 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4725 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-22 17:14:34 +00:00
danielr
79a3edeeef deleting downloaded releases after x days (default 30) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4724 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-22 16:53:53 +00:00
danielr
763f9d4f5d serverCore: setting timeout for new connection before SSLDetect 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4723 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-22 09:03:16 +00:00
orbiter
1995faef8d - refactoring of Colage back-end: move to plasma package 
- renamed also the plasmaCrawlResults to have a consistent naming for url and image queues
- added a double-check for the images
- added additional queues for the images: all worse-quality images go there, so the queue can be used also if no sizes are given; no image is lost
- added a cleanup for the stacks so they cannot flood the memory

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-21 22:42:49 +00:00
orbiter
d7e89c2aca fixed near-deadlock situation when deleting crawl profiles 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4721 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-20 22:10:26 +00:00
orbiter
5e3ce46339 - better logging when rejecting a url because it is not in declared domain 
- more XSS attack protection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4720 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-20 21:36:25 +00:00
orbiter
6d1be66822 - longer refresh rate for reload of WatchCrawler page forwarding to indexing start (does not work in IE) 
- better names for search pages
- Release 0.58

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-20 08:10:52 +00:00
apfelmaennchen
2149728227 - major rework on YaCy-UI 
- search results are retrieved from rss/xml, no other servlet needed
- added double accordion sidebar menus

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4718 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 11:31:41 +00:00
orbiter
c270d02176 Reverting SVN 4716 
ein 1.6er Target versehentlich zu setzen bedeutet bei automatischer Release-Erzeugung und updates bei Usern,
die nur Java 5 installiert haben (was bei allen Mac-Usern so ist), dass große Teile des Netzes crashen können und manuell
wieder hoch gezogen werden müssen.
Neu-User die mit einem dev-Release Beginnen können mit der intranet-Einstellung gar keine Websuche starten.
Bitte nach einem Commit immer kontrollieren, was man da eingecheckt hat.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4717 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 09:58:36 +00:00
danielr
48ffd61e6a changed "patched wrong" to warning, so it goes to the logfile 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4716 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 07:54:44 +00:00
orbiter
2f629d20a7 - tried to fix the '4217666-problem' 
- removed more unused code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 04:24:29 +00:00
orbiter
512f48e7d6 - removed unused methods 
- fixed xss attack on peer list in CrawlStartSimple

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4714 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 03:33:07 +00:00
orbiter
14384e7a45 deactivated unnecessary and very CPU-intensive deletion check for blacklisted URLs in index receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4713 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-19 03:02:44 +00:00
f1ori
701f769c66 * removed comma, which caused invalid xml 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4711 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-18 15:07:36 +00:00
orbiter
3c76342619 - added servlet to configure the search page greeting line 
- added information output about the current network definition in the network servlet
- better description and usage of profile entries in User Profile servlet regarding FOAF format
- reformatting of menues at status page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4710 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-18 13:58:56 +00:00
f1ori
b9602e891a * added CrawlProfileEditor_p.xml for monitoring in yacybar 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4708 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-18 09:13:02 +00:00
orbiter
d03940f2ec - included patch from http://forum.yacy-websuche.de/viewtopic.php?p=7193#p7193 
- fixed problem with crawl profile editor after deletion of a crawl profile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4706 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-17 22:21:03 +00:00
danielr
d1ee231866 HTTPC close more unused connections 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4702 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-15 16:37:51 +00:00
danielr
181796cffb - HTTPC ConnectionInfo entfernen bei Exceptions, unnötigen Code entfernt 
- FTPC (GET-)connections bei Fehlern auf jeden Fall schliessen


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4701 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-15 15:27:32 +00:00
orbiter
04c1226c80 added/fixed missing integrity-test else-case during deploy in case that we update with a tar file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4700 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-15 15:20:35 +00:00
orbiter
6155f0e634 last small changes until main release 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4699 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 07:26:33 +00:00
orbiter
45ae3da7e7 another patch to prevent NPE in EcoTable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4698 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 05:33:32 +00:00
orbiter
cb93ded5c6 applied configuration path patch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4697 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 04:10:51 +00:00
danielr
96e39b297a reduced StackTraces (by connect timed out) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4696 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 03:50:49 +00:00
orbiter
93376acdca fixed a bad chunkcache limit check which could have caused ArrayIndexOutOfBoundsExceptions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4695 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 03:49:02 +00:00
orbiter
1cab240198 patch for possible NPE in EcoTable iterator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4694 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 03:20:37 +00:00
orbiter
9a32a4c328 fixed concurrentModificationException during hello-process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4693 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 03:04:28 +00:00
danielr
64c33e717f catched ConcurrentModificationException in ConnectionInfo.cleanUp so cleanUp is not interrupted 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4692 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 03:02:44 +00:00
daburna
70826bb501 -small update for de.lng 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4691 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-14 01:14:44 +00:00
danielr
d8677ba611 fixed ConcurrentModificationException in HttpConnectionInfos 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4690 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-13 11:25:41 +00:00
orbiter
c7021c14bb patch for ArrayIndexOutOfBoundsException in BMP parser 
(may occur in case of malformed BMPs)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4689 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-13 03:28:26 +00:00
orbiter
8dd35f74c8 fixed redirect problem (does not work for POST) 
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1068&hilit=

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4687 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 16:35:09 +00:00
orbiter
8313d58ae7 - integrated the collage into the Web Visualization menu 
- added a counter for the public and private queue on the page (testing..)
- fixed wrong public/private categorization

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4686 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 15:45:57 +00:00
danielr
c5d1d7faca undo wrong commited files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4685 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 15:22:57 +00:00
danielr
2617f4dcdb Connections_p.html: better formatting and remove very old entries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4684 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 15:19:18 +00:00
orbiter
82bf9ac1c8 - added Collage servlet from datengrab and modified it: 
* all images are queued
* private/public is respected
* inserted into switchboard
* added collageQueue class that stores all the queued images

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4683 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 13:24:21 +00:00
danielr
959f448e5f - disabled redirects in proxy (so client sees real path) 
- added connection stats (only connections currently in use)
- remove "old" connections (closed or idle for some time)
- synchronized shared parts of proxyHandler


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4682 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 11:39:48 +00:00
orbiter
8fe39ebd74 -fixed file transmission with POST. The only usage was in ranking transmission, therefore: 
-fixed ranking transmission

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4681 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-12 08:12:51 +00:00
orbiter
82a9861779 fix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4680 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-11 12:55:43 +00:00
orbiter
5d1fbb25e7 fix for bad deploy: 
- the name of downloaded release files is adopted if the httpc delivers uncompressed tar.gz files (the .gz is removed from the file name)
- the deploy method is able to handle tar-file (not tar.gz-files)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4679 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-11 12:37:17 +00:00
orbiter
202a3adb3e refactoring of HttpClient Writer processes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4678 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 22:47:05 +00:00
danielr
8aa9fd8f24 HTTPC with only 1 retry 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4677 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 16:47:57 +00:00
orbiter
444dce7e81 more performance hacks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4676 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 15:28:58 +00:00
orbiter
2c2dcd12a2 - enhanced performance of Eco-Tables: less time-consuming size() - operations 
- will increase speed of indexing and collection.index creation


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4675 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 13:24:55 +00:00
orbiter
e356625b22 - refacotring of stream copy handling to support time-consuming operations 
- made usage of BufferedStreams explizit to distinct different copy method in serverFileUtils (byte-by-byte and using an own buffer)
- introduced another timeout setting (java internal property)
- more restrictions to clients accessing a single host (a security setting to prevent DoS by mistake)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4674 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 09:53:07 +00:00
danielr
f01c50cf8d Proxy logging error (first step to resolution!?) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4673 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-10 06:56:06 +00:00
orbiter
c3342e1178 - removed class with only one static method 
- removed connection method with too long time-out

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4672 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-04-09 23:35:20 +00:00