Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,687 Commits 1 Branch 20 Tags 836 MiB
c54058e64b
Commit Graph

1066 Commits

Author SHA1 Message Date
orbiter
6ad471ef96 * applied many compiler warning recommendations 
* cleaned up code
* added unit test code
* migrated ranking RCI computation to kelondroFlex and kelondroCollectionIndex


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2414 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-16 19:49:31 +00:00
low012
9add56dc09 *) Cursor gets placed in search field when page is loaded. If Javascript is disabled or function does not work for any other reason, there will be no change to current behaviour. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2411 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-15 22:21:33 +00:00
theli
34831d2d9f *) Check validity of crawl filter reg.exp. before adding it into the crawler queue 
See: http://www.yacy-forum.de/viewtopic.php?p=24671

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2410 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-14 16:11:22 +00:00
theli
5e0b6f8f83 *) sorting peer name list on Blacklist_p.html 
*) restructuring of sharedBlacklist_p.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2405 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-13 13:29:50 +00:00
theli
6c8366aea1 *) Bugfix for blacklist import function 
- wrong property name
   - list was accidentally imported into a new blacklist file

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2404 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-13 09:20:43 +00:00
orbiter
d0000a15d6 adjusted opensearchdescription to match requirements of A9 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2403 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-13 00:25:32 +00:00
orbiter
248627ab92 added open search compatibility 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2401 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 17:59:13 +00:00
theli
eee44be602 *) adding an interface for customized blacklist classes 
- now it's possible to use a customized blacklist engine
     instead of the default one
   - this can be done by configuring the property BlackLists.class
   See: http://www.yacy-forum.de/viewtopic.php?t=2108

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2397 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 14:28:14 +00:00
theli
79f27c298e *) next bugfix for blacklist 
- added items were not displayed properly
   - bugfix for disabled usage

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2395 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 12:18:39 +00:00
theli
4abc04dac0 *) make Blacklist_p.html more failsafe if no blacklist file is available of the user has entered empty strings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2394 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 12:03:44 +00:00
theli
28c84e5b57 *) Bugfix for NullPointerException in Blacklist_p if blacklist directory is empty 
See: http://www.yacy-forum.de/viewtopic.php?p=24563

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2392 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 11:03:14 +00:00
theli
66f1eb07d9 *) Bugfix for IllegalArgumentException in transferURL 
See: http://www.yacy-forum.de/viewtopic.php?p=24560

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2391 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 10:54:19 +00:00
theli
d2e8e76218 *) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler 
See: http://www.yacy-forum.de/viewtopic.php?t=2541
        http://www.yacy-forum.de/viewtopic.php?p=24516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2389 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-12 02:42:10 +00:00
orbiter
f43c90fa98 fixed handling of null referer in crawlOrder 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2384 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-11 21:46:34 +00:00
rramthun
23a99b8283 Small changes to the language 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2383 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-11 20:55:40 +00:00
orbiter
abf22f6e60 removed url normalform computation from htmlFilterContentScraper. 
This method was implemented in de.anomic.net.URL


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2377 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-11 15:09:22 +00:00
orbiter
718fbc2dae enhancements in kelondroCollectionIndex: 
* synchronized array and index objects
* auto-fix function for slightly corrupted index entries
* generalized internal access methods

also extended kelondroIndex interface to support ordering access
which is used in kelondroCollectionIndex for string comparisments

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2366 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 23:29:26 +00:00
orbiter
ec5149ff3b fix for busyCacheFlush detection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2365 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 22:28:09 +00:00
orbiter
f58283def2 better control of index flush 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2364 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 22:07:17 +00:00
orbiter
80b6c90d54 enhancements to prevent blocking during dht transfer receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2362 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 21:49:39 +00:00
auron_x
4fb8fddd99 *)made the domainlist of the blacklist sorted 
if a new domain is added it is still appended to the end of the list and sorted in with next refresh, may need a fix.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2361 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 17:34:27 +00:00
hermens
d56f06401e - Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible 
- Small logging updates



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2359 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 11:42:00 +00:00
theli
c09f734d06 *) offer router configuration on ConfigBasic.html 
- checkbox to allow router configuration is shown if
   - a) the UPnP forwarder is installed
   - b) a UPnP enabled router was found
   - c) no other forwarder was configured
   See: http://www.yacy-forum.de/viewtopic.php?p=24264

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2358 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 11:31:18 +00:00
hermens
dcbb4d0a6b Display the size of HashBlacklistedCache on PerformanceMemory page. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2357 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 11:19:54 +00:00
theli
c7b6389ca1 *) renaming indexDistribution.dhtReceiptLimitEnabled property to indexDistribution.transferRWIReceiptLimitEnabled 
so that the default value is taken over by all peers


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2356 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-07 11:01:01 +00:00
theli
988341cf81 *) some comments added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2352 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-06 14:44:04 +00:00
theli
d54767f634 *) last step of removing embedded html from dir class 
- migration finished
*) dir list now sorts the dirlist entries. 
   - directories are listed before files
   - files are sorted alphabetically, case insensitive 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2351 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-06 14:38:07 +00:00
rramthun
96b774e427 Adding link to newsletters as agreed in forum. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-06 10:22:53 +00:00
theli
8283df2d77 *) first step of removing embedded html from dir class 
- dir list generation uses templates now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2349 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-06 08:09:39 +00:00
orbiter
279b1d969d Integrated new indexing data structure 'collections' into the main class 
for indexing, the plasmaWordIndex.

The new data structure is ready-to-use, but currently disabled.
It can be activated by setting the static
plasmaWordIndex.useCollectionIndex
to true. This shall be done for testing purpose.

The new index is stored to
DATA/INDEX/PUBLIC/TEXT
The directory PLASMA shall be used only for crawler in the future.

Attention: during testing the data structure in INDEX may change,
and created indexes with the new data structure may get useless.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2348 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-05 22:22:14 +00:00
allo
132cd7da45 no need to copy dir.* 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2346 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-05 18:39:25 +00:00
allo
0164321160 fix for the actions (uploading/deleting, loggin in, ...) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2345 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-05 18:34:31 +00:00
orbiter
9183d21f25 renamed new index class to old name 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2342 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-02 20:01:59 +00:00
orbiter
c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object 
to store the index entry. This is another step to move to the new database structure.
A side effect of this change is, that index storage uses much less RAM space,
which affects the index RAM cache.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-02 19:59:28 +00:00
orbiter
e357599f92 * fixed problem with indexContainer iteration from RAM: 
indexContainers from RAM must be cloned explicitely to prevent
  side-effects on stored indexContainer objects in Cache
* changed behaviour of urlReference deletion from indexContainers:
  deletion does not user retrieval of all Elements from the assortments
* added textual configuration of kelondroRow and kelondroColumn definition
* update of kelondroRow usage in yacyNews
* modified kelondroAttrSeq to use modified kelondroColumn parser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2339 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-08-01 10:30:55 +00:00
orbiter
8b77afd72c some fixes to new container merger 
and some code cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2336 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 22:40:11 +00:00
theli
6e676224d0 *) adding support for upnp 
A new port forwarding method for upnp was added.
   If this method is enabled, yacy automatically determines an UPnP 
   capable internet gateway and configures the gateway port forwarding
   settings properly. 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 14:26:45 +00:00
orbiter
417ed5102e redesign of database iterators: 
an iteration of key elements in kelondroTree databases is no longer supported.
this is now replaced by an iteration of kelondroRow.Entry objects from the database
Iteration of keys from the database was mostly followed by retrieval of the row
from the database, whcih caused unnecessary database load.
The index selection was also redesigned to use the new row iteration methods.
This affects many funktions, most important is the DHT selection routine which is now much faster.



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2327 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-26 11:21:51 +00:00
orbiter
ad692fc6c7 implemented option to extract nurls from the database 
(plus some iteration enhancements for nurls)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2325 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-24 16:40:59 +00:00
orbiter
5f72be2a95 some redesign of EURL storage 
* store() is now called explicitely
* more urls are written to the EURL table
* the EURL stack does not store the complete entry any more, now only the URL hash


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2323 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-24 15:25:47 +00:00
orbiter
58df8b7bbf a large collection of different changes 
* mainly for the transition to the new indexing database structure
* a bugfix for an endless loop inside kelondroTree iteration
* a bugfix for bulk read inside a kelondroTree iteration; the bug caused that some elements had been iterated twice
* very strong speed enhancement for url/domain extraction

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-23 22:39:41 +00:00
theli
b3c569f706 *) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 13:52:33 +00:00
allo
01363bc7f6 missing file for the supertemplate demonstration. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2307 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 11:59:55 +00:00
allo
67c486a023 some example Code, how supertemplates can be used. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2304 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-19 07:08:15 +00:00
allo
7b0e2521bb Support for a supertemplate, which can do all thing, a normal template can do. 
Its a layer under the servlets, this means, #[page]# will be replaced by serverletcode, the rest can be set by you.
(TODO: if we use this for layout, we need to read "TITLE" from the servlet's tp, to set it outside of the servlet.)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2302 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-18 15:51:19 +00:00
allo
ff39a7a0d1 Overlay for welcome.* 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2299 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-18 11:07:30 +00:00
rramthun
b5ec7de936 Correction to last commit + spelling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2296 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-17 16:23:47 +00:00
allo
8e08125657 security fix (known path on yacy host / known path on remote ftp server) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2292 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-13 19:15:28 +00:00
orbiter
3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL 
This shall be seen as an experiment to exclude all cases where
there could be a DNS lookup during URL comparisment.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2290 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-13 01:21:53 +00:00
allo
933a9e02ab fix for broken build 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-09 14:35:20 +00:00
allo
360056b30c fix ajax bug (no valid xml) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2283 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-09 10:59:55 +00:00
allo
f4d200ffa2 typo 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2281 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-07 20:44:45 +00:00
orbiter
e22cbaee97 - extended logging for preload 
- reduced preload-time for IndexImport_p.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2278 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-05 09:02:58 +00:00
orbiter
92f4cb4d73 added option to configure the start-up delay time for kelondro database files. 
the start-up delay is used to pre-load the database node cache

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2276 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 23:57:33 +00:00
orbiter
675d1081a4 code clean-up: switched off unused variables 
(bitte solche Variablen die nicht benutzt werden vermeiden.
Ich habe hier ein strafferes Warning an, da bekommt man die
immer angezeigt)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2273 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-03 13:39:08 +00:00
theli
31b5d8980e *) Bugfix for basic config redirection bug 
see: http://www.yacy-forum.de/viewtopic.php?p=23503

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2269 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-07-02 13:03:01 +00:00
rramthun
068d82c4c2 Important update of YPStats 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 20:30:50 +00:00
theli
b594ee9a5a *) Adding possibility to configure if the http proxy should send the 
X-forwarded-for header (requested by TeeSee)
   See: http://www.yacy-forum.de/viewtopic.php?t=2577

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2257 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-29 16:01:03 +00:00
rramthun
0e9192a622 Updated YPStats_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-28 09:51:38 +00:00
hydrox
8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-28 08:51:34 +00:00
rramthun
db2405533a New YPstats possibility. 
Users can enter the details of their system configuration and we are able do work-out profiles for special uses and hardware-configurations.
Default DB running on yacy-forum.de, but URL can be changed. 
User can see all data, which will be submitted.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-27 15:45:38 +00:00
hermens
53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit 
See: http://www.yacy-forum.de/viewtopic.php?p=22911#22911



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-27 11:14:30 +00:00
orbiter
4cc6e6551f bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-26 09:52:23 +00:00
orbiter
66964dc015 removed high/med/low from kelondroRecords cache control. 
this was done because testing showed that cache-delete operations
slowed down record access most, even more that actual IO operations.
Cache-delete operations appeared when entries were shifted from low-priority
positions to high-priority positions. During a fill of x entries to a database,
x/2 delete situation happen which caused two or more delete operations.
removing the cache control means that these delete operations are not
necessary any more, but it is more difficult to decide which cache elements
shall be removed in case that the cache is full. There is not yet a stable
solution for this case, but the advantage of a faster cache is more important
that the flush problem.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-25 10:31:38 +00:00
theli
b20496e42b *) make DHT DoS check configurable (requested by KoH) 
- check can be disabled via property indexDistribution.dhtReceiptLimitEnabled
   - upper bound can be configured via indexDistribution.dhtReceiptLimit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2234 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 19:28:42 +00:00
allo
032b3fdd94 allow Creation of gettext only with password, because it causes high cpu-usage. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2227 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-21 10:39:25 +00:00
allo
c264cda678 support to parse gettext files and to generate updated files, where only the new strings are empty. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2222 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-20 18:52:17 +00:00
allo
f95c006dc2 generation of empty gettext files from yacy html-files 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2218 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-19 19:34:00 +00:00
allo
0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-06-18 12:15:26 +00:00
allo
6fe2fed87e cookieauth works with static Admin. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-16 08:04:02 +00:00
theli
4ca0857c0c *) Index transfer now considers the pause time send by busy peers during 
index transfer / index distribution
   See: http://www.yacy-forum.de/viewtopic.php?p=22647#22491

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-14 09:40:42 +00:00
allo
958408ca4a bugfix for httpauth logout. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2203 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 20:22:15 +00:00
allo
b23703f260 using cookieAuth. 
logout for httpauth seems to be broken :-(

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2202 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 16:16:13 +00:00
allo
bd22634c44 HTML-login, logout fixed. 
TODO: If you login with the form, then logout with the form, and then try to login with httpauth, the first try will fail.
(should logged_out be resettet in ipAuth? but if there is ipAuth before proxyAuth, the logout would be broken. Maybe a combined method can help.)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2200 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 13:47:44 +00:00
hermens
3f1ebc097e Limit the size of the DNS cache to 5000 and the age of the entries to one day. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2199 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 12:14:11 +00:00
allo
d7a3fdb18b no white pages, when clicking cancel on the password-dialog 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2198 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-12 12:12:21 +00:00
allo
ac772d4ef0 more RAM for our powerusers ;-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2195 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-11 09:09:22 +00:00
allo
11123416f3 Form-Login function. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2193 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-10 21:03:33 +00:00
allo
251b3b636e some refactoring for js 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2191 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-09 17:20:17 +00:00
theli
d2dc848902 *) correcting validation of proxyStoreHTCache in ProxyIndexingMonitor configuration 
See: http://www.yacy-forum.de/viewtopic.php?p=22663


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2188 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-09 04:49:00 +00:00
hermens
38a1410361 Don't test a remote peer's seed during hello.respond as its IP might not be proper, especially while still virgin 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2187 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-07 23:59:45 +00:00
rramthun
5625937d1c Language improvements 
One very minor  HTML fix

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-06 16:30:32 +00:00
auron_x
71228cfc56 *)added ip to Blog.xml 
*)added possibility to import Blog.xml-files
*)included german translation for new Blog-features

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2178 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-05 18:47:31 +00:00
auron_x
7b47055d6c *)added Blog.xml for backup and exporting purposes, no importing at this time 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2177 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-05 10:34:27 +00:00
auron_x
3af867c7ba *)fix for broken subject in Blog-News 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-04 12:30:23 +00:00
rramthun
962bc705d4 Fixed broken link 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2174 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-03 22:59:28 +00:00
orbiter
b4efd7fc4b changed default number of search results 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2169 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-06-02 19:40:50 +00:00
orbiter
5041d330ce refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2150 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-28 11:44:50 +00:00
orbiter
7b3b12888c refactoring: integrated indexContainer abstraction layer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2149 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-28 01:09:31 +00:00
rramthun
bc94a714b2 Better explanation for the auto-dom-filter. 
Some javadoc.
Small change to DetailedSearch.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 12:18:12 +00:00
orbiter
196b8abb30 refactoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2144 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-26 09:32:50 +00:00
orbiter
24686e50a2 - fixed a caching bug 
- added counter for cache delete to distinguish between flush and delete
- changed some default paramenters for cache size settings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2143 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-25 11:46:09 +00:00
orbiter
4d8f8ba384 added cache-performance analysis for node caches 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2140 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-24 09:40:08 +00:00
orbiter
1b4a27cd99 added monitoring for new miss-cache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2137 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 22:59:39 +00:00
orbiter
cda087f43b - integrated cache miss storage into object cache 
- removed cache-miss handling from indexURL
todo: new Monitoring in PerformanceMemory_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 16:43:28 +00:00
orbiter
757ec28430 refactoring: better data capsulation for indexURL 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2131 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-23 08:59:45 +00:00
rramthun
fd27d55385 One more table in ConfigBasic by Kebron 
Nicer blog-newssymbol by Kane

HTML corrections/improvements by /me

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2130 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-22 10:01:46 +00:00
theli
61078b3885 *) adding support for delayed shutdown 
- needed by Ismael to receive the Steering page properly on shutdown
   - now the steering page should always be displayed properly in the web browser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2129 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-22 08:02:35 +00:00
theli
97393196fa *) Avoiding wrong java heap size settings. 
Xmx must be greater or equal Xms
   See: http://www.yacy-forum.de/viewtopic.php?p=21782

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2128 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 15:15:52 +00:00
theli
8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic 
See: http://www.yacy-forum.de/viewtopic.php?t=2415
*) If ssl is available, the browser conntects to yacy via https on yacy startup
   See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 14:05:49 +00:00
rramthun
955462d6b8 Some HTML cleanup/validation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2126 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 13:20:46 +00:00
auron_x
e7199c6c7e *)fixed "Umlaute"-Bug in Blog 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2125 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 12:21:01 +00:00
auron_x
ee1cc99c2f *) fixed some minor bugs in blog 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2123 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-20 11:45:58 +00:00
orbiter
90d569d70f refactoring of index management: 
url storage is part of index management; moved plasmaURL to indexURL

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2122 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 23:50:55 +00:00
orbiter
a930be4ba3 refactoring of index management: 
generalized the index entry

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2121 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 23:19:20 +00:00
orbiter
7dd57a3828 added a busy-time estimation at DHT/RWI-Receive 
to be done: usage of this value on client-side

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2116 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 14:52:00 +00:00
theli
fcec40fcc6 *) don't accept messages without subject or payload 
See: http://www.yacy-forum.de/viewtopic.php?p=21656

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2115 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-19 11:57:17 +00:00
orbiter
82b2bc6932 patch for index-transfer DoS problem 
see http://www.yacy-forum.de/viewtopic.php?p=21627#21627
note that this function will make the index-transfer functionality void

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-18 22:24:51 +00:00
hermens
df7e1d9df3 Changes to plasmaURL and subclasses: 
- Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present
- Use a more realistic estimation of memory usage by the existsIndex cache
- Routine cleanup of the existsIndex to limit its memory usage



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-17 13:08:57 +00:00
allo
70ef53a89d html fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2112 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 17:33:46 +00:00
orbiter
a474669338 start with refactoring of index management 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 16:11:55 +00:00
(no author)
63a08307c2 Updated WikiLink 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2109 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 11:47:20 +00:00
orbiter
bfc1a6a383 interface update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2108 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-16 10:42:22 +00:00
orbiter
20958acfd8 - fix for display problem for new blog news banner 
- created 'real' ip-based links instead of '.yacy'-links

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2103 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 21:45:26 +00:00
orbiter
19c6e67003 - added generation of news for blog entries 
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 20:48:39 +00:00
rramthun
f08e33680c Added Blog-news-symbol as requested. 
I think I will change the character distance a little bit later.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 15:42:06 +00:00
theli
df068cf23c *) adding first version of native SSL support for yacy 
VERY EXPERIMENTAL!
   See: http://www.yacy-forum.de/viewtopic.php?p=18516

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-15 09:41:29 +00:00
auron_x
55ea4cbfe6 *)reverted patch for memory-display issue 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 18:09:28 +00:00
orbiter
ba9798dcb7 better fix for 
http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2093 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 17:19:43 +00:00
auron_x
53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers 
see http://www.yacy-forum.de/viewtopic.php?t=2370

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-14 08:42:41 +00:00
theli
9c5ec2c8db *) fix for broken html on IndexTransfer_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2089 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:43:00 +00:00
theli
bcc950c533 *) Bugfix for Index Transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-13 15:28:57 +00:00
rramthun
fb064fdbee Many additions/corrections to the German language file 
Increased default time for DHT distribution, because many people complained about the high load on their systems, see http://www.yacy-forum.de/viewtopic.php?p=20922#20922

Avoided problems with some browsers and ampersands, see http://www.htmlhelp.com/tools/validator/problems.html#amp

Removed nearly invisible "bug" in menu

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2087 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-12 21:25:46 +00:00
auron_x
586b256627 *)fixed Blog-bug with german Umlaute 
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 14:03:15 +00:00
allo
9938c252dd better Errorhandling for proxyAccounts 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-11 13:12:35 +00:00
orbiter
015d044c25 tried to fix some problems with latest changes to httpc 
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 16:01:14 +00:00
orbiter
26e3216bcc update to profile fetch behavior 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:37:18 +00:00
orbiter
3e31820c3d - corrections to PerformanceMemory display of object cache 
- configuration of object cache size in kelondroTree initializer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-10 09:08:42 +00:00
orbiter
fd7c17e624 added virtual host support: 
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 13:11:00 +00:00
orbiter
29b1b0823c added monitoring of new object cache to performanceMemory page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-09 10:03:12 +00:00
low012
465319caf3 *) HTML-Tags in headlines and author names were not filtered. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2061 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-06 00:47:16 +00:00
allo
799c04091d Bugfix for Spam-Bug (Header manipulation) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2057 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-04 16:41:30 +00:00
low012
97c6a70b71 *) Fixed XSS vulnerability. I was able to crawl a PDF that caused the loading of an image in the admin's browser. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2056 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-05-04 16:07:35 +00:00
orbiter
f9c953481a fix for icq+jabber icons 
see http://www.yacy-forum.de/viewtopic.php?p=20533#20533

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-29 21:37:49 +00:00
rramthun
007b8008c2 -spelling/translation 
-adding hint for text-browsers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2045 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-29 16:33:49 +00:00
orbiter
b0036249c1 added some attributes to network picture 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-21 21:21:35 +00:00
orbiter
dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-20 10:15:00 +00:00
low012
ae0bdf5d71 *) added status indicator for Jabber 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2025 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-19 08:39:49 +00:00
orbiter
00a5d435e2 - fixed some bugs with domain filter 
- added new ranking filter "prefermask": urls that match the filter are ranked better


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-13 23:19:36 +00:00
orbiter
b00756378f adopted ViewProfile to be used in search interface to fetch local profile 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2021 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-11 14:18:25 +00:00
orbiter
41afccaf34 small update to search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-10 23:05:01 +00:00
orbiter
14d6e476c9 tried to solve some problems with new picture viewer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-10 22:34:47 +00:00
auron_x
aaaaf88ecd *)fixed error when setting empty language/skin 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-08 17:06:33 +00:00
orbiter
d0dd8b14d2 fixed picture tag and presentation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 22:09:59 +00:00
orbiter
51999578bf fixed bug created with last commit of borg 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2013 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 17:13:09 +00:00
orbiter
00e768b259 added Picture button to search results 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2011 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-07 13:38:09 +00:00
daburna
7f167be945 small update of German language file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2008 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-06 21:50:12 +00:00
orbiter
f0833b0328 introduced simple search interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-06 21:48:24 +00:00
orbiter
bd283b8443 fixed bugs: 
- null pointer exception during startup of a robinson-configured peer
- wrong time calculation of default value of re-crawl option

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-06 16:28:28 +00:00
rramthun
52d3d7b008 Added the new chatscript by Allo and _cato 
The usual language stuff
Reordered superseed.txt after reliability

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2003 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-06 15:46:16 +00:00
orbiter
c5087710a4 fixed type/cat properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-05 10:47:42 +00:00
orbiter
47b541b2d1 added better option handling in yacysearch 
added depth option for image presentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-05 10:34:24 +00:00
orbiter
c9e16bfd48 first try to insert image search (does not work yet) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-04 23:12:10 +00:00
auron_x
0bf2eb4813 *) fixed Blog updating timestamp on edit (now always keeps creation-date) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-04 15:10:59 +00:00
orbiter
83e0e765ec redesigned some parts of the html scanner & parser 
to better support image tags

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-04 14:36:01 +00:00
orbiter
e2e8d0c188 some kind of refactoring of yacysearch: 
made 'room' for new picture search result presentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-03 22:47:59 +00:00
orbiter
6b63e26cbb - removed search function from index.html/java, only imput left 
- added media fetcher/crawler class (not ready yet)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-03 15:36:53 +00:00
low012
80ef2355a8 *) added login link to blog 
*) added copyright notice to blog.java
*) deleted some whitespaces in the code


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-03 11:28:12 +00:00
orbiter
d8d0ac29c3 added image-viewer servlet that can do: 
- each image that is requested is stored in the cache
- the image is taken from the cache if exists there
- the image can be scaled
The purpose of creation a scaled image is because of copyright problems
In a further stept the retrieval of not-shrinked images is restricted
to either access from localhost or with given authentication
This servlet can be used for image-preview purpose after an image search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-04-02 22:59:53 +00:00
orbiter
e566d1d8d6 some bugfixes regarding new crawling options 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1980 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-28 22:54:36 +00:00
orbiter
c7f1300300 -fixes for last commit 
-some more ranking attributes (comments only)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1979 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-28 15:37:45 +00:00
orbiter
860a7b545b enhanced input options for crawl start 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1978 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-28 15:25:58 +00:00
orbiter
7a650d0023 several bugfixes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1971 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-27 16:45:29 +00:00
borg-0300
57fc0cf063 added ranking icon to Network.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1970 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-27 15:55:31 +00:00
orbiter
59d52fb4a9 fixed some problems with crawl profiles 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-26 14:52:01 +00:00
allo
44d72f06c4 more Caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 15:08:27 +00:00
allo
918445a2f4 Bugfix for last commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:34:27 +00:00
orbiter
219d847aaa fix for appearance of radio buttons 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1963 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:07:23 +00:00
orbiter
8cac4a1e73 syntax fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1962 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:00:28 +00:00
orbiter
7310d2de1f small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 13:56:58 +00:00
orbiter
0c9b61820e enhanced re-crawl settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 13:45:01 +00:00
orbiter
708cc6c8d9 fixed some bugs for auto-filter and added monitor in profile list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 00:38:40 +00:00
orbiter
1f32ad8fd9 very small enhancements to indexCreate page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1958 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 23:32:04 +00:00
allo
c58789177f bookmarkCache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 21:33:09 +00:00
rramthun
42b0b10a95 -Adding Windows Media to types which are not sended compressed 
-Renaming writeandzip to writeandgzip to avoid confusion about type of compression
-Adding new startup message to windows script
-The usual language "enhancements" ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 20:12:23 +00:00
orbiter
63f39ac7b5 added 3 new crawling steering options: 
- re-crawl by age of page (enter in minutes)
- auto-domain-filter
- maximum number of pages per domain
NOT YET TESTED!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 16:05:16 +00:00
orbiter
1fc3b34be6 some pre-work (without function yet) to implement: 
- re-crawl (by age of last crawl)
- auto-crawl-filter by crawl depth (to be explained..)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-22 15:28:17 +00:00
orbiter
0a4c2e89ed remote crawl orders are now only accepted if sum over all 
queues is less than 100 (the indexing queue was not measured before)
see also: http://www.yacy-forum.de/viewtopic.php?p=19374#19374

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1947 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-22 14:23:24 +00:00
orbiter
1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-20 22:31:59 +00:00
borg-0300
cb23fc3d83 keywords added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1934 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 12:36:39 +00:00
borg-0300
1258df8133 no "[0-9]+" in topwords 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1933 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 12:33:50 +00:00
orbiter
6c70f4a0cf renamed wordHashes for a word hash set generation to wordHashSet 
This was done because the wordHashes iterator will get another integer
parameter and then conflicts with the wordHashes set generation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-18 01:04:16 +00:00
orbiter
dba02f399f starting of re-design of kelondroTree iterator 
- new access to iterator
- added many IOException handling in other Classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 20:52:43 +00:00
allo
d2f34a2e94 skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable). 
preference of skinfiles:
-style.css will be overwritten on every new SVN, if "DATA/SKINS/"+currentSkin+".css" exists.
-DATA/SKINS will be overwritten with defaultskins from /skins
so develop your skins in DATA/SKINS, and put them into skins for distribution.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1913 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 20:48:00 +00:00
orbiter
3286b1f498 re-organisation of lurl-creation and -stacking 
this was necessary to prevent useless write to the database
in case of blacklist appearance of the url

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 10:16:07 +00:00
hermens
289da326e5 *) Bugfix: remove blacklisted URL from loadedURL, when received via DHT transfer 
see: http://www.yacy-forum.de/viewtopic.php?p=18976#18976



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1904 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:58:44 +00:00
borg-0300
9b94b374cc Bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1903 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:16:01 +00:00
orbiter
60995a3a67 changed behaviour of "search again" appearance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1902 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:07:59 +00:00
orbiter
3881f9ccde fixed total number in network list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1894 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 22:40:30 +00:00
orbiter
a6a3f4b694 fix for svn 1888 
this is a redesign of the no-iterator solution

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 16:01:42 +00:00
auron_x
1fc494858d *)added blog to the nav-bar 
*)added some padding to blog entries (looks nicer)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1891 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 15:51:25 +00:00
daburna
7605ddd450 just testing my new svn-client with linux - daburna - if login is possible... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1889 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 23:24:05 +00:00
(no author)
5ddc32f49a just testing my new svn-client with linux - daburna 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 22:56:41 +00:00
orbiter
e94b374d56 update to cache flush method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 23:06:06 +00:00
rramthun
9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 20:12:31 +00:00
allo
1a13c8b78e right wordCachesize after orbiters commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 18:09:09 +00:00
allo
6b056610e3 updated watchcrawler for the recent changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 16:33:47 +00:00
orbiter
bcd99fe83e introduced a second RAM cache for DHT transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 10:43:12 +00:00
hydrox
c55c51e2a8 *)added keywords to IndexCleaner_p.java 
*)updated Logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:23:05 +00:00
orbiter
ddbeda738e added minimum age of word in cache to performance menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 11:31:17 +00:00