Commit Graph

3377 Commits

Author SHA1 Message Date
orbiter
7a7a1c7c29 fight against problems with remove-methods and synchronization
- some bugs may have been fixed with wrong removal operations
- removed temporary storage of remove-positions and replaced by direct deletions
- changed synchronization
- added many assets
- modified dbtest to also test remove during threaded stresstest

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3576 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-17 15:15:47 +00:00
orbiter
b6a5f53020 removed double synchronization from kelondroRecords.USAGE to prevent thread locking.
The method synchronization should be sufficient

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3574 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-15 21:13:54 +00:00
(no author)
6186185775 *) Moved some comments to javadoc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3573 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-14 10:11:37 +00:00
michitux
56b30d6593 * fixed a bug in ie: class-names for image-snippets were set, but had no influence on ie, they have to be set with className =
* fixed a bug in safari (hopefully, sorry that I removed the old fix, the divs): yacy-logo is now above the fieldset, the fieldset clears and has a margin-left set
 * fixed a bug with the dls: for example in ViewProfile.html the dt's (the terms/keys) had not the same height as the dd's, so the dt's were not in the same row with the coresponding dd's towards the bottom
 * moved my new css-classes to the right place in base.css

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3572 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 23:14:12 +00:00
michitux
e917bfcae3 * Bugfix: changed handling of the query-string to be independent from input-elements
* removed unnecessary divs

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3571 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 18:01:02 +00:00
orbiter
063063aa0c fix for 100% cpu bug during dht selection
see also: http://www.yacy-forum.de/viewtopic.php?p=34068#34068

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3570 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 13:40:19 +00:00
auron_x
f15fa7c5b1 *) also visited menulinks hover correctly now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3569 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 10:03:57 +00:00
orbiter
f88aea4869 reverted another bad idea
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3568 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 21:28:31 +00:00
orbiter
58c7cd7885 reverted svn 3563
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3567 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 21:24:56 +00:00
michitux
4990909178 Some bugfixes, new layout/style for image search results:
* removed divide by zero bug when 20_dhtdistribution_busysleep is 0
 * replaced German comment with wrong charset in source/de/anomic/plasma/plasmaCrawlBalancer.java by an English one
 * replaced the table-fix for floating behind snipped images by a br with clear
 * removed unnecessary old xhtml-files (were not in use, they were created when we weren't having xhtml for testing)
 * new layout for image-search results: replaced the old one with spans and tables inside (not valid) with new divs, now each image snippet container has the same size
TODO:
 * the ids of the snippetLoading-divs aren't valid because ids must start with an alphabetic letter or an underscore, they have to be prefixed
 * in the returned snippet-xml is an unresolved pattern for status (the status is only set for text snippets)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3566 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 18:21:17 +00:00
orbiter
2e052eb816 fixed a bug in remote search with remote search tracker
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3565 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 13:49:50 +00:00
orbiter
fb6b21bb6c force opening of found pages on same page, not same frame
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3564 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 12:45:42 +00:00
orbiter
87fcefe1d9 white background color is default to support the kaskelix portal style
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3563 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 10:22:48 +00:00
orbiter
78d04bcbcf fixed bug in search statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3562 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 09:24:56 +00:00
orbiter
45f4489f4b bugfix for broken media search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3561 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 08:58:19 +00:00
orbiter
3e5cd34229 update to search display options for kaskelix embedding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3560 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 07:31:26 +00:00
orbiter
a922d9444d fixed search page (there had been some unresolved patterns)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3559 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-11 14:46:54 +00:00
orbiter
d59b31ec0c better display of embedded search results (no more comment on global search, if local was choosen on purpose)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3558 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 14:37:34 +00:00
orbiter
4eecf0bb12 templates for embedded display. try:
http://localhost:8080/yacysearch.html?display=2&input=0&search=yacy&resource=local

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3557 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 14:28:04 +00:00
orbiter
b79b4082e2 completed search exclusion:
- exclusion on index-level (not only from search snippets)
- exclusion hand-over at remote search protocol

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3556 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 12:27:03 +00:00
allo
991c62387a just ignore wrong ports
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3555 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-09 22:05:07 +00:00
auron_x
d66b0276e3 *) removed log-output for PPM-calc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3553 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-07 10:03:12 +00:00
low012
4400acc27d *) created new 8 bit oldschool style font for possible future use
*) main method is generalization of main method of ymageFontGenerator:
   it does not matter how many lines of how many bits a font is made of
   as long as the values stay the same within the font -> use this class as 
   a template for your own font generators and be a happy camper
*) main method checks if font is valid (96 characters, all letters must have
   same number of lines and same number of bits per line)
*) ***** I have not checked if the result is really a valid font so far. *****


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3552 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 21:05:16 +00:00
orbiter
25070822a5 fix for http://www.yacy-forum.de/viewtopic.php?p=33925#33925
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3551 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 19:08:59 +00:00
orbiter
06a7978730 moved url pattern matching for search to better place
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3550 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 15:08:14 +00:00
orbiter
159bd0cab5 diverses; b.o. fix for http://www.yacy-forum.de/viewtopic.php?p=33914#33914
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3549 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 14:58:29 +00:00
orbiter
cdc7b77a62 fix for http://www.yacy-forum.de/viewtopic.php?p=33916#33916
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3548 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 14:47:45 +00:00
orbiter
40c14a4f0e - better implementation of search query properties
- basic protection against start-up problems when database files are corrupted
- auto-delete of not-critical databases during startup when load error occurs
- on-the-fly reset option for all database tables
- automatic on-the-fly reset for seed tables during enumeration exceptions

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 10:14:48 +00:00
theli
0c8ff6729f *) adding function to delete single entries from the Global-Crawl-Trigger Queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 04:37:40 +00:00
theli
1696606b7f *) changing loglevel of "PPM-Calculation" message
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3545 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-04 13:09:59 +00:00
auron_x
f30bf1683e *) corrected spelling of captcha
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3544 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-04 10:13:58 +00:00
orbiter
fcdf000fbc bugfix for http://www.yacy-forum.de/viewtopic.php?p=33838#33838
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3543 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 22:08:40 +00:00
low012
d7edc9740b *) added correct (c) and Last*-data
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3542 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 20:58:45 +00:00
low012
ee241f32e6 *) very basic capcha class (see coding sections of forum for more details)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3541 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 20:54:14 +00:00
orbiter
6e7340ef52 added exclusion search
(you can now search and exclude words from the result with '-')

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3540 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 15:35:29 +00:00
orbiter
e4734a8b6b fix for fix in SVN 3537
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3539 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 14:42:29 +00:00
orbiter
c1dd6a674a erased stopwords. We need a different solution here.
Stopwords must consider experiences from our new common words and it must
distinguish different languages.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3538 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 12:43:40 +00:00
orbiter
356033aceb fixed bug with continuous reset of balancer file index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3537 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 12:36:24 +00:00
orbiter
ba2c307ab3 optimized memory allocation in kelondroRow.Entry
such an entry cannot be instantiated without allocation of new byte[]; instead
it can re-use memory from other kelondroRow.Entry objects.
during bugfixing also other bugs may have been solved, maybe the INCONSISTENCY problem
could have been solved. One cause can be missing synchronization during bulk storage
when a R/W-path optimization is done. To test this case, the optimization is currently
switched off.
More memory enhancements can be done after this initial change to the allocation scheme.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3536 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 12:10:12 +00:00
theli
24ea4ca631 *) adding first version of postscript parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3535 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-01 15:02:07 +00:00
theli
def0d6124e *) trying to solve SecurityManager problem during init of soap engine
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3534 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-31 16:01:52 +00:00
theli
75eb65028a *) adding a test if a seucrity manager is active
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3533 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-31 14:30:09 +00:00
orbiter
210ede8230 added a class for byte-array management. This was the result of a very large experiment
to replace byte[] objects within kelondro. Frequent System.arraycopy are common when
kelondroRow.Entry objects are handled. This class may be used to prevent this.
However, experimental replacement of byte[] by kelondroByteArray in kelondroRow.Entry
resulted in complete re-write of large parts of kelondro. This experiment did not
completely lead to a result, because then the interface to kelondro had to be changed
also from byte[] to kelondroByteArray, which may have caused a rewrite of large parts
of YaCy. The experiment is therefore abanonded, but this class remains here without
any function but possibly for future use.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3531 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-30 08:44:43 +00:00
low012
bc37ac64b3 *) Fix for last commit.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3530 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-28 22:37:01 +00:00
low012
f603b58f6c *) No stacktrace anymore if invalid regex is entered for URL mask or Prefer mask, insted an error message gets displayed.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3529 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-28 22:18:54 +00:00
theli
1b7fda12ee *) SOAP: separate function to get the active/passive/potential peer list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3526 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-28 07:34:44 +00:00
orbiter
6488ec8a80 no deletions in index in case that snippet-loading fails and there is no network connection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3525 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-27 08:21:45 +00:00
orbiter
847349358b less memory usage during collectionIndex-rebuild
should also speed up that process a little bit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3524 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-27 08:21:03 +00:00
auron_x
8ef3ad12a7 *) fix for rare bug in PPM-calc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3523 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-25 21:46:03 +00:00
auron_x
00bc0c1b47 *) new logging for PPM-Calculation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3522 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-25 20:24:12 +00:00