Commit Graph

1101 Commits

Author SHA1 Message Date
theli
a354bc2ec1 *) Bugfix for content length check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1666 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:54:47 +00:00
theli
8ffc6e35ad *) correcting logging output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1665 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:28:54 +00:00
hermens
e974d0cb99 Improve compliance to rfc
*) There is no status line in HTTP/0.9
*) Answers to HEAD requests should return the same headers as a GET request



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1664 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:27:21 +00:00
theli
556d242be0 *) Limited support of content-range requests
- a simple continue download request should work now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 09:23:27 +00:00
theli
8fcb25f9f9 *) Setting via header according to rfc
- can be disabled via settings dialog

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 09:20:57 +00:00
theli
980e986b64 *) Re enabling short cycle for already removed nurl entries
See: http://www.yacy-forum.de/viewtopic.php?p=17147#17147 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1660 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 06:59:34 +00:00
orbiter
218cd6561c fixed problem with wrong hash length in file share
see: http://www.yacy-forum.de/viewtopic.php?p=16565#16565

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1658 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 22:12:53 +00:00
orbiter
56516fd8e6 added refresh parser to htmlFilterContentScraper
* getRefreshSeconds() - number of seconds until refresh
* getRefreshPath() - url path
See also: http://www.yacy-forum.de/viewtopic.php?p=16851#16851

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1657 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 21:55:15 +00:00
orbiter
ba5fe0b287 fixed (again) nullPointerException in kelondroTree
see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 21:33:10 +00:00
allo
e6c2f700b1 public Tagview
IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 14:35:30 +00:00
allo
672b384fc7 refactoring setTagsTable and setBookmarksTable.
preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 13:16:10 +00:00
theli
040624e361 *) better support for http head requests of servlets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1648 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 12:51:24 +00:00
theli
62ffb5ece0 *) httpdFileHandler.java: adding real streaming support for lage files
- avoid to read the whole file into memory
   - support of chunked transfer-encoding for http/1.1 clients
   - support of gzip content-encoding suitable clients
   See: http://www.yacy-forum.de/viewtopic.php?p=17058#17058
*) MessageSend_p.html: better highlighting of peer response/status messages

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1646 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 12:31:52 +00:00
hermens
3b6328ad02 *) Consistent use of minCount for index transfer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1645 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 22:50:13 +00:00
orbiter
0017812b2e bugfix for null compare
see http://www.yacy-forum.de/viewtopic.php?p=16980#16980

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1644 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 22:18:45 +00:00
allo
b137c90015 BugFix for too long Usernames.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1642 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 20:19:40 +00:00
allo
9d6bae77ee the best PPM ever! ;-p
Now stopped indexingstop is recognized as 0 PPM.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1641 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 17:29:46 +00:00
hermens
0b60b9bf51 *) Remove entries from AssortmentCluster before reinserting the rest into the ramCache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1640 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 13:06:32 +00:00
hydrox
8ab1d6ff4b *) fixed NullPointerException in plasmaWordIndexEntity
See: http://www.yacy-forum.de/viewtopic.php?t=1921

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1638 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 11:40:36 +00:00
allo
a26574c894 Migration from tagName as key to wordhash(tagName) as key for bookmarkTags.db
(just deleting the old db, rebuildTags does the rest)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1637 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 10:00:12 +00:00
theli
eeba8b055e *) guessing, testing and suggesting alternative hostnames on "unknown host" error
See: http://www.yacy-forum.de/viewtopic.php?t=1879

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1636 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 09:55:09 +00:00
orbiter
7eb10675b3 re-organization of index management
this was done to be prepared for new storage algorithms


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1635 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-14 00:12:07 +00:00
allo
a8a5ad959a using TAG_NAME for getFriendlyName() and the lowercaseversion for getTagName()
Removed TAG_FRIENDLY_NAME

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1634 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-13 21:27:50 +00:00
allo
73f18ed5b2 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542 2006-02-13 14:42:19 +00:00
allo
bc6d400b03 bookmarktags with wordhashs.
to Come: Migration
please test this...1) backup bookmarks.db 2) delete bookmarksTags 3) test it...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1626 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-13 08:38:32 +00:00
allo
addc802cf3 workaround for kelondro Umlaut-Problem.
his will only fix öäüÖÄÜß ...just do not use other special chars ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1621 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-12 15:18:46 +00:00
allo
fb5c387368 XML import works.
Please backup your bookmarks.db before trying it, i had many kelondro errors while importing del.icio.us xml-Files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1620 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-12 14:51:04 +00:00
allo
a4513523d6 hide add/edit/import bookmarks per default.
xml-bookmark import (this does not work, yet)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1619 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-12 14:03:56 +00:00
orbiter
1e4578aab6 VERY EXPERIMENTAL removal of index ram cache flushing thread.
The cache will fill up and flushed explicitely when it is full.
This shall remove double-access of assortments (indexing and flush)
during indexing process. Hopefully this should reduce IO.
The main idea is: the cache shall mainly be flushed by DHT transfer, and
only indexes that shall be hosted by the own peer are flushed to the
assortments. This needs further work.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1617 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-11 23:19:01 +00:00
theli
44996afd79 *) Bugfix for handling of http/0.9 clients.
- nothing was send as response

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1610 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-11 15:21:04 +00:00
orbiter
01c668fe1b experimental disabling of db write buffer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1605 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-11 11:31:44 +00:00
hermens
954f02d22e *) Bugfix: Prevent wordIndex.getContainer() from returning and even manipulating
the containers from the ram cache. Return a new container instead.
*) Speedup flushFromMem by reducing the number of searches in the TreeMap



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1604 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-11 03:15:14 +00:00
orbiter
4438a96b87 tried to fix "Object type or Object type combination not supported" bug
see http://www.yacy-forum.de/viewtopic.php?p=16588#16588

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1592 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-09 22:32:18 +00:00
orbiter
c70befbe9c added xml read/write example file: kelondroXMLTables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1591 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-09 22:16:46 +00:00
allo
27b6b3d714 public Tags.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1589 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-09 20:08:45 +00:00
hydrox
a627162f13 *)fixed logginglevel for Debugmsg
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1585 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-09 09:10:49 +00:00
orbiter
fe39493145 changed default ranking parameters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1582 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-09 00:23:54 +00:00
allo
5ef57211a6 trim was just too easy...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1579 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-08 18:48:38 +00:00
allo
38e79aec94 Fix for wrong(?) httpheader:
" pragma: no-cache" (IIS specific?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1578 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-08 18:06:26 +00:00
allo
a8eff9a0ae xml/bookmarks/posts/all.xml to list all public Bookmarks
bookmarksIterator now accepts an option, if you want all(with private) or only public bookmarks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1577 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-08 17:13:27 +00:00
allo
d04e7d724e fix for deleting tags.
string2vector should return an empty vector on ""

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1576 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-08 16:37:05 +00:00
orbiter
365a3fff8e fixings for ranking attributes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1569 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-07 23:16:46 +00:00
orbiter
785763d070 added debug output for "Object type or Object type combination not supported" bug.
See also: http://www.yacy-forum.de/viewtopic.php?p=16306#16306

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1568 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-07 22:48:22 +00:00
theli
2a88232cee *) Bugfix for httpd security but
- authentication was only required for html files.
   See: http://www.yacy-forum.de/viewtopic.php?p=16510

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1563 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-07 06:54:23 +00:00
orbiter
8e55098b74 fixed detailed search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1562 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-06 23:13:54 +00:00
theli
ebc5b1eafb *) adding a servlet that can be used to generate a Firefox search-plugin for yacy.logging
- You can access this servlet via YaCySearchPluginFF.html
   - The generated search plugin has the name YaCySearchPluginFF.src

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1555 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-06 14:41:59 +00:00
orbiter
0cb940a8e5 added detailed search.
ranking profiles do not work properly yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1551 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 23:38:00 +00:00
orbiter
c695928f7c adopted search page to new detailed search (to be commited later)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1550 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 22:51:37 +00:00
orbiter
45323e7b76 fixed null pointer exception during search
see http://www.yacy-forum.de/viewtopic.php?p=16429#16429


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 14:59:30 +00:00
allo
1fce0ea263 xml api for deleting bookmarks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 14:54:07 +00:00
allo
6b16c13b20 showing the public/privat flag.
TODO: Some nice icons.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1545 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 14:03:33 +00:00
rramthun
49647583b2 language update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1544 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 13:55:18 +00:00
allo
670356fa4e code cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1543 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 13:27:04 +00:00
orbiter
fb7411d7bb re-structuring of ranking application:
concentration of all ranking attributes in the
plasmaSearchRankingProfile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1541 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 01:47:51 +00:00
hermens
5f5eee1ae9 *) replace System.out.println with log
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1540 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-05 01:17:08 +00:00
orbiter
d98418390b - introduced rankingProfile Class
- selection of ranking and timing profiles for each search


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1539 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 23:51:00 +00:00
orbiter
eab1805bca refactoring: plasmaSearchProfile -> plasmaSearchTimingProfile
This was made to distiguish this profile from the
(to-be-implemented) plasmaSeachOrderProfile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1538 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 23:11:31 +00:00
orbiter
6eef848954 re-design of post-ranking process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1537 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 23:00:31 +00:00
allo
af2127f3ad allow multiple #File: Sektions for one File in translations.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1534 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 18:08:01 +00:00
allo
1bb768178f simple check for unused Translations.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1533 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 17:49:10 +00:00
orbiter
be77fe1a88 code clean-up
@Martin: bitte schaue mal warum die Variablenzuweisung
         in plasmaCrawlNURLImporter war. So wie sie waren, waren sie überflüssig.
         Das hattest du dir bestimmt nicht so gedacht.
         Sollten es ggf. globale Variablen sein?

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1529 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 15:25:48 +00:00
orbiter
0bc2aaeb42 added normalization to search attributes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1528 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 14:13:54 +00:00
allo
7bd61ab0e5 Locales will now be in DATA/HTDOCS. So it works with readonly htroot.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1527 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-04 10:50:22 +00:00
theli
008bcb7fb8 *) simplifying code by moving closeTransferIndexes into final block
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1522 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-03 13:14:30 +00:00
theli
50d85657b8 *) new import function for IndexImport_p.html
- can be used to import the crawling queue (noticeUrlDB + stacks)
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1518 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-02 16:46:58 +00:00
theli
214302284e *) undoing last commit because of problems with getUpdateTime
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1514 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-02 10:05:16 +00:00
theli
408de3beee *) avoiding to search in the treemap two times for the same key
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1513 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-02 10:03:47 +00:00
borg-0300
139ba4e0c8 Bugfix for getCachePath(URL url)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1510 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-01 19:07:49 +00:00
theli
442807cb29 *) Bugfix for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1506 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 15:26:11 +00:00
theli
22fd1ca9aa *) minor changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1505 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 12:39:10 +00:00
theli
6a99304b2b *) Redesign of db import functionality
- restructuring to allow different import tasks to be controlled via one gui 
   - adding possibility to import a single assortment file
   - adding possibility to set the cache size that should be used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1504 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 12:30:24 +00:00
hermens
56936139ae Fix logging in kelondroTree:
*) Use java.util.logging.* (via kelondroRecords) without de.anomic.server.logging.serverLog
*) Log "CORRECTING ITERATOR" only in debug mode
   (happens way too often to be a useful warning and is corrected anyway)
*) Log when correctedNodeIterator stumbles on incorrectly ordered data
   (now this one deserves throwing a warning at the user)



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1503 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 02:01:32 +00:00
orbiter
3834675084 fixed bug that caused wrong behavior of search result preparation
(second search on same topic resulted in less links)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1502 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 01:20:28 +00:00
hermens
31c8476b5d plasmaWordIndexCache.getContainer:
*) Also get entries from cache
*) calculate available remaining time for backend.getContainer correctly



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1501 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 01:04:23 +00:00
hermens
bb1664b63e *) Remove workaround from SVN 1472: It is not needed anymore
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1500 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-31 00:45:48 +00:00
orbiter
ec5d88664a tried too fix serverSwitch synchronization problems
see also: http://www.yacy-forum.de/viewtopic.php?p=16110#16110

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1499 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 23:07:20 +00:00
orbiter
3419b3bcdd fix for bug that caused the peer-counter problem.
See http://www.yacy-forum.de/viewtopic.php?p=16016#16016
The kelondroDyn now uses a generic fill character.
kelondroDyn-Tables containing peer/word/url-hashes must not use '_'
as fill character.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1498 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 22:16:55 +00:00
allo
9bc62bfdac typo
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1497 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 20:57:11 +00:00
allo
cdc595ab67 another ppm fix. no more unknown ppm
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1496 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 20:42:02 +00:00
hermens
4f43816ec0 *) Fix wrong class cast in indexSize()
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1495 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 17:09:07 +00:00
orbiter
a7f0adf6fa bugfix in entity iterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1490 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 12:50:40 +00:00
orbiter
fa90c3ca7a - removed some usage of indexEntity
- changed index collection process: indexes are not first flushed to indexEntity,
  but now collected directly from ram cache and assortments

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1489 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 12:42:06 +00:00
orbiter
aea3e00864 cleanup: removed unused temporary index management in indexEntity.
This is replaced by indexContainers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1486 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 01:18:25 +00:00
orbiter
03c65742ba changes towards the new index storage scheme:
- replaced usage of temporary IndexEntity by EntryContainer
- added more attributes to word index
- added exact-string search (using quotes in query)
- disabled writing into WORDS during search; EntryContainers are used instead


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1485 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-30 00:42:38 +00:00
rramthun
84a00e5673 Use YaCy logging instead of something I don't understand.
Problem was: YaCy under Linux wrote every CORRECTING ITERATOR message to syslog an your logfiles get VERY big if you run YaCy 24/7. 
Approx. 20MB/day.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1483 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-29 16:04:20 +00:00
theli
ab7a911bb3 *) Trying to solve pool not open problem
See: http://www.yacy-forum.de/viewtopic.php?t=1798

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1482 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-29 08:54:19 +00:00
allo
a6245a302f even better ppm ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1481 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 19:22:30 +00:00
hydrox
d665f3c39c *) fixed Threadnames for stackCrawl-Threads
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1480 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 19:06:21 +00:00
theli
3d5347bc8e *) changing loglevel for some messages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1479 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 17:40:24 +00:00
theli
0fcd113c42 *) last bugfix part. Seems to work now for the stackCrawler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1478 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 17:25:19 +00:00
theli
b9c9eaeb44 *) next try todo a bugfix :-((
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1477 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 17:05:47 +00:00
theli
4b4b93c413 *) next try todo a bugfix :-(
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1476 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 16:55:05 +00:00
theli
d9fbad71b9 *) next try todo a bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1475 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 16:38:25 +00:00
theli
6da97bd2e4 *) next bugfix for threadpool problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1474 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 16:31:40 +00:00
theli
bea2b9edee *) further redesign of threadpools to solve too many thread problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1473 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 16:18:07 +00:00
hermens
2d1283da34 This is an extremely ugly workaround for an incompatibility between yacySeed hashes and kelondroDyn keys
See: http://www.yacy-forum.de/viewtopic.php?p=15955#15955



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1472 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 15:26:56 +00:00
theli
784fd50437 *) more verbose thread names
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1471 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 15:26:47 +00:00
theli
56e4dbeb71 *) displaying current active + current idle threads in PerformanceQueues_p.html now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1470 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-28 15:17:04 +00:00
theli
859c6a88f5 *) testing various thread pool eviction settings to avoid outOfMemory - Thread creation problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1467 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-27 16:51:29 +00:00
allo
7197f171d3 better ppm calculation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1464 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-01-27 11:51:27 +00:00