Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,790 Commits 1 Branch 20 Tags 836 MiB
283a7181c6
Commit Graph

56 Commits

Author SHA1 Message Date
orbiter
ba5fe0b287 fixed (again) nullPointerException in kelondroTree 
see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-15 21:33:10 +00:00
orbiter
0017812b2e bugfix for null compare 
see http://www.yacy-forum.de/viewtopic.php?p=16980#16980

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1644 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-14 22:18:45 +00:00
orbiter
4438a96b87 tried to fix "Object type or Object type combination not supported" bug 
see http://www.yacy-forum.de/viewtopic.php?p=16588#16588

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1592 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-09 22:32:18 +00:00
hermens
56936139ae Fix logging in kelondroTree: 
*) Use java.util.logging.* (via kelondroRecords) without de.anomic.server.logging.serverLog
*) Log "CORRECTING ITERATOR" only in debug mode
   (happens way too often to be a useful warning and is corrected anyway)
*) Log when correctedNodeIterator stumbles on incorrectly ordered data
   (now this one deserves throwing a warning at the user)



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1503 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-31 02:01:32 +00:00
orbiter
03c65742ba changes towards the new index storage scheme: 
- replaced usage of temporary IndexEntity by EntryContainer
- added more attributes to word index
- added exact-string search (using quotes in query)
- disabled writing into WORDS during search; EntryContainers are used instead


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1485 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 00:42:38 +00:00
rramthun
84a00e5673 Use YaCy logging instead of something I don't understand. 
Problem was: YaCy under Linux wrote every CORRECTING ITERATOR message to syslog an your logfiles get VERY big if you run YaCy 24/7. 
Approx. 20MB/day.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1483 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-29 16:04:20 +00:00
orbiter
b9d73f63e7 replaced String object in loop detection by byte[] to omit String-generation 
which could cause locks.
See http://www.yacy-forum.de/viewtopic.php?p=15738#15738

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1425 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 13:12:38 +00:00
orbiter
bb2095fe39 assortment files are now not deleted, but shifted to a backup directory. 
See also: http://www.yacy-forum.de/viewtopic.php?p=15458#15458

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1394 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 01:03:01 +00:00
orbiter
7366e39dd3 tried to fix 100% CPU bug. 
See http://www.yacy-forum.de/viewtopic.php?p=15569#15569

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1393 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 00:50:05 +00:00
orbiter
c51e18c4ad - added signatures to ordering 
- added storage of orderings to database
- orderings can be read from database when opening a database

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1357 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 00:31:27 +00:00
orbiter
38b19ff56a another bugfix to the correctedNodeIterator 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1314 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 15:19:09 +00:00
orbiter
45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717 
(no rotation)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 07:24:03 +00:00
orbiter
c137683a5c added patch to correct tree-iterator 
(symptoms: at the end of the iteration,
more elements are iterated that are not in the
correct order)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1312 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 13:47:16 +00:00
orbiter
2028403670 - consolidated different orderings to kelondroNaturalOrder 
- added another iteration method to rwihash-enumeration


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1309 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 00:32:44 +00:00
orbiter
7c0d7ed4f8 introduction of generic order interface for kelondro 
this is needed for (to be introduced) splitted tree-files

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1283 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 12:35:39 +00:00
orbiter
60fc34d9e8 iterartion bug: 
http://www.yacy-forum.de/viewtopic.php?p=14182#14182


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1235 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-19 00:40:06 +00:00
orbiter
676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1208 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-13 11:58:55 +00:00
orbiter
0c762daf4b better startup failure handling 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1205 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-12 23:59:58 +00:00
orbiter
356231b033 changed only for testing with new hastable implementation. 
Core funktions are unchanged.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1192 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 21:38:34 +00:00
orbiter
1041f4946a experiments with locks to remove synchronization 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1189 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 12:30:55 +00:00
orbiter
288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1188 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 02:18:44 +00:00
orbiter
37f88b4017 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 23:51:29 +00:00
orbiter
ec2b39c1ce code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1175 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 22:30:15 +00:00
orbiter
76618442e0 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1173 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 21:21:14 +00:00
orbiter
3d8a5ae652 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1166 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 14:24:13 +00:00
orbiter
a04930f025 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1158 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-04 23:51:28 +00:00
orbiter
420d56ce79 extended db-testing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1152 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-02 01:51:37 +00:00
orbiter
85282b1d98 enhanced YBR recognition and search result heuristics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1121 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-23 01:40:02 +00:00
theli
c2fe3a1670 *) Updating jMimeMagic Ruleset 
- to detect some special formated html documents correctly
   - adding rule to detect vCards
*) plasmaParser now supports parsing of files that have a supported fileExtension
   but a unsupported mimeType because the webserver has set it incorrectly to text/plain
*) Adding vCard new Parser


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1107 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-20 14:39:58 +00:00
orbiter
24dc0e0760 implemented cr-file processing and further transmission steps 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1099 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-17 01:59:01 +00:00
orbiter
022530df7e small bugfix in kelondroTree 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1097 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-16 22:36:36 +00:00
orbiter
9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1079 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-15 01:20:05 +00:00
orbiter
a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1072 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 00:23:20 +00:00
orbiter
6dc42a2392 detecting of loops in kelondroTree during last/first-Node search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1038 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-06 21:06:55 +00:00
orbiter
4fa942511b de-serialized read and write access 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@989 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-26 23:05:20 +00:00
orbiter
1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@987 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-26 12:37:22 +00:00
orbiter
495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@774 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-22 20:01:26 +00:00
orbiter
979a3ee3c0 exceptions for better testing of bug http://www.yacy-forum.de/viewtopic.php?p=9852#9852 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@769 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-21 22:58:15 +00:00
orbiter
e6b30911c3 small changes to caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@747 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-19 15:13:12 +00:00
orbiter
0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@738 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-16 12:20:59 +00:00
orbiter
19547f1821 changed node manipulation methods in kelondro core to reduce object allocation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@729 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-15 20:45:51 +00:00
orbiter
2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@724 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-09-14 10:10:49 +00:00
theli
b67f008eb8 *) Trying to solve "Too many open files bug" 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@601 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-30 06:45:49 +00:00
orbiter
5716f8521d bug fixes for word ordering and dht index selection 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@521 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-12 14:06:47 +00:00
orbiter
c796a38424 doc update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@515 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-08-11 00:30:43 +00:00
orbiter
ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-07-27 12:51:00 +00:00
orbiter
1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-23 02:07:45 +00:00
orbiter
3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@301 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-19 05:27:42 +00:00
orbiter
3be98f194d tried to find the socket bug 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@300 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-06-18 01:48:11 +00:00
orbiter
650ca3955a added flush-thread for index cache and added language-name mapping in Language_p 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@203 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-05-31 17:39:14 +00:00