Commit Graph

4514 Commits

Author SHA1 Message Date
orbiter
93633abed8 - removed some debugging code from search process - should speed up now
- added some profiling code to search event - more time details in PerformanceSearch_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4594 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-23 00:55:04 +00:00
orbiter
fba46c51d7 fixed non-termination bug in qsort
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4593 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-22 23:15:28 +00:00
orbiter
541b817502 refactoring of switchboard queueing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4591 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-22 01:28:37 +00:00
orbiter
fc94fbe224 another improvement to the collection sorting
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4589 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-20 23:11:04 +00:00
orbiter
11270d450e better quicksort-pivot computation: 30% faster (measured with test program)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4588 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-20 22:01:12 +00:00
orbiter
3e44293f07 - fixed a problem with thread pools in row collection
- added a line-viewing feature in threaddump	

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4587 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-20 14:21:58 +00:00
danielr
e43051b125 - fixed Threaddump output (html-escaped ie. <init>)
- in EcoFS converted comments to javadoc


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4586 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-20 10:20:55 +00:00
orbiter
433ff855f7 - fixed another concurrency problem in collection sorting
- fixed a typing problem that was introduced in svn 4579 and caused the crawl monitor to fail

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4585 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-19 23:47:24 +00:00
orbiter
19286fa2d1 tried to fix seed2.old.db-problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4584 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-19 22:35:19 +00:00
apfelmaennchen
5fde618337 changed display of y-marks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4583 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-19 19:54:35 +00:00
orbiter
f3996e63b8 tried to fix more deadlocks:
- changed connection modes in ftpc
- replaced sort tread pool in row collections by new one using util.concurrent. the old pool had caused blockings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4582 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-19 11:23:43 +00:00
daburna
26155cbb5e update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4581 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-18 17:53:54 +00:00
daburna
1618bd5505 added submenu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4580 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 14:51:04 +00:00
danielr
7008a218b3 avoid ConcurrentModificationException in plasmaCrawlerQueues
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4579 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 13:51:56 +00:00
danielr
9d0af17c5b removed debug from startYACY.sh *ups*
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4578 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 13:02:39 +00:00
danielr
bf3e5807b0 fixed typo and remove redundant code from startYACY.sh
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4577 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 12:51:46 +00:00
lulabad
ea59dbf4c2 fixed build problem see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=956&hilit=
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4576 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 06:53:20 +00:00
orbiter
7150b463ff changed handling of default values and database paths:
- the default files yacy.init and for the network definition is now moved to the path defaults
- the httpProxy.conf is renamed to yacy.conf
- the DATA/INDEX/PUBLIC is renamed to the actual network nickname, which should be freeworld or sciencenet
more menu entries
- added apfelmaennchens alternative search page to the menu
- added the new thread dump page to the server log menu point as submenu
modifications
- modified the thread dump page: sorting by thread type

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4575 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 22:31:54 +00:00
apfelmaennchen
54cb097ea4 added .trigger("update") after paging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4574 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 22:05:50 +00:00
apfelmaennchen
82f17ccee2 just an example sidebar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4573 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 21:44:51 +00:00
apfelmaennchen
3c710f22cd added server side driven pagination for search tabs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4572 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 21:44:20 +00:00
lulabad
25f5035f23 typo
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4571 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 15:13:12 +00:00
orbiter
7fd094fcbe small bug in ftpc: did cot compile in Java 1.5
Please set compiler to Java 1.5-compliance

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4570 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 13:41:49 +00:00
lulabad
0a593a4e4a small changes to Threaddump Servlet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4569 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 13:15:23 +00:00
lulabad
995b5a2b27 added Threaddump Servlet, see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=862
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4568 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 09:03:52 +00:00
danielr
f51bad8ae5 FTP:
- report connection status (to break if no connection possible)
- fixed isFolder()
- additional error output
- fixed paths with encoded symbols (ie. a%20file.txt)
- refactoring


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4567 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 21:57:55 +00:00
danielr
820641938e ftpc: fixed date parsing, some refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4566 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 10:56:47 +00:00
orbiter
4c584dff87 disabled soLinger to prevent that too many connections stay open (it's a TEST!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4565 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 10:46:55 +00:00
lulabad
d1b9f50b94 added "delete Release" to Update Page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4564 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 10:37:20 +00:00
lulabad
3d122c125c added "current installed release" to Update Page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4563 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 09:22:07 +00:00
orbiter
9c989fe5f7 fixed deadlock
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4562 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-15 00:49:16 +00:00
danielr
c565906050 FTP:
- added maxFileSize-check
- added timeout for download
- fixed dirlist (when all filenames have spaces, change to absolute links)
- enhanced isFolder()
- make sure data connection is closed, so a new can be opened
- refactoring


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4561 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 16:28:27 +00:00
apfelmaennchen
368b8735b5 added 'close tab' function
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4560 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 15:59:56 +00:00
danielr
1a7870df0d FTP: source cleanup (added finals, indention for easier diffs)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4559 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 12:35:53 +00:00
orbiter
fa1090113d - next try to fix the networking problem:
set the maximum transfer size to less than MTU=1500-52: buffer size <= 1448
- some refactoring of transfer methods (naming)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4558 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 00:16:04 +00:00
apfelmaennchen
f63bd26268 fixed search performance / dynamic display of results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4557 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 21:24:53 +00:00
orbiter
d87d295c68 one more try to fix the connection problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4556 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 13:13:11 +00:00
orbiter
a3dadcd89b preventing that peer which return a false search result are disconnected
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4555 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 00:56:18 +00:00
orbiter
ba622bb240 addendum to svn 4553
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4554 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 00:24:20 +00:00
orbiter
5530b8e1ca reverted changes to yacy protocol classes: they caused the sciencenet to loose connections
a comparisment with the main release 0.57 had been made: this showed a stable network
This is an emergency operation to ensure availability of the sciencenet network.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4553 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 00:05:18 +00:00
orbiter
b664a53553 fix for NPE during search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4552 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-11 15:30:26 +00:00
orbiter
b3d4571a5d fix for bad opensearch file format
did you know that yacy has a built-in rss feed reader? try:
http://localhost:8080/FeedReader_p.html?url=http://www.tagesthemen.de/xml/rss2
it can be used to fetch search results from other yacy peers:
http://localhost:8080/FeedReader_p.html?url=http://sciencenet.fzk.de:8080/yacysearch.rss?search=yacy

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4551 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-11 12:45:27 +00:00
orbiter
b4ed937f1e - modified zone navigation (does still not work correctly)
- added dht switch in network definition
- 0.574

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4550 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-11 11:09:38 +00:00
orbiter
8d0470a5c6 new method to compute search history IDs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4549 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:40:56 +00:00
orbiter
65785da8f2 new method for best hash computation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4548 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:28:05 +00:00
apfelmaennchen
c75fa90206 adjusted display of search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:23:04 +00:00
apfelmaennchen
7a902424af adjusted display of search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:22:34 +00:00
orbiter
e0c481decb not class file in SVN .. I guess it is a mistake
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4545 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 19:05:06 +00:00
lulabad
8c15fbf7d1 simple and fast fix for LogStatistics_p
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4544 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 18:52:01 +00:00
orbiter
9eddc1506b - one try to fix the httpd problem
- fix for handling of collection index that appears when removing elements
- added another navigation method (stub, not working yet)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4543 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 23:58:22 +00:00