Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,948 Commits 1 Branch 20 Tags 836 MiB
f9c953481a
Commit Graph

783 Commits

Author SHA1 Message Date
allo
5a809f21c6 default tag on quickadd 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1573 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-08 13:54:52 +00:00
orbiter
aa01c78722 - added bookmarks to main menu 
- added '+' to search results; this can be used to add search results to bookmarks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1567 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-07 22:40:54 +00:00
rramthun
45a61c3da8 Fixed bug in Opera and IE, which caused the YaCy headline to be cut off. 
Fixed bug in Opera and IE, which caused the search options to be centered and by this looked ugly.

Thanks to Philipp Redeker.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1565 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-07 12:00:20 +00:00
orbiter
8e55098b74 fixed detailed search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1562 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-06 23:13:54 +00:00
allo
62a0bb475a More values displayed on WatchCrawler.html 
status_p.xml: to be extended.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1561 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-06 19:47:59 +00:00
allo
2f188d3fa8 more stable layout and String Constant (for translation) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1560 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-06 17:01:39 +00:00
allo
fd7af851bf WatchCrawler is working NOW! 
Thx to theli.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1557 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-06 15:12:03 +00:00
theli
ebc5b1eafb *) adding a servlet that can be used to generate a Firefox search-plugin for yacy.logging 
- You can access this servlet via YaCySearchPluginFF.html
   - The generated search plugin has the name YaCySearchPluginFF.src

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1555 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-06 14:41:59 +00:00
orbiter
0cb940a8e5 added detailed search. 
ranking profiles do not work properly yet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1551 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 23:38:00 +00:00
orbiter
c695928f7c adopted search page to new detailed search (to be commited later) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1550 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 22:51:37 +00:00
orbiter
454c138e19 switched back to previous behavior of the search page, 
keeping the new link presentation design.
The websearch.html used the wrong search page (yacy/search.java) which caused further problems.
Please keep this page unless the new detailed search page is in place,
then shrink options of this page to create a more simple search interface.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1549 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 15:51:53 +00:00
orbiter
8600f6a788 fix for empty strings during search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1548 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 15:38:31 +00:00
allo
1fce0ea263 xml api for deleting bookmarks. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1546 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 14:54:07 +00:00
allo
6b16c13b20 showing the public/privat flag. 
TODO: Some nice icons.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1545 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 14:03:33 +00:00
orbiter
fb7411d7bb re-structuring of ranking application: 
concentration of all ranking attributes in the
plasmaSearchRankingProfile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1541 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-05 01:47:51 +00:00
orbiter
d98418390b - introduced rankingProfile Class 
- selection of ranking and timing profiles for each search


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1539 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 23:51:00 +00:00
orbiter
eab1805bca refactoring: plasmaSearchProfile -> plasmaSearchTimingProfile 
This was made to distiguish this profile from the
(to-be-implemented) plasmaSeachOrderProfile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1538 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 23:11:31 +00:00
rramthun
4bb7397b53 Updated startYACY.sh: 
now it checks if java is executable and provides errormessage if it is not.

To-Do:
Perhaps could someone implement an -c (Cron) and -help option.
Places where you could find PATH are in the comments.
I will add text for -help if someone provides the code.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1530 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 15:56:21 +00:00
orbiter
be77fe1a88 code clean-up 
@Martin: bitte schaue mal warum die Variablenzuweisung
         in plasmaCrawlNURLImporter war. So wie sie waren, waren sie überflüssig.
         Das hattest du dir bestimmt nicht so gedacht.
         Sollten es ggf. globale Variablen sein?

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1529 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 15:25:48 +00:00
allo
7bd61ab0e5 Locales will now be in DATA/HTDOCS. So it works with readonly htroot. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1527 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-04 10:50:22 +00:00
allo
1f3eaf9f8e use DATA/HTDOCS for notifier.gif. Works even if htroot is readonly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1526 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-03 21:21:42 +00:00
theli
01ef85316d *) new search gui by roland 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1525 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-03 16:26:59 +00:00
rramthun
58ca4c777d Updated language file. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1523 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-03 15:36:07 +00:00
theli
50d85657b8 *) new import function for IndexImport_p.html 
- can be used to import the crawling queue (noticeUrlDB + stacks)
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1518 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-02 16:46:58 +00:00
rramthun
5b85d92690 hendis patch from http://www.yacy-forum.de/viewtopic.php?p=16212#16212 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1511 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-01 21:05:25 +00:00
rramthun
9ce44c8d0a Some minor enhancements to the webinterface and updated translation. 
de.lng mainly updated by Jan.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1509 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-02-01 17:29:14 +00:00
theli
442807cb29 *) Bugfix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1506 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-31 15:26:11 +00:00
theli
6a99304b2b *) Redesign of db import functionality 
- restructuring to allow different import tasks to be controlled via one gui 
   - adding possibility to import a single assortment file
   - adding possibility to set the cache size that should be used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1504 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-31 12:30:24 +00:00
theli
48e302252e *) adding possibility to build a distribution containing an exe file for windows users 
see: build file target "distWinExe"

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1494 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 16:16:37 +00:00
orbiter
fa90c3ca7a - removed some usage of indexEntity 
- changed index collection process: indexes are not first flushed to indexEntity,
  but now collected directly from ram cache and assortments

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1489 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 12:42:06 +00:00
orbiter
03c65742ba changes towards the new index storage scheme: 
- replaced usage of temporary IndexEntity by EntryContainer
- added more attributes to word index
- added exact-string search (using quotes in query)
- disabled writing into WORDS during search; EntryContainers are used instead


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1485 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-30 00:42:38 +00:00
rramthun
c81ad1bf34 Many modifications to the webinterface. 
Look at it and if the majority says it is not as good as before we undo the changes (especially the search page is very unfamiliar).

Thanks to Philipp Redeker.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1484 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-29 16:17:15 +00:00
theli
56e4dbeb71 *) displaying current active + current idle threads in PerformanceQueues_p.html now 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1470 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-28 15:17:04 +00:00
theli
6d73c6b481 *) adding xml version for QuickCrawlLink_p.java (used by yacybar) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1465 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-27 15:36:42 +00:00
orbiter
b946e28e61 some ranking enhancements 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1460 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-27 02:48:27 +00:00
allo
0f84591d57 better defaulttime (the yacybar uses it) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1459 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-26 21:28:28 +00:00
theli
3feeba3d7b *) better handling of urls containing query parameters 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1445 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-26 09:34:50 +00:00
low012
d0043b027c *) Fixed a bug where page name was not displayed in URL. (see http://www.yacy-forum.de/viewtopic.php?t=1778) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1436 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 19:26:45 +00:00
allo
e575e57918 removed HTML from .java 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1431 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 15:32:19 +00:00
borg-0300
5756b9d5c8 blacklist entries now checked 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1426 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-24 13:28:50 +00:00
allo
da50e90615 " was missing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1409 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 20:02:22 +00:00
allo
31985fb38a simple Bugfix for Messages_p 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1408 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 19:50:57 +00:00
borg-0300
0fcc07d3f7 "unresolved URL Hash" entries now checked 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1404 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 15:44:46 +00:00
borg-0300
d5a86e2287 added keywords, properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1402 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 14:35:51 +00:00
theli
319f8ffb18 *) changing file header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1400 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 14:17:24 +00:00
theli
ed5ac0f81a *) adding servlet that is needed by the yacy screensaver 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1399 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 14:06:43 +00:00
orbiter
f14d49fae9 enhancements, bugfixes and additions to word index attribute storage 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1392 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-22 00:07:00 +00:00
allo
0f750c2ed6 new Templates 
removed locales from Buildpath

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1391 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-21 23:01:08 +00:00
orbiter
1a70ad64b2 extended network grafics capacity 
try this:
http://localhost:8080/NetworkPicture.png?width=1280&height=1024&pal=10000&pol=10000&max=1000 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1387 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-21 00:21:39 +00:00
rramthun
5942f6334c Some language fixes. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1386 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 20:32:25 +00:00
theli
d298b54b50 *) removing unnecessary button 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1385 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 16:30:26 +00:00
theli
4df41b313b *) changing login realm 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1384 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 15:57:07 +00:00
theli
91bc67edb5 *) blacklist patch from lulabad 
See: http://www.yacy-forum.de/viewtopic.php?p=15358#15358

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1383 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 15:17:13 +00:00
orbiter
f4ffa9aee5 - implemented more attributes to index entries 
- implemented hand-over of new word index attributes during remote search
- implemented word-distance computation during search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1382 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 15:14:21 +00:00
theli
83328ed712 *) Display login link on Status.html 
See: http://www.yacy-forum.de/viewtopic.php?p=15183&highlight=#15183

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1379 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-20 11:04:14 +00:00
orbiter
0371494010 tried to add word position to index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1377 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-19 14:13:39 +00:00
borg-0300
c5b6154136 added CRDistOn = true/false 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1372 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-18 02:18:23 +00:00
borg-0300
8d8a40c2d9 added properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1369 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-18 00:03:28 +00:00
orbiter
cfd1e5e376 more security for index transfer protocol: 
- allow only specific file names
- log IP number of accessing peer in case of attack attempts

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1367 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 22:19:18 +00:00
orbiter
423ce9bf59 quickfix for http://www.yacy-forum.de/viewtopic.php?p=15336#15336 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1366 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 21:50:40 +00:00
allo
5eba6c66c6 thelis fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1364 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 19:01:20 +00:00
theli
faca799f79 *) Bugfix last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1362 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 12:22:22 +00:00
theli
b1b8ba719e *) adding links to specify the amount of entries of a queue that should be displayed on the gui 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1360 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-17 08:45:12 +00:00
daburna
0dcc89ec78 #added/corrected/updated German translation in de.lng 
#updated Status_p.inc

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1355 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 21:30:19 +00:00
theli
da81d7db17 *) Adding possibility to close open connections via Connections_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1350 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 14:46:33 +00:00
theli
b9db08249f *) IndexImport_p.java: Print out stacktrace on error 
See: http://www.yacy-forum.de/viewtopic.php?p=15233

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1349 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-16 09:13:00 +00:00
allo
4f8127946e inc Files are now translatable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1345 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 22:11:45 +00:00
rramthun
c59027e520 Translated status_p.inc a bit further, but it didn't work. 
See http://www.yacy-forum.de/viewtopic.php?p=15180#15180

Added my seed to superseed.txt as I am now proud owner of a PC which runs YaCy most of the day.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1343 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 22:01:21 +00:00
allo
fe2d983c3e recursive Translations! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1341 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 11:56:20 +00:00
(no author)
7f1192498a display the message as UTF-8 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1340 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 11:09:41 +00:00
orbiter
4cd0c45a77 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1337 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-14 01:06:54 +00:00
(no author)
001513cc1f Now custom httpHeader can be created 
and filled with cookies and so on.

This header one can set into serverObjects

Check CookieTest.html and CookieTest.java for details.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1334 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 22:50:04 +00:00
(no author)
d69a182736 Html pages to test cookies 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1333 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 21:37:48 +00:00
allo
239a904888 new Templates for Wiki.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1331 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 18:04:55 +00:00
allo
d5aaaf500f bookmarksDB: 
lowercase Tags; if you create a Tag with Uppercase chars, friendlyName will be set.
So The Tag is displayed Uppercase, but stored Lowercase.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1328 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-13 15:10:24 +00:00
(no author)
5c87685438 handle UTF-8 correctly 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1321 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 21:13:01 +00:00
orbiter
b21b9df2d0 added section headlines generation to html parser 
can be viewed in cache control, but is not yet included to indexing

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1320 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 20:21:34 +00:00
rramthun
c4487deba9 Minor changes collected over some time. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1319 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 19:15:31 +00:00
borg-0300
6de5c46702 new CacheAdmin (redesign); 
bugfix: no more '//' in cachelink;
bugfix: don't left the htCachePath;


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1318 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 18:02:54 +00:00
allo
6822dce57b Using Orbiters function for auth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1315 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-12 16:21:08 +00:00
allo
25c4e47582 bugfix for login 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1311 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-11 12:49:02 +00:00
orbiter
9544c47684 added some UTF-8 handling. 
hope this will help somehow.. for shure not THE solution to our UTF-8 problem


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1308 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 16:48:59 +00:00
allo
7586fcb1a4 second Loginbug... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1307 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-10 16:12:28 +00:00
orbiter
9086261476 refactoring of base64 encoding: 
the kelondro database needs specific information about the order of
base64-encoded keys. Since no other package depends on base64
(only the httpd uses base64 for encryption, but does not need to encode these strings)
it is good to move base64 encoding to the new ordering classes in kelondro.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1284 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-04 00:39:00 +00:00
daburna
a4696fa92e added new submenu for index control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1282 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 11:46:46 +00:00
daburna
c7a4bf7ed1 #updated de.lng: 
-translation for IndexImport_p.html added
-translation for Bookmarks_p.html added
-updated other files

#corrected spelling:
-IndexImport_p.html
-IndexTransfer_p.html
-Bookmarks_p.html

#added link for IndexImport_p.html at IndexControl_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1279 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-01-03 00:38:45 +00:00
allo
ba96cefe0c packages for xml/* 
bugfix for servlets with packages from theli.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1272 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-30 13:57:51 +00:00
allo
26bab876db more del.icio.us Api 
Bugfix for http in gettitle_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1268 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-29 19:53:15 +00:00
allo
2e2fa99501 bookmarksManager: 
-gettitle_p.xml and AJAX to use it
-classpath change
httpc:
-simple wget function

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1267 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-29 17:45:50 +00:00
allo
ca3a513aee del.icio.us style api 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1265 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:26:26 +00:00
allo
75b9163242 xmlapi for bookmarktags 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1263 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-28 18:07:57 +00:00
allo
4c824cacba Description Field 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1258 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-27 20:47:16 +00:00
allo
09c95544c0 edit Function 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1255 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 22:10:12 +00:00
allo
0619051c4b timestamps 
sorted by timestamps

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1254 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 21:03:42 +00:00
allo
d5e27009b1 bookmarks: 
-bugfixes
-deleting

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1253 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:48:19 +00:00
borg-0300
66cf813f07 BUGFIX: not all "<unresolved URL Hash>" were listed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1252 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:41:55 +00:00
allo
87ea300d71 bookmarks interface 
-bugfix for tags
-defaulttag, if no tag is given

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1251 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 19:29:26 +00:00
allo
d0d1855520 tagView 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1250 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 18:14:40 +00:00
allo
ece2844385 bookmarkManager 
tagView, Public Flag, next-page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1249 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 15:40:09 +00:00
allo
4ac0fd328a First Version of the Bookmarksmanager 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1248 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-26 14:21:01 +00:00
allo
0f1212feb9 userDB.hasAdminrights to check adminRights. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1245 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 14:05:05 +00:00
allo
f2f8867251 auth with userDB in IndexMonitor 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1243 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 12:55:25 +00:00
orbiter
b3dca06bb1 added location column to network pages. 
The location is computed from the userAgent string of connecting peers.
Therefore this information is not available right after start-up.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1241 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-22 01:01:46 +00:00
daburna
016ed3471f updated de.lng: 
-translation for Connections_p.html added
-translation for IndexCreate_p.html updated

IndexCreate_p.html:
-corrected spelling

header.template:
-added link for YaCy Wiki

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1239 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-21 21:25:26 +00:00
theli
ce99d4ce2a *) Correcting network.xml 
- bugfix for peer status
   - bugfix for index receive 
   - adding ppm and utc
   See: http://www.yacy-forum.de/viewtopic.php?t=1645

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1237 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-20 07:14:56 +00:00
orbiter
ba669887e4 fixed border of delete button at search results 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1234 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-18 23:10:49 +00:00
rramthun
45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1224 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-17 11:13:44 +00:00
borg-0300
3df24b8673 restart button removed 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1222 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 12:58:49 +00:00
orbiter
dbd6cc57dc * added Connection page to main menu; adoped Connection page layout 
* updated changelog

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1216 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-16 00:35:38 +00:00
orbiter
4500506735 fixed some bugs concerning url entry retrieval and intexControl interface 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1212 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-15 10:31:00 +00:00
orbiter
83a34b838d * added Object allocation monitor on performanceMemory page 
* added some final statements
* changed shutdown sequence order

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1211 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-14 13:04:43 +00:00
orbiter
bb79fb5d91 - changed handling of error cases retrieving urls from database 
(no more NULL values are returned, instead, an IOException is thrown)
- removed ugly damagedURLS implementation from plasmaCrawlLURL.java
  (this inserted a static value into the Object which is not really a good style)
- re-coded damagedURLS collection in yacy.java by catching an exception and evaluating the exception message
to do:
- the urldbcleanup feature must be re-tested


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1200 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-11 00:25:02 +00:00
theli
61bded057a *) Bugfix for Server Port configuration. Status-Info was not displayed correctly. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1194 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 22:22:41 +00:00
theli
5a1d45715d *) Bugfix for parser configuration bug 
- it was not possible to disable all parsers
   See: http://www.yacy-forum.de/viewtopic.php?t=1579

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1191 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 21:35:40 +00:00
daburna
dee27a86c6 - added title="delete" and alt="delete" for minus-grafic in index.html 
- updated language file

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1190 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-08 12:58:40 +00:00
rramthun
a1061495d4 Fixed some spelling mistakes and added some text which (should) make it easier to understand the options. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1187 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 19:47:21 +00:00
orbiter
13fdebc50d added authentication for link deletion in search result 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1177 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-07 00:36:05 +00:00
orbiter
37f88b4017 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1176 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 23:51:29 +00:00
daburna
e078a50e0b - corrected spelling in IndexCreateWWWLocalQueue_p.html and simple_search.html 
- updated de.lng with translation for simple_search.html and update translation for IndexCreateWWWLocalQueue_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1174 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 21:31:52 +00:00
orbiter
8f1f2daa5e implemented interactive link deletion of search results. 
next steps: attach voting and restrict to administrator
to see the deletion button, move the mouse pointer to the left of a search result

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1172 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 16:15:21 +00:00
theli
44fa94ac52 *) Modifications for dbImport functionality 
- dbImporter threads are now shutdown by the switchboard on server shutdown
   - adding possibility to pause a importer thread via GUI
   - Bugfix for abort function
     See: http://www.yacy-forum.de/viewtopic.php?p=13363#13363

*) Modification of content parser configuration
   - now it's possible to configure which parsers should be enabled for the proxy,
     crawler, icap, etc. separately
   - 

*) htmlFilterContentScraper.java
   - adding regular expression to normalize URLs containing /../ and /./ parts

*) httpc.java
   - adding functionality to unzip gzipped content
   - requested by roland: should be used later to allow gzipped seed lists

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1170 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 10:41:19 +00:00
orbiter
28ddba8813 added vote-button images 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1169 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-06 00:16:41 +00:00
low012
d5c36c8e2e *) now showing the total number of entries in the queue in addition to the number of entries in the list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1168 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 23:24:46 +00:00
orbiter
7920e1547d code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1163 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:13:13 +00:00
theli
64478b1f02 *) Adding possibility to delete crawler queue entries using regular expressions 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1160 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 09:11:28 +00:00
orbiter
1d6a6d1f85 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1159 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-05 00:17:12 +00:00
orbiter
a04930f025 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1158 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-04 23:51:28 +00:00
orbiter
548f0c6aff first Try with Eclipse / cleaned sources 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1157 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-04 23:14:30 +00:00
low012
d35fb38c2b *) making the serach button work with Opera, Konqueror and Safari again. Roland's code is still in there, but in a comment to be reviewed later 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1156 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-03 10:18:28 +00:00
rramthun
8c0d982191 1.) Fix from Martin (he ist not at home...) 
2.) Search button now gets blocked if clicked and JS active.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1150 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-12-01 18:26:39 +00:00
theli
b62c36d2ab *) Bugfix for urlRedirector 
- media extension was not parsed correctly

*) Displaying urlRedirector connections in Connections_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1145 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-29 23:45:17 +00:00
theli
bdf30117c1 *) Redesign of parser configuration 
- restructuring of mimeTypes based on the parsers
   - displaying parser usage count
   - displaying human readably parser names
   - displaying parser version information

*) httpdFileHandler.java
   - adding possibility to support "streaming" servlets
     which are special servlets that can communicate with
     the client via the connection streams autonomous
   - the name of these new servlet types must end with the 
     file extension .stream
   - this feature will be needed by the yacy ScreenSaver
     class to fetch statistic data from the peer without the
     need to reconnect to the server all the time

*) Adding human readable names and version information for
   all supported parsers

*) plasmaParser.java
   - adding new structure to store parser statistic data

*) Adding openDocument parser
   - can be used to parse odt files

*) jmimemagic
   - adding rules to detect openDocument formats properly

*) serverLog.java
   - adding functions that can be used to query if a given
     logging level is enabled or not.


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1140 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-29 07:27:58 +00:00
low012
edaa820bec resubmitting Allos patch after accidentally removing it 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1137 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-28 21:42:01 +00:00
low012
c45e47bf91 fixed vulnerability, see http://www.yacy-forum.de/viewtopic.php?t=1535 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1136 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-28 16:51:59 +00:00
allo
38d915e24c limiting the Number of Items displayed to 100 max. 
http://www.yacy-forum.de/viewtopic.php?p=13275


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1131 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-27 09:50:23 +00:00
orbiter
f57e2d67f5 shortened network overview (less columns fit easier on page) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1124 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-23 11:57:30 +00:00
allo
787c368696 synchronized redirectors and using the port. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1122 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-23 07:37:15 +00:00
orbiter
85282b1d98 enhanced YBR recognition and search result heuristics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1121 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-23 01:40:02 +00:00
orbiter
b9cc9029e3 added ybr selection for remote search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1119 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-22 16:10:24 +00:00
orbiter
0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1118 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-22 15:17:05 +00:00
borg-0300
75c0d12ac5 small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1117 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-21 18:27:12 +00:00
allo
52a0237bf2 using Filetemplates for #[metas]# and other static includes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1116 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-21 08:33:54 +00:00
allo
bac22d3f4d hiding the current_user field. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1115 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-21 08:23:40 +00:00
theli
90d6c6223b *) Adding color codes to network graphic legend 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1114 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-21 08:13:01 +00:00
theli
8d68cd9ca4 *) Adding patch of HopFlash for network graphic legend 
See: http://www.yacy-forum.de/viewtopic.php?p=13031

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1113 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-21 07:57:06 +00:00
theli
cfdc0c89c3 *) Removing "error" strings in proxyErrorMsg template because not all messages 
are proxy errors (requested by HopFlash)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1109 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-20 15:52:48 +00:00
theli
89fab9f200 *) Correcting Problems with lURLEntries containing null URLs. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1104 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-17 21:37:24 +00:00
theli
23dc904e0e *) Correcting Problems with lURLEntries containing null URLs. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1102 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-17 15:43:21 +00:00
rramthun
67d73218b0 -Search button is now blocked while searching if client has Javascript active 
-Introduced real .ico, because .ico is not a renamend .bmp ;-)
See favicon.de for details.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1095 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-16 17:16:19 +00:00
theli
8e308cf50e *) Possibility to change the server port on-the-fly. 
- Now it's possible to change the server port without the need to restart the whole server.
   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1089 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-15 15:03:15 +00:00
theli
d0dfccdb77 *) Making CrawlStacker pool configurable via GUI and config file 
See: http://www.yacy-forum.de/viewtopic.php?t=1448

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1087 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-15 12:46:22 +00:00
theli
9b35ae9027 *) Correcting wrong % values on IndexTransfer_p page 
See: http://www.yacy-forum.de/viewtopic.php?p=12646 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1084 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-15 09:52:50 +00:00
theli
0610ff4fe9 *) small changes to crawlReceipt.java 
- we do not know if the URL was stored in the noticeURL-DB with the old or new hash.
     therefore we now try to remove the URL from the noticeURL-DB using both hash values

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1082 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-15 08:40:49 +00:00
allo
f8f9d509d5 removed dead Code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 12:48:14 +00:00
theli
47a2a8885d *) Display MimeType on URL Info page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1077 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 12:05:57 +00:00
orbiter
e9d6defce6 qquickfix for http://www.yacy-forum.de/viewtopic.php?p=12638#12638 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1073 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-14 09:48:39 +00:00
theli
444a5a9368 *) Bugfix for Entries with null url in GlobalQueue 
See: http://www.yacy-forum.de/viewtopic.php?p=12675#12675

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1069 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-13 14:59:38 +00:00
allo
22da652d4f more options on Userpage. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1068 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-13 14:17:23 +00:00
allo
4976f97956 Logout Function on User.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-12 15:29:18 +00:00
orbiter
f763923e0a added missing files for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1057 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-11 08:02:46 +00:00
orbiter
79818a320f introduced citation-rank transmission protocol and activate transport for anonymisation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1055 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-10 23:48:20 +00:00
borg-0300
9a441e8e77 new Ranking Images 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-09 13:24:41 +00:00
theli
6f8d7d3bcd *) Adding first version of YaCy bookmarklet 
- this can be used to easily crawl a webpage which is currently opened in the browser
   - to get the bookmarklet javascript simply call http://localhost:8000/QuickCrawlLink_p.html
     and drag and drop the link shown to your Browsers Toolbar/Link-Bar.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1053 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 12:14:51 +00:00
hydrox
86c74d209d *) fix for Settings_p.html (wrong variablename in link) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1051 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 09:02:26 +00:00
hydrox
886955e38c *) fix for last commit (wrong filename) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1050 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 08:58:18 +00:00
hydrox
88669ce008 *) cleaned up Settings_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1049 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-08 08:40:18 +00:00
orbiter
d2731418bf added creation of global ranking files and changed url normal form usage 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 12:33:02 +00:00
theli
fb766413d1 *) Changes on httpc dns caching 
- Bugfix: old dns cache did not handle case insensitive hostnames correctly. 
   - adding a possibility to set domain name patterns defining hostnames that should not be cached by the httpc dns cache
     e.g. borg-300.dyndns.org
     This can be done by setting the new httpc.nameCacheNoCachingPatterns property
   - using httpc.dnsResolve wherever possible within the sourcecode
     [httpd.java,plasmaCrawlStacker.java]

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1044 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 10:57:54 +00:00
allo
89a4cca4df max. num of Entries 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 06:53:44 +00:00
allo
8d8d866494 Bugfix for catch up late Peer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-07 06:52:30 +00:00
theli
dd24f0252f *) Searchword highlighting for info page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1036 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-06 06:27:17 +00:00
borg-0300
440e6ed747 see http://www.yacy-forum.de/viewtopic.php?t=1416 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1025 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 23:49:50 +00:00
theli
b8ceb1ffde *) Adding better https support for crawler 
- solving problems with unkown certificates by implementing a dummy trust Manager
   - adding https support to robots-parser 
   - Seed File can now be downloaded from https resources
   - adapting plasmaHTCache.java to support https URLs properly

*) URL Normalization
   - sub URLs are now normalized properly during indexing
   - pointing urlNormalForm function of plasmaParser to htmlFilterContentScraper function
   - normalizing URLs which were received by a crawlOrder request

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1024 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 15:28:37 +00:00
hydrox
2c5999ae00 *)fixed UNRESOLVED PATTERN in ViewLog_p.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1020 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 10:44:53 +00:00
theli
f871408729 *) sharedBlacklist_p.java 
- Setting Pragma: no-cache
   - increasing timeout to 12 sec.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1019 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-03 08:32:43 +00:00
hydrox
cb69047b91 *)cleanup access static methods and fields 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1016 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 17:56:26 +00:00
hydrox
56b9f34411 *)removed unused imports 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1015 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 16:30:45 +00:00
hydrox
62b6c2b9e7 *)added news count to News.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1014 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-11-02 10:31:52 +00:00
hydrox
295aff52a3 *)added offline-browsing-support (onlineMode=0) 
*)online-mode now can be changed in Status.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1010 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-31 12:25:40 +00:00
orbiter
b058ecf0bc refactoring of image-generation; added experimental PNG encoder (not active now) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1008 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-31 02:43:55 +00:00
orbiter
fce616db23 security limits for network picture 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1006 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-30 13:47:42 +00:00
allo
749f44d144 LiveUpdate. 
(this does not work correctly at the Moment :-/)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1003 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 10:52:21 +00:00
allo
5526d2ff73 Basic WatchCrawler.html, which loades the Queues using AJAX. 
ajax.js: generic Ajax-Functions
xml/queues/indexing_p*: the Backend


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1002 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-29 09:47:30 +00:00
orbiter
7a3be46c18 bugfix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@999 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-28 13:03:30 +00:00
theli
8194fde340 *) trying to continue transferRWI processing even if this error occures: 
|> Caused by: de.anomic.kelondro.kelondroException: kelondroTree.searchproc: nullpointernull in db '.../urlHash.db' 
   - if URL existence can not be determined, we request it from the remote peer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@997 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-28 07:47:30 +00:00
theli
ec3af327f7 *) Bugfix for Proxy-Authentication against remote proxy 
See: http://www.yacy-forum.de/viewtopic.php?p=11804#11804

*) Adding first version of db test for mysql
   NOTES:
   - db user + db + db table must be created before starting the test
   - db table must be empty. Entries can not be updated at the moment
   - db connection properties must be changed in the sourcecode at the moment
   TODOs:
   - accepting connection properties via command line
   - implementing update + remove + read operations
   - 'maybe' adding code to create db + table if it doesn't exists

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@991 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-27 11:28:37 +00:00
orbiter
5b0911d7ea added new performance menu for search sequence configuration and monitoring 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@990 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-27 00:42:08 +00:00
orbiter
8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@980 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 14:07:43 +00:00
orbiter
097009d910 experimental visualization of DHT access during global search (temporary) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@977 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-24 00:34:15 +00:00
orbiter
4dcbc26ef1 introduction of search profiles; very experimental 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@976 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 17:50:27 +00:00
theli
efd11c13b6 *) Fixed wrong button text 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@975 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 16:18:41 +00:00
theli
525c8dcbd4 *) Adding Traffic Statistic for Crawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@972 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-23 12:35:48 +00:00
theli
02d9af1a70 *) Restructuring and extending of Remote Proxy Support 
- remote proxy configuration can now be "really" changed on the fly and takes effect immediately
   - adding possibility to disable remote proxy usage for yacy->yacy communication
   - adding possibility to disable remote proxy usage for ssl
   - restructuring proxy configuration so that it is stored in a single place now

*) Adding possibility to import a foreign word DB (or even more of them in parallel) 
   at runtime into the peers DB
   - this can be done by calling IndexImport_p.html 
   - ATTENTION: please not that at the moment this thread must be aborted via gui
     before a normal server shutdown is done. 
   - TODO: integrating IndexImport Thread into normal server shutdown
   - TODO: Adding posibility to import crawl-queues, etc. from foreign peers
   - TODO: removing old import function from yacy.java and calling the new routines instead

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@968 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-22 13:28:04 +00:00
theli
af3060938b *) Bugfix for manual peer ping functionality 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@965 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 11:43:43 +00:00
theli
9879c68be9 *) Bugfix for manual peer ping functionality 
- updateMySeed was not called properly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@964 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 10:43:26 +00:00
theli
6e3201b74d *) Bugfix in httpc.java 
- Requestheader was not passed to the underlying post function properly
   - Bug seems not to have caused any side-effect until yet

*) Bugfix for manual peer ping functionality

*) Bugfix for UnresolvedPattern Problem if an Exception occurred in a servlet.
   See: http://www.yacy-forum.de/viewtopic.php?t=1353

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@963 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-20 09:55:12 +00:00
borg-0300
58b670201d now, changed HTCacheSize needs no restart 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 17:59:54 +00:00
allo
f97c303ebd rights for Admin and Proxy. 
Adminrights are OR(old auth or new).
Proxyrights are AND(you need Proxyrights and a not reached Timelimit)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 12:20:08 +00:00
allo
2e1597320f now you can use userDB Users to login 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 11:51:24 +00:00
allo
df147d0fb0 rightsmanagement for upload/download User - preparations for proxy and admin User 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@957 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 11:26:35 +00:00
theli
7256bea45f *) Bugfix for nameLookup parameter handling 
*) Bugfix for Received xx Words [xxxxxxx .. null] Bug



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-19 05:38:04 +00:00
orbiter
99f4d2931a added options in network picture generation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@952 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 20:18:49 +00:00
allo
e057d5686f fix for translatedIncludes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@951 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 18:56:42 +00:00
theli
40777556c5 *) Connection Tracking 
- adding automatic refresh
   - accepts new parameter nameLookup which can be used to deactivate 
     yacy-peer name lookup (because we have problems with this on large seed-dbs)

*) ViewFile
   New page that can be used to view 
   - original content 
   - plain text content 
   - parsed content
   - parsed sentences 
   of a webpage specified by there url hash
   Mainly for debugging purpose at the moment

*) Robots.txt 
   Bugfix for if-modified-since usage
   TODO: synchronization of downloads to avoid loading the same robots-file 
   multiple times in parallel by different threads

*) Shutdown
   Better abortion of transferRWI and transferURL sessions on server shutdown

*) Status Page
   Adding icon to start/stop crawling via status page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@950 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-18 07:45:27 +00:00
borg-0300
e642a5d8b7 more constants 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@947 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-17 15:46:12 +00:00
orbiter
6260942590 changed search process: received indexes are now buffered and written to wordIndex after search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@934 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 13:57:15 +00:00
theli
91e676744e *) Temporarily deactivating reverse name lookup for passive and potential yacy peers to avoid blocking requests when calling 
Connections_p.html
   See: http://www.yacy-forum.de/viewtopic.php?p=11271#11271

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@933 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 13:52:17 +00:00
allo
4a8e6d552e invokation with "emailaddress" in Parameter. 
(compatible with other programs than sendmail, like sendxmpp)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@929 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 10:12:10 +00:00
allo
b88a9584f8 New Errorpage 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@928 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 07:47:57 +00:00
orbiter
bc56a88cc8 further refactoring of search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@925 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-13 00:05:30 +00:00
allo
7ca60f97bf localization Support for Includes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@923 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 12:44:05 +00:00
orbiter
d29dfb0a12 refactoring of search / preparation for better search methods 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@921 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 12:28:49 +00:00
theli
f02c79273e *) Correcting file header 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@917 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 08:40:05 +00:00
theli
c8a35a0130 *) Adding new connection tracking page (currently only for incoming connections) 
*) Displaying statistic for incoming connections on status page
*) Bugfix for Loop-Access Bug when trying to access the yacy page while yacy is configured as proxy
   See: http://www.yacy-forum.de/viewtopic.php?p=6826
*) Bugfix for Referer Bug
   See: http://www.yacy-forum.de/viewtopic.php?p=11098#11098
*) Adding reverse Name lookup for yacy-domain names (used by the connection tracking page)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@916 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-12 08:17:43 +00:00
orbiter
b80b2fbdcc crawling peers now produce waves in network graphic 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@912 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-11 13:06:07 +00:00
orbiter
10d3627c90 changed word cache flush scheduling and removed possible locks 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@910 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-11 07:06:33 +00:00
orbiter
dced5c761e added 'corona' for crawling peers in network graphic 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@909 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 16:21:09 +00:00
orbiter
4cf0d1eb6d less memory occupation in ImagePainter 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@908 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 15:02:53 +00:00
orbiter
aae5af9686 imagePainter may now paint arbitrary large circles; small update to network graphics 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@906 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 13:48:25 +00:00
theli
a9e25c26e1 *) adding new sendRespondError method to httpd which accepts a template include file 
for individual error messages

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@902 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:33:09 +00:00
allo
5605cc8018 TimeLimits 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@901 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:21:25 +00:00
orbiter
6a72f06c40 resizable network picture + greater on click 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@900 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 10:08:28 +00:00
orbiter
839db8869c added high/low priority for index adding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@899 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 09:28:28 +00:00
orbiter
77ae30063d refactoring of websearch process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@893 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-10 00:32:15 +00:00
orbiter
579b22d8ff small update to network drawing 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 23:11:17 +00:00
orbiter
e85989510a update to network image; added disconneced peers by disconnection time and changed colors 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@890 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 17:20:40 +00:00
orbiter
c83594528c integrated crawl stacker into thread control 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 15:59:09 +00:00
orbiter
d666b61b83 fix for news-deletion, see also http://www.yacy-forum.de/viewtopic.php?p=11000#11000 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 14:31:35 +00:00
theli
45f55a6fad *) Bugfix for wrong index-queue size displayed on status page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-09 04:58:09 +00:00
orbiter
c1c94111b0 added new network picture at Network menu using the new image-servlet method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-08 00:37:43 +00:00
borg-0300
a1777788a5 small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@879 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 15:04:03 +00:00
orbiter
d98ed41f31 update to image painter and test on http://localhost:8080/imagetest.png 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 14:17:33 +00:00
allo
f65c939a60 userDB Auth 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@874 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 13:49:07 +00:00
orbiter
5153ec0f3e update to image painter 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-07 01:25:39 +00:00
orbiter
c6f0e35a32 removed notifier.gif; this file is created automatically after startup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 23:12:38 +00:00
orbiter
1b2db0b52a fix for file-share access; damaged some commits before by me :-( 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@870 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 22:30:13 +00:00
borg-0300
f875eda9b7 changed 2, added 5 new picture for more information 
added runtime to the list

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 22:18:44 +00:00
orbiter
1a5d98cd6d better imagePainter example and fix for typo http://www.yacy-forum.de/viewtopic.php?p=10920#10920 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-06 11:51:35 +00:00
orbiter
06f4ac494a image-painter test; try with http://localhost:8080/imagetest.png 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@864 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:38:16 +00:00
borg-0300
fb27428674 added restart to Status.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:35:05 +00:00
borg-0300
13dd16d1dd small change 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 16:00:16 +00:00
borg-0300
5c4db6968e sorted URL list, StringBuffers, finals, cleaned, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@860 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 14:11:50 +00:00
borg-0300
2a18e6486b cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:45:11 +00:00
borg-0300
64acb46a91 cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@857 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:16:53 +00:00
borg-0300
52168fab9b cleaned, finals, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@856 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 13:14:18 +00:00
orbiter
be60b512b7 fix for last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@855 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 12:24:25 +00:00
orbiter
f6cf3967de fix for compile-bug in svn 583 (Martin guck mal ob das richtig ist: fifo oder filo-stack?) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 12:21:30 +00:00
theli
a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl) 
various checks like the blacklist check or the robots.txt disallow check are now
   done by a separate thread to unburden the indexer thread(s)
   TODO: maybe we have to introduce a threadpool here if it turn out that this single
         thread is a bottleneck because of the time consuming robots.txt downloads

*) improved index transfer
   The index selection and transmission is done in parallel now to improve index 
   transfer performance.
   TODO: maybe we could speed up performance by unsing multiple transmission threads in 
         parallel instead of only a single one.

*) gzip encoded post requests
   it is now configureable if a gzip encoded post request should be send on
   intex transfer/distribution

*) storage Peer (very experimentell and not optimized yet)
   Now it's possible to send the result of the yacy indexer thread to a remote peer 
   istead of storing the indexed words locally. 
   This could be done by setting the property "storagePeerHash" in the yacy config file
   - Please note that if the index transfer fails, the index ist stored locally.
   - TODO: currently this index transfer is done by the indexer thread. 
     To seedup the indexer
     a) this transmission should be done in parallel and
     b) multiple chunks should be bundled and transfered together


*) general performance improvements  
   - better memory cleanup after http request processing has finished
   - replacing some string concatenations with stringBuffers
   - replacing BufferedInputStreams with serverByteBuffer
   - replacing vectors with arraylists wherever possible
   - replacing hashtables with hashmaps wherever possible
   This was done because function calls to verctor or hashtable functions
   take 3 time longer than calls to functions of arraylists or hashmaps.
   TODO: we should take a look on the class serverObject which is inherited from hashmap
         Do we realy need a synchronization for this class?
   TODO: replace arraylists with linkedLists if random access to the list elements is not needed

*) Robots Parser supports if-modified-since downloads now
   If the downloaded robots.txt file is older than 7 days the robots parser tries to
   download the robots.txt with the if-modified-since header to avoid unnecessary downloads
   if the file was not changed. Additionally the ETag header is used to detect changes.

*) Crawler: better handling of unsupported mimeTypes + FileExtension

*) Bugfix: plasmaWordIndexEntity was not closed correctly in 
   - query.java
   - plasmaswitchboard.java

*) function minimizeUrlDB added to yacy.java 
   this function tests the current urlHashDB for unused urls
   ATTENTION: please don't use this function at the moment because
              it causes the wordIndexDB to flush all words into the
              word directory!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 10:45:33 +00:00
orbiter
01db66dc69 implemented image-servlets. the imagetest will stay there only for a limited time. Now images can be generated on-the-fly from servlets 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-05 08:40:20 +00:00
borg-0300
a9c466ef21 cleaned, finals, StringBuffer, Properties 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@849 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2005-10-04 17:51:32 +00:00