Commit Graph

1890 Commits

Author SHA1 Message Date
karlchenofhell
30c3d909b1 - fixed charset problem in ConfigProfil_p.html (use accept-charset="UTF-8" in forms)
- fixed wrong XML output if no peers are known in Network.xml
- simplified parsing of table properties in wikiCode and ZTableToken
- reimplemented GC heuristics. They are needed to constantly ensure that an amount of free memory is available which is higher than Java's max. limit for performing a Full GC (please use serverMemory.request(long, boolean) rather than serverMemory.available(long, boolean) to provide data for averaging over the last GCs)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3793 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-05 11:37:19 +00:00
allo
089c2a7c39 firefox-like filter function.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3790 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-04 17:33:29 +00:00
allo
d1e1580223 Surftips Blacklist
Blacklists List Hardcoded instead of only updated on firststart / migration.java

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3788 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-04 15:36:10 +00:00
theli
051a65f7af *) Snippet fetching:
Snippet are now fetched synchronous if the query parameter "fetchSnippet=" 
   is appended to the query string on the yacy search page. This is required 
   for the RSS feed.
   See: http://www.yacy-forum.de/viewtopic.php?t=4051
*) Small changes in the XSLT-stylesheet that is used to generate a html page from
   the RSS feed.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3787 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-04 05:27:46 +00:00
theli
e1a5babff1 *) Logging GUI handler: line-size is now set to max-size if max-size was exceeded
See: http://www.yacy-forum.de/viewtopic.php?p=36355

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3786 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-02 21:23:32 +00:00
(no author)
94cc9f05f5 *) Improvements for restart via update wrapper
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3785 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-02 15:25:13 +00:00
allo
54ddb3262c enter on webstrucutre
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3783 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-02 14:50:36 +00:00
karlchenofhell
edec6049c3 - fix for UPNP error, TODO: via ajax
- removed unused "type" argument in yacysearch.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3782 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-02 08:53:08 +00:00
allo
5fc00871a9 getpageinfo/sitemap bugfix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3781 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-01 16:03:08 +00:00
allo
e7da3d2340 fixed sitemap url in getpageinfo
added suggested tags/keywords in getpageinfo

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3780 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-01 14:44:46 +00:00
allo
d0f8254f95 better refresh ui
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3779 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-01 13:58:48 +00:00
hydrox
44bac7dea1 *) blog-comments can now be moderated
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3778 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-01 06:02:55 +00:00
(no author)
f89517203d *) SOAP: new function to get the Performance Settings of Queues and Processes
No items left in the yadmin SOAP-TODO :-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3776 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-31 15:47:58 +00:00
(no author)
92351c4dcb *) SOAP: bookmarks list now indicates if a bookmark is private (requested by KoH)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3775 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-31 14:54:56 +00:00
(no author)
5f80b72cac *) adding peer-hash, seed-url and location to network.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3772 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-31 14:22:27 +00:00
(no author)
1efe607c34 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3771 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-31 11:24:59 +00:00
low012
0610285c4f *) totalResults and itemsPerPage gets set again
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3768 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-29 21:15:42 +00:00
(no author)
5cc8bb075b Syntaxfehler beseitigt
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3764 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-26 19:51:05 +00:00
low012
a97a3756fe *) got rid of HTML in Java classes that led to HTML tags being displayed on monitor pages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3763 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-25 19:54:54 +00:00
(no author)
ef24bed406 Sorry...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3760 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-24 16:25:07 +00:00
(no author)
a29cb2e1af blupp
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3759 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-24 16:14:46 +00:00
orbiter
0ae6664ad8 enhanced web structure picture
- hand-over of get properties from web front-end to graphics generation
- added depth-control buttons
- added marking of anchor-points to highlight relation order
- enhanced ymage graphics library

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3757 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-24 15:28:03 +00:00
orbiter
54ca71535e added search protection also to detailed search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3755 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-23 19:17:36 +00:00
orbiter
b3d2fafcfb added option to block the search function against unauthorized users
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3754 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-23 19:09:19 +00:00
rramthun
dee29faf15 *) System independent restart is now possible if using the updater/wrapper. - Part 1/2 (YaCy side)
The old Windows-only method has not been removed, so Windows-users without updater are still able to restart without updater


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3752 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-23 18:42:31 +00:00
orbiter
c321ddff7a redesigned access control to surftips:
- access is now granted to authorized admin, even if it is blocked to the public
- generalized naming
- changed links to buttons

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3750 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-23 17:49:16 +00:00
(no author)
b4b56a5475 *) Preparations for system-independent restart using the wrapper. Not functional yet.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3748 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-22 20:41:15 +00:00
orbiter
a585b4d41b added web structure image
see http://localhost:8080/WatchWebStructure_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3747 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-22 15:20:50 +00:00
orbiter
33ad0c8246 added a web structure computation and logging:
- all web page parsing operations will now increase a web structure file
- the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database)
- the file can be used externally to analyse the link structure of the crawled pages
- the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml
- the short-term purpose is the computation of a link-graph image (before linuxtag!)
- a long-term purpose could be a decentralized computation of the citation rank



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-22 08:13:48 +00:00
auron_x
cd3494a04c *) hint for idle indexer only appears if indexer is idle now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3744 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-21 11:57:57 +00:00
karlchenofhell
baa9402b97 - wiki-parser is now configurable via the config setting wikiParser.class which holds the class-name for the parser to use
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3742 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-20 16:19:25 +00:00
karlchenofhell
601fc7d1c5 - added source to J7Zip-modifed.jar and it's license (changelog is still to come)
- moved HTML-*replace-methods from wikiCode to de.anomic.data.htmlTools
- prepared use of different wiki parsers as suggested here: http://www.yacy-forum.de/viewtopic.php?p=34444#34444

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3741 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-20 13:29:12 +00:00
orbiter
b3f97b5c38 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-16 17:45:39 +00:00
karlchenofhell
086239da36 - added servlet: remote crawler queue overview
- added servlet: crawl profile editor

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3731 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-16 10:11:25 +00:00
theli
4dc45d6e97 *) adding tags for skype
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3729 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-15 16:18:51 +00:00
karlchenofhell
8ba81e0995 - added some comments (will get more in the near future)
- added missing <label> to the search field in Network.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3728 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-15 15:48:28 +00:00
allo
eda8696e33 http://www.yacy-forum.de/viewtopic.php?p=35721
wrong startindex


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3727 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-14 21:27:48 +00:00
(no author)
424146f027 more XHTML validation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3710 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-11 18:19:09 +00:00
auron_x
841e51e15e *) addition to last commit (just commited html-changes)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3707 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-11 11:00:17 +00:00
auron_x
15ad9ff32e *) removed unneccessary debug-lines
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3706 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-11 10:56:03 +00:00
orbiter
85035dc319 addition to svn 3699: check send/receive if p2p-mode is activated
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3701 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-10 13:27:38 +00:00
borg-0300
709b4c1905 added switches for the columns
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3700 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-10 11:36:04 +00:00
auron_x
1d1685c588 *) added some JS to give more direct feedback
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3699 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-10 11:15:55 +00:00
(no author)
0132fb6ea7 Status.html now more XHTML valid
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3694 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-09 18:11:03 +00:00
orbiter
139c59ebbd - fixed dht selction problem: the seed tables used a wrong ordering
- cleaned some code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3693 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-09 17:59:36 +00:00
auron_x
c671d70b2e *) added german translation for NetworkConfig
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3690 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-08 13:33:06 +00:00
orbiter
f3fee4d445 fix for http://www.yacy-forum.de/viewtopic.php?p=35322
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3689 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-08 09:19:36 +00:00
orbiter
c209ef5137 changed the icons again
- slightly different size of '!'
- differen colours of idea-icon

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3688 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-08 09:18:46 +00:00
theli
6e74adcb54 *) Bugfix for layout problem with hint boxes
See: http://www.yacy-forum.de/viewtopic.php?p=35316

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3687 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-08 04:49:04 +00:00
low012
a50256aba2 *) removed surplus replacements of HTML
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3686 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-08 00:16:17 +00:00
orbiter
a3ecfe0a45 replaced failed-icon by new 'bad'-icon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3680 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 14:05:49 +00:00
orbiter
ba6e91ed76 changed again the icons
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3679 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 13:32:01 +00:00
orbiter
03032f7d62 more tipps
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3678 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 12:02:11 +00:00
orbiter
b0cf009c16 - added an idea icon
- modified ok icon (was 64x62, now 64x64)
- replaced warning icon
- added size tags to warning image in configBasic
- replaced bad icon for hints on status page by new icons

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3677 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 10:32:51 +00:00
orbiter
dbe8eeba74 slightly enhanced the favicon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3676 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 09:06:41 +00:00
orbiter
68f5d64ae6 replaced yacy logo by better version
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3675 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 08:54:27 +00:00
theli
7d9259e44d *) Bugfix for umlaut problem
See: http://www.yacy-forum.de/viewtopic.php?t=3932

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3674 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-07 04:49:01 +00:00
orbiter
dca85b82ff fix for wrong memory display
see http://www.yacy-forum.de/viewtopic.php?p=35239#35239

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3673 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-06 22:03:09 +00:00
orbiter
d6480dc670 fix for long transfer pauses
see http://www.yacy-forum.de/viewtopic.php?p=35243#35243

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3672 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-06 21:43:20 +00:00
(no author)
b25bc6c36d *) Status page now has button to install updates (1/2)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3670 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-06 20:26:46 +00:00
theli
0b5fc3c28c *) moving date functions to serverDate class
*) Sitemap-parser
   - logging added
   - parsing of modDate added

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3667 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-06 12:36:49 +00:00
theli
6f46245a51 *) Bookmarks: Ajax icon is displayed while loading title
*) First version of a sitemap parser added
   - currently only autodetection of sitemap files is supported
*) DB-Import restructured
   - pause/resume should work again now


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3666 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-06 09:52:04 +00:00
orbiter
111ba9e359 - fixed some width problems in new status page
- fixed deadlock in dns cache
- added termination security for DHT peer selection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3660 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-05 23:18:00 +00:00
orbiter
8005b532ad moved message string from colums at the side of Status_p.html to main text field
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3651 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-04 22:57:00 +00:00
orbiter
158b652c17 redesign of status page:
- moved all information to columns at the right side
- long texts within the column will be removed in a second step, and will re-appear
  as action items below the 'Welcome' header
- new usage hints will also appear below the Welcome header
- Peer news (in full sentences) will appear in separate column
- possibly some more grafics


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3647 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-04 14:19:12 +00:00
orbiter
e0007b2764 fixed save button in confignetwork
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3643 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-03 21:37:22 +00:00
orbiter
9c41132569 re-implemented gc-button (has been lost somewhere)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3639 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-03 08:49:37 +00:00
orbiter
dd44a1394f disabled automatic performance setting change
- during crawl start
- each indexing cycle
- for delay values
- for short memory cycles

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3634 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-02 15:39:27 +00:00
orbiter
b9add5cf37 some bugfixes:
- dht iterator start point
- wordIndex synchronization
- surftipps url check

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3633 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-02 14:20:43 +00:00
orbiter
06b6e35484 fix for a null pointer exception if clusters are not defined
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3632 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-05-02 12:26:29 +00:00
orbiter
d4428947af fix for http://www.yacy-forum.de/viewtopic.php?p=34962#34962
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3630 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-30 23:21:13 +00:00
orbiter
81844e85b2 - fixed more cluster routing problems
- fixed a problem in remote search when balancer caused shift process to wait too long

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3627 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-30 00:39:53 +00:00
orbiter
e48189c710 enhanced cluster routing
- cluster definitions can now contain an addition for local ip addresses
- cluster-cluster communication uses the local ip address instead the global address, if one is given

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3624 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-29 22:05:34 +00:00
karlchenofhell
97d4ab2053 - handle null from iterator in IndexCreateWWWLocalQueue_p.java
- fixed ETA to reach next peer in Network.java
- added some <label>s and fxied minor XHTML errors in ConfigNetwork.html
- try to avoid returning null in servlets as it is unexpected and causes a NPE in the file handler


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3623 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-29 21:45:01 +00:00
orbiter
b33cef421e better routing for public clusters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3620 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-29 00:08:38 +00:00
michitux
f5e6a5d8b2 Fixed media search: parameters were in the wrong order.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3619 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-28 23:23:16 +00:00
(no author)
44fe8361ae *) re-enable popup configuration on status-page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3617 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-28 10:35:46 +00:00
(no author)
d5b7eac6d7 *) aquirerelease should now work again
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3616 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-28 06:31:45 +00:00
orbiter
f73e1e3af9 fixed bugs in remote search setting for public clusters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3615 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-28 00:12:41 +00:00
theli
d86a823822 *) re-enable commands on status page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3612 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-27 15:37:43 +00:00
orbiter
e0d6d5bacf - release information retrieval only on demand of user. Must be admin.
the option is only presented if it is known that there is somewhere
  another more recent version
- removed some old code
- disabled online-mode presentation. the code is not yet removed until decision about
  future usability is made. (not all countries have DSL for everyone)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3610 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-27 13:59:59 +00:00
orbiter
871ee1ce0f one step closer to automatic updates:
automatically aquire release information from download archives
web pages from latest.yacy-forum.net and yacy.net are retrieved, parsed,
links wihin are analysed, sorted and the most recent developer and main
releases are provided as direct download link on the status page, if it was
discovered that a more recent version than the current version is available.
This process is done only once during run-time of a peer, to protect our
download archives from DoS by YaCy peers.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3606 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-27 09:23:44 +00:00
theli
baa814df24 *) adding cluster pph and qph to network.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3605 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-27 05:15:46 +00:00
theli
2399ed817c *) robots.txt parser now extracts the sitemap-URL (will be used later)
*) some javadoc added
*) junit testclass for robots.txt parser added

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3602 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-26 15:42:38 +00:00
orbiter
e192f616a2 collection of small bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3600 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-26 14:28:57 +00:00
orbiter
f8de19fb2f robinson cluster: added client-side protocol implementation
- the network configuration page shows a new option: robinson clusters
- when a global search is made, all robinson peers are excluded, but:
- robinson peers/clusters that provide peer tags and where search words match
  such tags, they are included in global search. Therefore, robinson peers/clusters
  support the global yacy network with their indexes, without doin DHT-exchange


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3598 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-26 09:51:51 +00:00
orbiter
794eefe5b1 added new favicon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3597 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-26 09:33:26 +00:00
(no author)
4f4d3d71dd *) Faster appearance of ConfigBasic by bypassing UPNP-scan in case of existing external connects
*) Marked two deprecated source-points
*) Added possibility to dump words from indexing to file. Should not affect performance in the current form.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3592 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-24 16:33:31 +00:00
orbiter
657585fe0d network functions for robinson peers: server-side protection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3591 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-24 15:11:12 +00:00
orbiter
8253a5bf82 small interface correction
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3590 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-23 20:55:58 +00:00
orbiter
89c1511738 - added new Network Configuration menu, can be found in basic settings
- new cluster functions will be available in this menu, but currently not enabled,
  because corresponding interface methods are not ready yet
- shifted remote crawl settings to new network configuration menu
- shifted DHT distribution/receive to the new network configuration menu
- adopted some string constants
- added cluster configuration settings to yacy.init


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3589 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-23 20:47:07 +00:00
karlchenofhell
c5c3ecc67e - fixed display of last entered value at IndexCreate_p plus minor usability/HTML adjustments
- removed double XML-escaping from CacheAdmin_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3588 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-23 18:53:21 +00:00
rramthun
e6fb6426a3 *) Some cosmetical changes and corrections
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3582 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-19 16:16:54 +00:00
orbiter
eeb5d62bff fix for http://www.yacy-forum.de/viewtopic.php?p=34484#34484
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3581 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-19 15:35:23 +00:00
orbiter
ca79362b9d disabling auto-setting of remote crawl performance
see also http://www.yacy-forum.de/viewtopic.php?t=3849

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3577 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-18 18:36:06 +00:00
michitux
56b30d6593 * fixed a bug in ie: class-names for image-snippets were set, but had no influence on ie, they have to be set with className =
* fixed a bug in safari (hopefully, sorry that I removed the old fix, the divs): yacy-logo is now above the fieldset, the fieldset clears and has a margin-left set
 * fixed a bug with the dls: for example in ViewProfile.html the dt's (the terms/keys) had not the same height as the dd's, so the dt's were not in the same row with the coresponding dd's towards the bottom
 * moved my new css-classes to the right place in base.css

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3572 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 23:14:12 +00:00
michitux
e917bfcae3 * Bugfix: changed handling of the query-string to be independent from input-elements
* removed unnecessary divs

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3571 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-13 18:01:02 +00:00
orbiter
f88aea4869 reverted another bad idea
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3568 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 21:28:31 +00:00
orbiter
58c7cd7885 reverted svn 3563
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3567 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 21:24:56 +00:00
michitux
4990909178 Some bugfixes, new layout/style for image search results:
* removed divide by zero bug when 20_dhtdistribution_busysleep is 0
 * replaced German comment with wrong charset in source/de/anomic/plasma/plasmaCrawlBalancer.java by an English one
 * replaced the table-fix for floating behind snipped images by a br with clear
 * removed unnecessary old xhtml-files (were not in use, they were created when we weren't having xhtml for testing)
 * new layout for image-search results: replaced the old one with spans and tables inside (not valid) with new divs, now each image snippet container has the same size
TODO:
 * the ids of the snippetLoading-divs aren't valid because ids must start with an alphabetic letter or an underscore, they have to be prefixed
 * in the returned snippet-xml is an unresolved pattern for status (the status is only set for text snippets)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3566 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 18:21:17 +00:00
orbiter
2e052eb816 fixed a bug in remote search with remote search tracker
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3565 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 13:49:50 +00:00
orbiter
fb6b21bb6c force opening of found pages on same page, not same frame
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3564 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 12:45:42 +00:00
orbiter
87fcefe1d9 white background color is default to support the kaskelix portal style
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3563 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 10:22:48 +00:00
orbiter
78d04bcbcf fixed bug in search statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3562 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 09:24:56 +00:00
orbiter
45f4489f4b bugfix for broken media search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3561 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 08:58:19 +00:00
orbiter
3e5cd34229 update to search display options for kaskelix embedding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3560 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-12 07:31:26 +00:00
orbiter
a922d9444d fixed search page (there had been some unresolved patterns)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3559 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-11 14:46:54 +00:00
orbiter
d59b31ec0c better display of embedded search results (no more comment on global search, if local was choosen on purpose)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3558 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 14:37:34 +00:00
orbiter
4eecf0bb12 templates for embedded display. try:
http://localhost:8080/yacysearch.html?display=2&input=0&search=yacy&resource=local

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3557 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 14:28:04 +00:00
orbiter
b79b4082e2 completed search exclusion:
- exclusion on index-level (not only from search snippets)
- exclusion hand-over at remote search protocol

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3556 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-10 12:27:03 +00:00
allo
991c62387a just ignore wrong ports
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3555 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-09 22:05:07 +00:00
orbiter
40c14a4f0e - better implementation of search query properties
- basic protection against start-up problems when database files are corrupted
- auto-delete of not-critical databases during startup when load error occurs
- on-the-fly reset option for all database tables
- automatic on-the-fly reset for seed tables during enumeration exceptions

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 10:14:48 +00:00
theli
0c8ff6729f *) adding function to delete single entries from the Global-Crawl-Trigger Queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-05 04:37:40 +00:00
orbiter
6e7340ef52 added exclusion search
(you can now search and exclude words from the result with '-')

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3540 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 15:35:29 +00:00
orbiter
ba2c307ab3 optimized memory allocation in kelondroRow.Entry
such an entry cannot be instantiated without allocation of new byte[]; instead
it can re-use memory from other kelondroRow.Entry objects.
during bugfixing also other bugs may have been solved, maybe the INCONSISTENCY problem
could have been solved. One cause can be missing synchronization during bulk storage
when a R/W-path optimization is done. To test this case, the optimization is currently
switched off.
More memory enhancements can be done after this initial change to the allocation scheme.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3536 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-04-03 12:10:12 +00:00
low012
bc37ac64b3 *) Fix for last commit.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3530 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-28 22:37:01 +00:00
low012
f603b58f6c *) No stacktrace anymore if invalid regex is entered for URL mask or Prefer mask, insted an error message gets displayed.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3529 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-28 22:18:54 +00:00
hydrox
2522c26921 *) peer-search now checks matches to peername and peerhash
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3520 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-24 16:51:19 +00:00
orbiter
5c3afb3202 added option to configure a path to a secondary index location.
this shall be used to store a fragment of the index on another physical device,
to split IO load and enhance access speed. The index is splitted in such a way
that the LURLs are stored to the secondary location, and the RWIs to the primary
location. This is especially useful for environments where symbolic links are
not possible and may cause IO access even if there is no write access to the
device which hosts the symbolic link.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3519 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-24 15:28:17 +00:00
theli
07cd30cf9b *) minor changes for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3518 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-23 06:35:47 +00:00
theli
51b2df566b *) adding possibility to display a fileshare-dir as RSS feed
(e.g. to monitor the directory for changes)
   usage example: http://localhost:8080/share/?format=rss

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3517 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-23 06:25:21 +00:00
theli
e6681b2a79 *) changing RSS feed titles
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3512 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-22 08:52:58 +00:00
theli
f20b596dc0 *) adding servlet to display all deployed SOAP Services
- soap related servlets are located in htroot/soap
*) new serverContext class for soap

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3511 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-22 08:30:57 +00:00
theli
7edd5a0b77 *) correcting notifier.gif path
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3510 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-22 07:42:28 +00:00
theli
df15f71a5c *) avoid NullpointerExceptions if Seed is null
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3508 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-21 17:21:28 +00:00
orbiter
2cb16824e3 removed support for old database structures.
The new collection index will be more generalized to support other indexes
i.e. YBR block-rank computation. A clean-up of the many conditions to support
the old database was necessary.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3506 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-21 15:35:35 +00:00
theli
81b4598487 *) peer profile can now be displayed as vcard
e.g. http://localhost:8080/ViewProfile.vcf?hash=localhash

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3504 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-21 15:08:18 +00:00
theli
40ce33e664 *) adding RSS feed for yacy news
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3496 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-21 12:22:18 +00:00
theli
589cbd8cbf *) replacing all yacy-news-category strings with corresponding constants
Note: please use these constants from now on

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3495 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-21 11:09:15 +00:00
allo
bb51efbb49 "Bugfix" for Tagdisplay
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3493 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-19 13:00:33 +00:00
rramthun
43114af6d7 *) Translated robots.txt-config-page
*) Simplified some sentences

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3492 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-19 12:42:07 +00:00
orbiter
6b9eea3932 - removed differentiation between longTitle and shortTitle; this cannot be used for search results,
and it is difficult to get both types from all document types
- added some author parsing

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3489 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-18 12:33:19 +00:00
orbiter
a738b57b31 added author tag to indexing content
enhanced composition of title tag
TODO: insert author information for external parsers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3488 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-17 01:18:34 +00:00
theli
91c2a042a7 *) bugfix for wrong proxy traffic accounting
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3484 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-16 13:52:48 +00:00
orbiter
861f41e67e redesigned NURL-handling:
- the general NURL-index for all crawl stack types was splitted into separate indexes for these stacks
- the new NURL-index is managed by the crawl balancer
- the crawl balancer does not need an internal index any more, it is replaced by the NURL-index
- the NURL.Entry was generalized and is now a new class plasmaCrawlEntry
- the new class plasmaCrawlEntry replaces also the preNURL.Entry class, and will also replace the switchboardEntry class in the future
- the new class plasmaCrawlEntry is more accurate for date entries (holds milliseconds) and can contain larger 'name' entries (anchor tag names)
- the EURL object was replaced by a new ZURL object, which is a container for the plasmaCrawlEntry and some tracking information
- the EURL index is now filled with ZURL objects
- a new index delegatedURL holds ZURL objects about plasmaCrawlEntry obects to track which url is handed over to other peers
- redesigned handling of plasmaCrawlEntry - handover, because there is no need any more to convert one entry object into another
- found and fixed numerous bugs in the context of crawl state handling
- fixed a serious bug in kelondroCache which caused that entries could not be removed
- fixed some bugs in online interface and adopted monitor output to new entry objects
- adopted yacy protocol to handle new delegatedURL entries
all old crawl queues will disappear after this update!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3483 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-16 13:25:56 +00:00
hydrox
9b5fb3908d *) a peer-message are now created when a blog-comment is written
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3480 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-15 12:58:17 +00:00
orbiter
9f929b5438 better snippet handling in case of snippet load fail
see also http://www.yacy-forum.de/viewtopic.php?p=31096#31096

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3475 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-13 22:18:36 +00:00
auron_x
d451ad48d3 *) improved peerloadgraphic:
- unnecessary (0 %) pieces are removed
 - percent-values of each thread displayed in legend

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3474 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-12 19:08:17 +00:00
orbiter
a5d668c0c6 added speed-buttons for easy performance setting
appears in crawl start and on indexing monitor page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3473 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-12 16:24:28 +00:00
karlchenofhell
e2ac5f62bd - Code hübscher machen [von NNs TODO]
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3471 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-11 19:53:14 +00:00
auron_x
22fe14f292 *) first version of Peerload-graphic
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3469 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-11 17:04:11 +00:00
orbiter
909d7a8ae9 fixed wrong implemented row iterator in kelomdroFlexSplitTables
this has no effect, until now this iterator was only used on
the Index Administration page.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3464 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-09 13:55:26 +00:00
orbiter
b3ca177a5d fix for http://www.yacy-forum.de/viewtopic.php?p=32797#32797
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3459 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-09 11:49:56 +00:00
orbiter
38b93f8cb8 bugfix for my last commit:
iterator did not consider secondary start point in case of rotation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3456 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 22:07:17 +00:00
karlchenofhell
264a82eec8 - fix for http://www.yacy-forum.de/viewtopic.php?t=3657
- fix for http://www.yacy-forum.de/viewtopic.php?p=32758#32758
- Diff takes any objects now, not only strings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3455 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 22:04:15 +00:00
rramthun
045d758537 Avoid stopwords as topwords, configurable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3454 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 20:50:27 +00:00
orbiter
d755a8026d - better OOM protection
- better memory allocation for FlexTable indexes
- splitting between static index and dynamic index (only the dynamic part must grow)
- to enable a merge-iteration of new splittet index, a huge number of classes needed to be adopted for new iterator classes
- added new iterator classes that support cloneable iterators
- adopted all iterator classes to implement cloneable itarators

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3453 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 16:15:40 +00:00
karlchenofhell
2be405e1e1 - fix for last two commits
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3452 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 14:00:04 +00:00
karlchenofhell
de1b4a1731 - don't publish news if empty or equal page is submitted in wiki
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3451 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 13:50:24 +00:00
karlchenofhell
dcc13abd59 - fixed small bug at home page, button "peer's console"
- fixed <fieldset><dl> for safari on many pages
- added Blog-link to Network page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3450 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 13:39:09 +00:00
theli
6596167277 *) bugfix for wrong RSS feed pubDate formats
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3449 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 08:37:47 +00:00
theli
0d178d00a5 *) adding RSS feed for peer messages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3448 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-08 08:10:36 +00:00
karlchenofhell
4f2e6ef47b - WatchCrawler_p shows max. 80 characters of URLs now (maybe dynamically adjustable based on browser width?)
- typo in BlacklistCleaner

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3445 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 23:16:25 +00:00
orbiter
70cd391ea1 fix for dl/fieldset problem in Safari
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3444 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 22:49:32 +00:00
orbiter
5741701b59 moved crawl start up, personal web pages down in main menu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3443 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 16:08:13 +00:00
orbiter
b627c77df6 - workaround for safari bug with definition lists inside fieldsets in ConfigBasic
- alternative can be seen in PerformanceMemory, where a dl is simulated with a table layout

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3442 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 15:53:04 +00:00
karlchenofhell
03c5906ae7 - minor bugfixes for url-fetcher & http://www.yacy-forum.de/viewtopic.php?t=3646
- PerformanceMemory_p.html is valid XHTML again

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3440 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 11:50:03 +00:00
theli
8e9bee12fc *) adding guid to yacysearch.rss
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3435 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-07 05:58:14 +00:00
orbiter
1cba31de43 redesigned ram organization for database caches
- each cache can now allocate as much memory as is available
- no more fixed limits
- replaced old performance memory monitor by new one
- added supervision methods as static functions into the classes that provide cache functionality
- steering of ram allocation is done with two simple limits that are ram availability-relative


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3434 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-06 22:43:32 +00:00
theli
e934c5b09b *) wrong blog rss feed titel
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3433 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-06 17:37:21 +00:00
theli
ceed0364e2 *) Blog RSS: Image added
*) RSS Feed for YaCy Bookmarks added

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3432 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-06 17:35:24 +00:00
low012
ce360ef43e *) no more HTML in plasmaCrawlProfile.java anymore
*) <br> will not be displayed in items in Auto Filter Content on WatchCrawler_p.html anymore
*) removed unnecessary replaceHTML()


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3425 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-02 21:09:28 +00:00
karlchenofhell
93e1ad2bca - fix for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3424 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-02 01:50:21 +00:00
karlchenofhell
88245e44d8 - improved version of robots.txt (delete your old htroot/robots.txt before updating):
- robots.txt is a servlet now
  - no need to rewrite the whole file each time a section is added or removed
  - user-defined disallows, added manually, won't be overwritten anymore
- new config-setting: httpd.robots.txt, holding names of the disallowed sections

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3423 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-02 01:19:38 +00:00
karlchenofhell
9623bf7bbe - removed call of java 1.5 method
- added config servlet for local robots.txt
- removed YPStats_p as it is of no use anymore
- supertemplates use XHTML now
- quick-fix for http://www.yacy-forum.de/viewtopic.php?p=32296#32296

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3422 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-01 13:54:14 +00:00
daburna
f4c13b422c *updated translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3421 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-03-01 09:36:59 +00:00
karlchenofhell
1fe505f0b0 - adapted User_p to general web-interface style (and removed status-only page on changes)
- beautified WikiHelp.html + typos
- IP hasn't been set correctly in Blog.xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3418 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-28 09:22:31 +00:00
karlchenofhell
92b6bc0ad2 - fixed wrongly applied replacement of "<" and ">" in Blog and simplified the code a bit
- added check, whether active blacklist engine is supported by blacklist cleaner

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3417 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-28 00:04:32 +00:00
karlchenofhell
a1d68fe092 - use .class rather than Class.forName for classes in class-path
- added Bost's patch for Diff.findDiagonale() from: http://www.yacy-forum.de//files/patch_685.txt
- fixed minor bugs in Blog

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3416 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-27 22:52:22 +00:00
orbiter
f4cfd19835 second Generation of collection R/W head path optimization:
- permanent cache flush is switched off. The optimized cache flush
  works better if it is a large number of collections that is flushed
  together
- the flush size can be configured instead the flush divisor. There is
  only one size for all flushes
- collection records that shall be removed during collection transition
  (jump from one collection file to another) are now not really removed
  but only marked in RAM. add-operations to the collection use these
  marked collection spaces
- index bulk write operations are now separated for each file of a kelondroFlex


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3414 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-27 13:01:22 +00:00
hydrox
e92e8b2ae3 *) added RSS-Feed for blog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3413 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-27 10:05:46 +00:00
hydrox
a107961099 *) fixed blog-comment-deletion without admin-rights is no longer possible
*) fixed no empty blog-comments anymore

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3412 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-27 08:37:47 +00:00
(no author)
cf47075855 CSS corrects
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3410 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-26 23:03:10 +00:00
hydrox
116fc016d0 *) fix for Blogcomment-Preview
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3408 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-26 16:18:43 +00:00
hydrox
54fef3574f *) missing files for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3406 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-26 14:38:34 +00:00
hydrox
cb89c74d52 *) added blog-comments
*) removed debug-output when deleting news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3405 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-26 14:36:01 +00:00
karlchenofhell
6fbe31425a - some code-cleanup (no more syntax-warnings here)
- added deletion from loadedURLs of URLs to be blacklisted in IndexControl_p

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3404 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-26 12:56:50 +00:00
karlchenofhell
31ad42535a - added buttons to add complete domain or single URL to blacklist to IndexControl_p
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3400 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-25 23:14:45 +00:00
karlchenofhell
e0decf4653 - added support for changing invalid entries in blacklist cleaner
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3397 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-25 19:36:05 +00:00
karlchenofhell
c58ef48e1c - increased size of subject text-field
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3396 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-25 18:48:25 +00:00
auron_x
9cbf94222f *) added seedurl to network.xml as requested by lulabad
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3394 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-25 10:24:42 +00:00
karlchenofhell
26f5757b40 - added support for multiple paths per domain to default-blacklist
warning: an interface-change had been neccessary:
- remove(String, String) has been renamed to removeAll(String, String), because it removes all path-entries for the specified host
- remove(String, String, String) has been added to delete only a path-entry
- geBlacklistType(String) has been renamed to getBlacklistType(String)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3391 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-24 13:56:32 +00:00
karlchenofhell
3d6ab19f7e - remove double entries in blacklist as well
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3390 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-23 18:27:56 +00:00
karlchenofhell
bf7a69197d - fix for possible NPE in queues_p
- WatchCrawler_p:
  - display crawler traffic
  - pause/resume local- and global crawler


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3389 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-22 22:26:11 +00:00
allo
9702d3abba further supertemplate test
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3388 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-22 11:01:16 +00:00
karlchenofhell
0c7b8cf632 - added first version of new wiki-parser
- added blacklist support to manual URLFetcher stack fill
- fix for NPE: http://www.yacy-forum.de/viewtopic.php?t=3559

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3385 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-21 22:31:36 +00:00
orbiter
f7803a6ce4 enhanced crawl balancer
- new domains now get a chance to get crawled early
- less IO operations
- new balancing method
- better dump order at shutdown time
- bugfixes regarding not found url hashes (no more superfluous cache kill)
- domain access time is now shared over all balancer stacks
- viewing the stack does no more disturbish the balancing algorithm that much
- intelligent selection of best next domain using domain access times
- extra double-check (to double-check the double-check)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3384 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-21 16:23:31 +00:00
orbiter
39b0658839 Redesign of Webinterface menu structure
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3381 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-20 14:35:29 +00:00
orbiter
dc0c06e43d PLEASE MAKE A BACK-UP OF YOUR COMPLETE DATA DIRECTORY BEFORE USING THIS
redesign for better IO performance
enhanced database seek-time by avoiding write operations at distant
positions of a database file. until now, a USEDC counter was written
at the head-section of a kelondroRecords database file (which is the
basic data structure of all kelondro database files) to store the
actual number of records that are contained in the database. Now, this
value is computed from the database file size. This is either done
only once at start-time, or continuously when run in asserts enabled.
The counter is then updated only in RAM, and written at close of the
file. If the close fails, the correct number can be computed from the
file size, and if this is not equal to the stored number it is a strong
evidence that YaCY was not shut down properly.
To preserve consistency, the complete storage-routine had to be re-written.
Another change enhances read of nodes in some cases, where the data-tail
can be read together with the data-head. This saves another IO lookup during
each DB node fetch.
Includes also many small bugfixes.
IF ANYTHING GOES WRONG, ALL YOUR DATA IS LOST: PLEASE MAKE A BACK-UP

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3375 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-20 08:35:51 +00:00
hydrox
5af76fccd7 *) peer-search on Network.html now is case-insensitive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3374 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-19 13:00:41 +00:00
karlchenofhell
c016fcb10f - added streaming-support to CrawlURLFetchStack_p servlet
- bug for NPE in list.java
- use more constants

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3373 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-19 12:47:46 +00:00
karlchenofhell
65af9d3215 - continue shifting even in the case the stacked URL could not be found
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3372 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-18 01:50:41 +00:00
karlchenofhell
d114a0136e - crawl profile: don't add null-values
- added some settings and statistics for url-fetcher 'server'-mode
- added own stack for fetchable URLs
- added possibility to fill stack via shift from peer's queues, via POST (addurls=$count and url$num=$url) or via file-upload
- added "htroot" to classpath of linux start-script

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3370 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-17 19:16:53 +00:00
karlchenofhell
a46dc43f45 - added lock symbol for restart- and stutdown-buttons on Status-page (see http://www.yacy-forum.de/viewtopic.php?p=31444#31444)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3369 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-16 00:25:45 +00:00
karlchenofhell
b2a9d32f29 why do I always forget some lines? sorry...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3368 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-14 15:11:03 +00:00
karlchenofhell
e6ddf135bb - enabled fetching new crawls via /yacy/list.html?list=queueUrls for testing purposes
- sent URLs are taken off the limit-stack (of the global crawl trigger) (may be moved somewhere else in future versions)
- added option to set the requested chunk-size

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3367 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-14 14:50:55 +00:00
karlchenofhell
67d96249b4 - fix for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3366 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-13 21:17:43 +00:00
karlchenofhell
c5a2ba3a23 - prepared URL fetch from other peers
- more feedback for user

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3365 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-13 20:18:12 +00:00
auron_x
5ba531a722 *) higher precision for QPH also on status-page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3363 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-11 09:33:39 +00:00
karlchenofhell
4e5eda6ef9 huch...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3362 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-10 20:25:45 +00:00
karlchenofhell
50b59e312f - added experimental CrawlURLFetch_p-Servlet to fetch new URLs from a specified location (\n-seperated list). Requested by Theli.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3361 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-10 20:20:00 +00:00
karlchenofhell
6c6375577e - fix for http://www.yacy-forum.de/viewtopic.php?t=3523
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3360 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-10 11:50:18 +00:00
karlchenofhell
ea20d8d7c5 - return to edited wiki-page after submit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3359 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-09 19:47:21 +00:00
orbiter
30d79d69a6 fix for wrong display of search statistics
see http://www.yacy-forum.de/viewtopic.php?p=31242#31242

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3352 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-08 10:42:35 +00:00
hydrox
faad869865 *) added peer-search to Network.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3347 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-07 11:20:31 +00:00
orbiter
c464157a6e replaced some toString()
see http://www.yacy-forum.de/viewtopic.php?p=31151#31151

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3345 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-06 16:26:56 +00:00
orbiter
d25caa07bf redesigned some parts of http authentication
added another access check for peer hops

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3340 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-05 19:46:50 +00:00
low012
588e48ce0b *) Part II of last commit. Note to myself: check svn commandline syntax :-(
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3339 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-05 18:21:11 +00:00
low012
0d2431d6f7 *) removed printed out '<br />' in row Hit-Size Miss-Size by moving <br /> from Java file to HTML file.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3338 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-05 18:16:01 +00:00
hydrox
ff829e97f8 *) fixed headlines in blog (see: http://www.yacy-forum.de/viewtopic.php?t=3442 )
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3337 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-05 14:40:02 +00:00
hydrox
9184113284 *) fixed News deletion. News are now removed if they are no longer in a news-stack. This does not effect News-entires in the news-db that have no stack-entries.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3336 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-05 13:35:36 +00:00
karlchenofhell
a647a7ca8d - <tt>-tags look like <span class="tt">-tags now, fix for EDIT 3 of http://www.yacy-forum.de/viewtopic.php?t=3485
- Typo: crawl depth 0 indexes the given url, 1 indexes all links on it

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3335 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-04 18:22:53 +00:00
karlchenofhell
3bafd643c0 - fix for http://www.yacy-forum.de/viewtopic.php?t=3483
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3330 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 20:22:39 +00:00
karlchenofhell
6667930352 - old versions may be reviewed and restored
- removed explicit replacement of '<' and '>', fix for first bug in: http://www.yacy-forum.de/viewtopic.php?t=3485

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3329 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 19:48:18 +00:00
karlchenofhell
bf8f120340 - reduced margin of headlines in wiki (someone has to create a nice base.css urgently)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3328 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 16:04:43 +00:00
karlchenofhell
f2e6f19b90 - added versioning to Wiki
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3327 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 15:20:12 +00:00
karlchenofhell
2401e748a3 - fixed wrong replacement of POST-parameters in httpd ('<' and '>' are still replaced, don't know why): http://www.yacy-forum.de/viewtopic.php?t=3466
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3324 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 01:26:05 +00:00
orbiter
ceff987dd7 higher precision display for qmh
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3323 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-03 01:18:38 +00:00
orbiter
b2f4087400 redesign of last-seen fieln inside seed:
the field contains now a time in UDC-0 (instead relative to local UDC offset)
this fixes a bug in peer selection, where an iteration over all seeds
ordered by lastseen did not work correctly.
Problems may occur because the new meaning of this field may mix with
the different meaning of that field in older peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3322 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-02 23:54:27 +00:00
karlchenofhell
e68cdeeeb3 - reverted parseArg(String) to use a byte-array to handle correct UTF-8 parsing
- arguments aren't passed html-escaped to the servlets anymore, bug-fix for http://www.yacy-forum.de/viewtopic.php?p=30573

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3321 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-02 21:20:53 +00:00
orbiter
e00e850a98 removed constants (no connection with yacySeed.dna identifier)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3320 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-02 14:52:54 +00:00
orbiter
fcc11391a8 some redesign attempts because sorting of lastseen does not work correctly
not finished yet
target: better selection of peer-ping targets, which should enhance stabilization of the net

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3319 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-02 13:12:31 +00:00
netbude
c80707ccd5 File is again valid XHTML
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3318 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 15:00:38 +00:00
orbiter
c2d6edf21d integrated number of remote targets as 'partitions' into remote search protocol
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3317 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 13:27:23 +00:00
orbiter
f696d3c1eb added double computation to kelondroMapObjects
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3316 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 09:48:31 +00:00
theli
8a0ed1ce50 *) bugfix template variable qph for local peer renamed to my-qph
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3315 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 08:52:20 +00:00
theli
8d4dc11d38 *) adding qph to network.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3314 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 08:48:55 +00:00
orbiter
819ff21c92 fixed QPM output
QPM is temporarily called QPH (until more search requests are present?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3313 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-01 00:17:35 +00:00
auron_x
a480bb7afa *) changed stats-display on status-page and added QPM
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3312 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 23:43:25 +00:00
theli
8c9ee3b442 *) missing table cell added
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3311 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 17:26:35 +00:00
orbiter
4f6eed5623 QPM increment
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3309 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 16:21:20 +00:00
orbiter
306c50ac40 QPM (queries per minute) statistic stub
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3308 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 15:39:11 +00:00
michitux
48da3184f0 Two fixes: escaped some &s in QuickCrawlLink_p.html and added correct id to the skype-field in ConfigProfile_p.html (note: ids must be unique in a (x)html-document - in most cases you can simply use the same like for name)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3307 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 15:11:39 +00:00
orbiter
7598e1243e removed unused variables/imports
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3306 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 09:28:47 +00:00
orbiter
47ab83a7c0 added flag for YaCyHop - proxy access for all paths that start with /yacy/
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3304 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-31 00:09:51 +00:00
allo
c70dd35aed another safeXML Fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3301 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-30 10:48:42 +00:00
allo
ec52c98ab0 fix for http://www.yacy-forum.de/viewtopic.php?p=30823#30823
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3300 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-30 05:29:44 +00:00
orbiter
88fa764b64 implemented new kelondroObjects into bookmarkDB
- Bookmark-Objects are stored inside the kelondroObjects cache
- removed superfluous classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3298 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-30 00:17:55 +00:00
daburna
214a18dea7 *added translation for
-BlacklistCleaner_p.html

*some small changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3296 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-29 21:09:22 +00:00
allo
669c21db05 first version of abstracted kelondroMap Cache.
get returns a kelondroCachedObject(or in most cases a subclass of it),
or a map, which can be used to construct a kelondroCachedObject.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3295 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-29 19:10:55 +00:00
orbiter
2de9d73702 - added Skype nick to peer profile
- reversed remote/local search statistics table order (latest first)
- fixed bug in remote search tracker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3294 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-29 15:39:05 +00:00
allo
98cb777e18 abstract wikiCode in putWiki
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3293 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-29 15:09:58 +00:00
orbiter
f25c0e98d1 - replaced String by StringBuffer in condenser
- added CamelCase parser in condenser
- added option to switch on or off indexing for proxy

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3292 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-29 01:11:22 +00:00
allo
14f2068daf some more bookmark changes towards multiuser bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3291 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-28 17:38:43 +00:00
karlchenofhell
6d60b47706 - missing sub-menu in Blacklist-template
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3290 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-28 16:31:18 +00:00
karlchenofhell
1bfd779879 - fix for last fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3289 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-28 12:37:24 +00:00
karlchenofhell
c83b156120 - fix for use of Java 1.5 methods (eclipse is crap)
- added two more test-cases for blacklist cleaner

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3288 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-28 12:25:53 +00:00
low012
cd86e7813a *) Changed yacysearch.html to yacysearch.rss because A9 does not accept html (anymore?).
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3287 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-28 11:49:54 +00:00
karlchenofhell
f88487e964 - added servlet to clean blacklists (find & delete invalid entries)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3286 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-27 23:30:58 +00:00
orbiter
b123a404b0 added mime types
added peer name in search statistics

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3285 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-27 23:24:18 +00:00
allo
25c7d4e25e fix for form (cookie) login
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3284 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-27 17:22:49 +00:00
allo
16aa66bf3d fix for promoteSearchPageString
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3283 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-25 15:49:34 +00:00
daburna
f7adc9c913 *added translation for
-LogStatistics_p.html

(hat jemand eine passende Übersetzung hierfür: 
Tried to create left child node twice
Tried to create right child node twice)

*some small changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3279 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-23 20:42:14 +00:00
netbude
8ca317f39d Some XHTML warnings fixed. WatchCrawler_p.html is now valide.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3278 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-23 15:35:36 +00:00
allo
769c3f1249 set owner to new bookmarks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3275 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-23 10:42:25 +00:00
allo
ff79c52fc0 bookmark users can now edit bookmarks.
TO COME: tag bookmarks with username, list bookmarks of a special user, filter private bookmarks for users.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3274 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-23 10:24:26 +00:00
allo
f40169fcd7 preparing multiuser bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3256 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 19:42:50 +00:00
netbude
6d6a783ddf element oriented reorganisation
see also: http://www.yacy-forum.de/viewtopic.php?t=3417

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3255 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 15:42:37 +00:00
hydrox
814a09a0ed *) reversed r3250 and parts of r3252 (nanotime() is an java1.5 function)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3253 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 11:10:57 +00:00
karlchenofhell
d311e258f8 - adjusted LogStatistics to nano-seconds
- removed patches of SVNs 3184/3185 preventing fast DHT

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3252 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 10:39:22 +00:00
orbiter
8369b2bd5a fix for surf tip bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3251 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 09:35:08 +00:00
orbiter
f3f99b19c6 extended search statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3249 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 01:45:29 +00:00
orbiter
c0851ee943 refactoring: moved and renamed de.anomic.data.searchResults to plasma package
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3248 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-19 00:38:03 +00:00
allo
979656f09c fix broken voteURLs && use nice Templates for voteURLs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3247 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-18 16:53:31 +00:00
allo
df4fe259c9 support for external Thumbnailers.
TODO: Mimetype fix
TODO: Demo Thumbnailer


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3245 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-18 14:43:35 +00:00
allo
c39dda2374 finished refactoring of searchtemplates.
now plasmaSwitchboard.searchFromLocal calculates a searchResults structure,
which is parsed in the yacysearch/detailedSearch Servlets.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3244 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-18 10:42:36 +00:00
orbiter
76fab83395 fixed bugs in seach statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3240 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-18 00:26:16 +00:00
orbiter
bc30dd6b24 fixed compilation bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3237 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 19:46:46 +00:00
(no author)
df8d6a7eab Fix for http://www.yacy-forum.de/viewtopic.php?t=3394
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3235 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 18:10:25 +00:00
karlchenofhell
5d540b219e - LogalizerHandler skips interfaces again
- added LogParser stats to LogStatistics

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3234 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 17:01:20 +00:00
karlchenofhell
3863f2dd24 - CacheAdmin: no exception if cached file was not available
- fix for http://www.yacy-forum.de/viewtopic.php?t=3412

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3232 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 15:46:35 +00:00
allo
e1fb3550ab fix for profile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3231 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 14:52:51 +00:00
allo
02522ed607 further Blog fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3230 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 14:39:26 +00:00
karlchenofhell
fdb45378fb - don't spam log because of some old URLs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3227 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 05:31:27 +00:00
karlchenofhell
7c40197e42 - fixed error pages and <label>s for index.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3226 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-17 04:20:19 +00:00
allo
29aa7031d3 workaround for the snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3225 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 21:35:25 +00:00
allo
8803f813c5 partly fixed snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3224 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 21:18:32 +00:00
allo
3954bbfcf9 removed a bit html from .java file.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3221 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 17:41:29 +00:00
karlchenofhell
71112b1fe6 - added LogStatistics_p.html servlet based on the logalizer (indexing values not functional yet due to charset/regex problems)
add the following to DATA/LOG/yacy.logging:
---
# Properties for the LogalizerHandler
de.anomic.server.logging.LogalizerHandler.enabled = true
de.anomic.server.logging.LogalizerHandler.debug = false
de.anomic.server.logging.LogalizerHandler.parserPackage = de.anomic.server.logging.logParsers
---
and "de.anomic.server.logging.LogalizerHandler" to the list of global handlers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3219 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 16:13:21 +00:00
allo
ce6493e265 fix for blog and wiki
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3218 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 15:02:22 +00:00
allo
0c81bd39d4 XSS-safe put as default.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3217 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 14:07:54 +00:00
daburna
d6e02cf837 updated languagefile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3216 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-16 13:46:07 +00:00
orbiter
5515571950 redesign of ymage classes
- less memory usage
- better usage of awt classes
- drawing abstractions: preparations for movable objects for animation class
- test applet for animations
- known bugs: wrong colours for network picture

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3214 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 23:31:50 +00:00
orbiter
c82f494b08 reorganisation of search statistics page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3213 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 21:36:25 +00:00
rramthun
00ca6ecf58 -made snippet-timeout for text and media configurable
-Now completely working OpenSearch plugin!

Please have a look at the search-field of modern browsers (IE 7+, FF2+). It should change its colour when you visit the index/search-page of a peer and you should be able to add your YaCy-peer as search source very easily now.
Credits for adapting the plugin to make it work go to Philipp Redeker.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3212 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 19:45:15 +00:00
orbiter
52c6461e6b some bugfix for statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3211 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 16:03:00 +00:00
karlchenofhell
06152cdf6d - changed grammar in ViewProfile.html to comply with peer-names ending on i.e. 's'
- removed restart-button on non-Windows platforms (until start-script is adjusted)
- margin for <dt>s with more than one line 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3209 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 12:12:16 +00:00
daburna
aedb34a988 removed "cookie menu"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3208 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 12:10:58 +00:00
(no author)
fe72b772cf added a monitor page for search requests
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3206 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-15 01:50:57 +00:00
auron_x
454f182ba3 *) fix for http://www.yacy-forum.de/viewtopic.php?p=30118#30118
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3205 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-14 21:07:37 +00:00
karlchenofhell
2cec552b62 - count of global search contributions were not displayed anymore
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3203 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-14 19:09:54 +00:00
auron_x
9699b094e8 *) fixed hello reporting yourip=UNRESOLVED_PATTERN
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3200 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-14 16:57:24 +00:00
daburna
45ddaf40bb - updated translation for settings_foo_inc files
- corrected table for settings_parser.inc

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3199 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-13 13:37:16 +00:00
auron_x
6ac0021e14 *) fixed static ip beeing cleared when no port was given
*) fixed static ip beeing enabled although it was cleaned to ""

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3198 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-13 11:00:50 +00:00
auron_x
4aec181643 *) out-commented import options that are not availible because of missing assortment-support
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3195 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-12 18:37:04 +00:00
karlchenofhell
b873ad51ab - fix for http://www.yacy-forum.de/viewtopic.php?t=3369
- merged netBude's alternative for tables in yacysearch.html & search results valid
- added statistic info to index.html as proposed here: http://www.yacy-forum.de/viewtopic.php?p=29762#29762
- fixed error-log in httpTemplate

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3189 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-12 00:52:38 +00:00
auron_x
cc1a7ab717 *) using 0 and 1 instead of no and yes, because of better semantic
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3182 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-08 18:46:29 +00:00
auron_x
93f7495399 *) again extended network.xml (patch by lulabad)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3181 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-08 15:08:43 +00:00
auron_x
e5845b6b74 *) extended network.xml (patch by lulabad)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3176 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-07 15:06:45 +00:00
borg-0300
44991fbf6e reference added
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3175 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-07 12:24:12 +00:00
karlchenofhell
340dc52a9d - ConfigProfile_p.html now transmits usable encoding for other than 7-bit ASCII charset, see TODO in httpd.parseArg(String)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3174 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-07 02:07:27 +00:00
karlchenofhell
35fb671721 - updated DetailedSearch and ViewFile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3173 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-06 12:21:13 +00:00
karlchenofhell
00aa9472d6 - added decode of HTML-entities in request lines
- removed Bookmark symbol on search pages and surftips if not authenticated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3172 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-06 11:05:50 +00:00
karlchenofhell
cf31efec5d - escaped urls in IndexMonitor
- use <label>s in Performance-pages
- <form accept-charset="ascii">-workaround for utf-8-problems in webforms
- fixed some xhtml problems in yacysearch.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3170 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-05 20:19:29 +00:00
auron_x
4228ba4d97 *) use VM1.4-functions instead of VM1.5-functions
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3167 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-05 12:52:11 +00:00
auron_x
b6112ae625 *) less confusing memory-table
*) fixed partly wrong build.xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3166 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-05 12:39:58 +00:00
karlchenofhell
0336480a3e - the maxMemory-fix for the Sun JVM 1.4.2 wrongly also applied to 1.6, thx to NN
- added logging of reducing word-cache (log-level fine)
- disabled memprereq field in PerformanceQueues_p.html, because it is now set by the collections db
- minor changes to ConfigSkins / -Language

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3165 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-05 08:00:05 +00:00
borg-0300
735c1f87b1 restart re-activated (windows)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3164 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-04 22:03:32 +00:00
karlchenofhell
780aa5219d - send peer-messages from Messages_p.html without going to network-view first
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3157 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-03 01:44:36 +00:00
karlchenofhell
88ee449300 - don't offer voting for urls if user is not authenticated at peer
- removed possibility to raise priority of YaCy process

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3156 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-03 01:03:56 +00:00
michitux
727b64e793 Fixed Surftips.html for <ie7 (hover for divs) so the vote-icons are usable in <ie7, too. I corrected also some small things in order to get valid xhtml.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3155 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-02 23:43:25 +00:00
karlchenofhell
a27e884a8c - fixed http://www.yacy-forum.de/viewtopic.php?p=29488
- some HTML-stuff

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3153 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-02 23:16:18 +00:00
michitux
c43aae2143 Added column-layout for surftips, some color-fixes for the default-style (default-colors if the user changed the standard-colors in his browser) and a small fix for the dl-layout for forms, now also two-line-labels are displayed correctly.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3152 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-02 23:10:48 +00:00
karlchenofhell
df6281ba1f - removed JS from DetailedSearch => valid
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3151 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-02 21:43:21 +00:00
hydrox
fb1d8b91af *) changed Startpoints of IndexCleaner and IndexTransfer from ------------ to AAAAAAAAAAAA.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3150 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-01 12:27:05 +00:00
auron_x
7e12954634 *) added possibility to set YaCy-Priority
-> Linux-startscript has to be updated

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3148 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-31 01:05:45 +00:00
orbiter
97af4a558b typo
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3144 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-28 16:50:46 +00:00
orbiter
5c529bb348 fixed number of results counter on detailed search page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3143 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-28 16:16:22 +00:00
daburna
07cfe6a045 updated languagefile
-removed and corrected unsed strings
-perhaps better translation for "queu"
-small changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3142 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-28 15:02:49 +00:00
low012
edef8a99de *) Removed online check for Jabber since it did not work for quite some time now. The service (edgar.netflint.net) seems to be down permanently.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3141 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-28 12:27:35 +00:00
low012
86f07c3631 *) Added peer name to title of the page.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3140 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-28 12:00:55 +00:00
daburna
7da6fd1245 updated languagefile
-translated DetailedSearch.html
-translated dir.html
-changed every "indizier" to "indexier"
-small changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3138 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-27 15:41:02 +00:00
daburna
bdebc1ac64 updated languagefile
-clean up for unused strings
-small changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3137 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-26 13:41:53 +00:00
karlchenofhell
61a66f410b - typo in yacy.init
- removed table-layout (please comment, whether the "new" style of ConfigLanguage_p and ConfigSkins_p is accepatable)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3136 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-25 13:49:45 +00:00
karlchenofhell
89a270757f - 3 more templates XHTML valid (had to remove all disabled <input>s if no blacklist was selected)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3135 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-24 13:47:04 +00:00
karlchenofhell
41bc31d2c2 - ConfigAdvanced_p => XHTML (no invalid IDs)
- removed unmappable characters from code

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3133 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-23 13:35:34 +00:00
orbiter
2aa6f978c2 fix for http://www.yacy-forum.de/viewtopic.php?p=29125#29125
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3129 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-23 01:54:28 +00:00
karlchenofhell
ecbd91fc77 - <br /> instead of <br> => valid
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3123 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-22 15:38:17 +00:00
karlchenofhell
4a1dd8ecc8 - final step for Advanced Settings pages to XHTML
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3121 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-22 15:11:14 +00:00
karlchenofhell
18c841b3c0 - fix for http://www.yacy-forum.de/viewtopic.php?t=3269 [don't put 2 template-expressions back-to-back => bug?]
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3120 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-22 13:37:48 +00:00
daburna
ce8cde6335 -updated languagefile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3116 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-22 11:17:48 +00:00
karlchenofhell
10528a0ced - hopefully last needed fix for indexControl_p (wrong property on "set")
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3115 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-22 00:53:40 +00:00
orbiter
1d2d1854b9 added size of rwi and urls to WatchCrawler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3112 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-21 21:33:35 +00:00
orbiter
8e3bd17554 adopted DetailedSearch page to new ranking options
- fixed bug http://www.yacy-forum.de/viewtopic.php?t=3265
- more attributes on page
- attributes can be set as default for main search page
- option to re-set the attributes to built-in values

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3109 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-21 03:09:46 +00:00
orbiter
2dbea612c9 fixed display bug for image search preview
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3107 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-20 23:31:57 +00:00
karlchenofhell
2beea44465 - fixed typo in IndexControl_p
- migrated some more pages to correct (X)HTML

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3106 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-20 22:14:45 +00:00
orbiter
0a050bc043 enhanced ranking
- redesign of data storage in plasmaSearchRankingProfile
- profiles are extended by new ranking parameters
- new RWI ranking parameters are considered during ranking
- appearance attributes (i.e. emphasised text) is now considered
- faster ranking
- some attributes that had been checked during post-ranking can now be
  checked during pre-ranking phase
- removed old ranking parameter on index.html page (will be replaced by profiles in the future)
- ranking can now consider appearances of media content
- snippet-loading for media types now work correctly (fetches only from the wanted media)
- ranking-profiles can be handed over the remote peers and apply there also
- re-search of same query with different domain now also re-triggers remote search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3105 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-20 15:44:29 +00:00
karlchenofhell
a44ef51a8b - first review of Settings_*.inc, IndexShare_p and IndexControl regarding XHTML
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3103 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-19 23:55:52 +00:00
orbiter
61798f0ae6 added option to distinguish between text crawl and media crawl
- for each crawl start, there is now a flag for text and media
- the localCrawl flag is superfluous
- added new crawl profiles
- if an image search is done, only media links are crawled for the snippets


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3100 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-19 03:10:46 +00:00
orbiter
6866bcd0e0 added missing file for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3099 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-19 00:29:45 +00:00
karlchenofhell
41d7e86299 - removed HTML from CacheAdmin_p.java in favour of the corresponding .html file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3098 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-19 00:07:47 +00:00
orbiter
c500178fd7 redesign of index creation interface
- the input remains in the IndexCreation menu point
- after pressing the submit button, the IndexingMonitor is called
- the code for creation of new indexing starts was moved to the indexingMonitor
- Existing crawl profiles can be monitored in the Indexing Monitor
- the code for creation of crawl profile data was shifted from indexing start to indexing monitor
- existing crawl profiles can be deleted on the crawl monitor page

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3095 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-18 02:56:32 +00:00
orbiter
febe6b114a design update of crawler monitor
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3094 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-18 01:18:28 +00:00
orbiter
40049e0635 fixed media search snippet flow
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3092 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-17 22:52:58 +00:00
rramthun
1a525710c1 *) cursor jumps now to searchbox on searchpages again
*) added missing private IP-ranges for APIPA/Zeroconf and 172.16.0.0–172.31.255.255
*) Changed some seed-download-errors to warnings

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3086 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-17 13:21:17 +00:00
orbiter
7ff86d6ba6 - image search now shows thumbnails (in bad order, but it works)
- repaired DHT selection

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3081 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-14 02:48:37 +00:00
rramthun
882ebf34fa *) Some enhancements to the statuspage, which save one point from the advanced config
*) ant clean now doesn't remove RPMs anymore

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3079 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-13 20:12:07 +00:00
orbiter
ee3d91cb6b print-out of links that result from contraint-filtering
in search result

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3078 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-13 01:39:34 +00:00
orbiter
28971da91c fix for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-12 02:51:59 +00:00
orbiter
e4570bffaf -implemented a specialized snippet-fetch for media content
-changed search result preparation for media search presentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3073 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-12 02:09:25 +00:00
orbiter
1377c53aa3 extraction of media links from search results
these links are mixed to the snippets for testing purpose
(a final version will handle this differently)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3069 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-11 01:31:23 +00:00
orbiter
fb9e0f0284 preparations for media snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3064 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-09 23:15:58 +00:00
orbiter
99664d6267 removed confusing proxy-statements
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3062 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-09 18:25:53 +00:00
orbiter
937ccd4e76 fix for snippet-generation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3060 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-09 02:13:43 +00:00
orbiter
bf0d820659 - added correct flagging of word properties
- added self-healing to database in case that wrong free-pointers exist
- added presentation of media links in snippets (does not yet work correctly)
- code cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3055 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-08 02:14:56 +00:00
orbiter
10d888e70c - added a media search for images, audio, video and applications
- new search options on search page
- new option in ViewInfo to display all links of a file
- enhanced collection data structure

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3054 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-07 02:40:57 +00:00
rramthun
25a64fe3da -windows-script echoes correct port-number now
-minor changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3053 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-06 17:27:44 +00:00
orbiter
a603c4d5e8 more code simplifications
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3052 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-06 13:13:55 +00:00
orbiter
9a85f5abc3 cleanup
- removed 'deleteComplete' flag; this was used especially for WORDS indexes
- shifted methods from plasmaSwitchboard to plasmaWordIndex

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3051 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-06 12:51:46 +00:00
orbiter
773ba1e91a - generalized object order handling
- controlled object order for all database tables
- migrated DHT position computation to correct base64-decoded values
  this also closed the 'gaps' in the dht positions

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3049 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-06 03:02:57 +00:00
orbiter
109ed0a0bb - cleaned up code; removed methods to write the old data structures
- added an assortment importer. the old database structures can
  be imported with
  java -classpath classes yacy -migrateassortments
- modified wordmigration. The indexes from WORDS are now imported
  to the collection database. The call is
  java -classpath classes yacy -migratewords
  (as it was)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3044 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-05 02:47:51 +00:00
orbiter
052f28312a removed assortments from indexing data structures
removed options to switch on assortments

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3041 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-02 19:34:59 +00:00
borg-0300
83cdf056c1 check for valid static IP
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3038 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-01 20:59:24 +00:00
orbiter
ad1e4aa88e added selection of audio, video, image and application resources
to search procedure. This function can currently not used through the
search interface, but only through remote search.

added accumulation of search attributes to enable the audio, video,
image and application selection.

fixed a problem with external URL representation generation


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3036 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-01 16:21:17 +00:00
orbiter
1697fa3dc0 added a 'more options' link to yacysearch page
(which referes to the index.html page with extended options activated)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3031 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-12-01 02:45:49 +00:00
daburna
ef999f5f31 -just a very small change. now translation works better
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3029 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-30 19:56:53 +00:00
orbiter
4ce590622f - more asserts
- better memory usage during remove in kelondroRowSet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3022 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-30 00:23:07 +00:00
orbiter
816698ad21 added access right control to wiki and changed access policy
- by default, only the admin is allowed to make changes to wiki pages
- the admin may allow changes to everybody

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3019 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-29 01:50:10 +00:00
orbiter
ceb9e3aa17 - enhanced parser: collection of audio, video, image and application links
- enhanced condenser: better handling of utf-8 and pre-formatted texts


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3017 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-28 15:00:15 +00:00
orbiter
b5a29e9651 - fix for snippets that are too short
- added keyword to snippet fetch to suppres removal of not-found snippet words (for debugging)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3009 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-25 00:38:09 +00:00
low012
f7176d2f6f *) cursor jumps to searchfield if Javascript is enabled
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3008 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-24 20:52:11 +00:00
allo
4cb688018d wikiAdmin Recht
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3006 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-24 11:32:00 +00:00
low012
29fa17bd40 *) simplified some code in wikiCode.java
*) deleted outdated text in Settings_p-html (see http://www.yacy-forum.de/viewtopic.php?p=28027)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3005 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-24 02:52:38 +00:00
orbiter
0a0c3edeb6 fixed a bug in index transfer
- the encoding within the new entry format for binary data was wrong
- the string parser of RWI receive had to be enhanced

added some mor debugging tools
- a target peer for index transfer can now be selected by typing in the peer name
- the RWI result list has an entry counter

enhanced routing
- if communication is between two peers that have the same IP address,
  the loopback address 127.0.0.1 is used instead the public IP
  to contact the peer

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3003 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-24 01:12:14 +00:00
orbiter
8fa4a01c38 added password check to url retrieval in FiewFile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3002 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-23 17:13:25 +00:00
orbiter
8e7215475b - extended ViewFile to use is as debugging-tool: you can now use the
post-parameter url to submit an url directly
- fixed some bugs in text parser (not all parts had been analysed)
- fixed a bug in remote search interface (could not handle constraints)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3001 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-23 15:47:19 +00:00
orbiter
30888e7a2f implementation of search constraints
Such constraints may formulate specific restrictions to web searches
This is implemented by scraping information for constraints from a web
page during parsing, and storing flags to the pages within the web index.

In this first step, only information for index pages ("index of", directory listings)
are scraped and stored in flags
- added new flag class kelondroBitfield
- added scraper method in condenser
- added bitfield structure for all scrape types (see also condenser)
- added bitfield structure for appearance locations (see RWIEntry)
- added handover protocol for remote search and index distribution
- extended kelondroColumn class to hold bitfield types
- added another search attribute on search page (index.html)
- extended search-filter to enable filtering of non-matching constraints
- set all new database types to be default
- refactoring: moved word hash generation to condenser class

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2999 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-23 02:16:30 +00:00
orbiter
49a83f99d9 - fix for wrong DHT ordering in DHT selection
- fix for http://www.yacy-forum.de/viewtopic.php?t=3112&highlight=

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2995 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-21 00:36:41 +00:00
low012
75915502ec *) Cursor will jump to textfield on http://localhost:8080/yacysearch.html when page is loaded if JavaScript is enabled. (No changed behavior if JavaScript is diabled.)
*) If text is entered in textbox on http://localhost:8000/yacysearch.html and user clicks on "Web Search" in top menu, text will appear in textfield on http://localhost:8080/index.html if JavaScript is enabled. (No changed behavior if JavaScript is diabled.)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2994 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-21 00:00:18 +00:00
orbiter
e55ef0df28 - automatic migration of old RWI entries to new format during remote search
if new collections are activated
- one more assert in RowSet, control of removeMarker

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2993 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-20 22:55:27 +00:00
auron_x
6cca0ee98d *) used regexp to recognize invalid peer-names
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2992 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-20 20:03:05 +00:00
orbiter
d66dbd0d65 bugfix for received number in transferRWI
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2989 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-20 15:38:11 +00:00
orbiter
f4b547dc13 limited index transfer to peer with version 0.486
this protects peers with version below 0.486 from new RWI objects
(which they cannot handle)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2988 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-20 02:46:53 +00:00
orbiter
e3d75f42bd final version of collection entry type definition
- the test phase of the new collection data structure is finished
- test data that had been generated is void. There will be no migration
- the new collection files are located in DATA/INDEX/PUBLIC/TEXT/RICOLLECTION
- the index dump is void. There will be no migration
- the new index dump is in DATA/INDEX/PUBLIC/TEXT/RICACHE

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2983 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-19 20:05:25 +00:00
theli
5c0669429e *) soap: adding function to query the peer list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2968 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-17 19:26:55 +00:00
orbiter
c9364246cc introduced new RWI-Object.
This will be used for the final version of the collections.
The new object is not yet used.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2966 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-17 14:17:20 +00:00
rramthun
fd1dcf0d9b - patch for dropdown-box on IndexCreate_p.html by Philipp Redeker
- YaCy updater v0.2: Runs not interactively anymore, but automatically. Some documentation on usage will be added later.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2964 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-16 20:03:07 +00:00
auron_x
400c86f2ad *) fixed possible div by zero
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2960 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-15 16:58:04 +00:00
orbiter
d34f10c63d some tests with reverse dns lookup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2954 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-12 00:28:10 +00:00
orbiter
497428c8ec refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2949 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-10 01:13:33 +00:00
(no author)
a51417d86b Bugfix: language of ConfigLanguage_p.html was not changed properly when a different language was choosen here
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2948 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-09 22:18:16 +00:00
orbiter
76fceb9997 refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2945 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-09 16:32:34 +00:00
daburna
794105f04a -replaced tags and updated translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2940 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-08 22:08:55 +00:00
orbiter
bb7d4b5d5e refactoring to prepare new RWI entry object
- moved all url and index(RWI) entries to index package
- better naming to distinguish RWI entries and URL entries


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2937 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-08 16:17:47 +00:00
auron_x
de6295d0ae *) added legend to "Connects" on Status.html via span-titles
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2929 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-06 21:29:55 +00:00
daburna
2788e7269d -translated WikiHelp
-small other changes
-please use <br /> instead of <br>!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2926 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-06 11:33:23 +00:00
orbiter
114a76a86e - added flag to urlhash that shows that domain is a local domain
- enhanced local domain detection
- bugfixing for memory assignment in kelondroFlexSplit
- automatic memory assignment to caches according to available RAM
- bugfixes for details during search process

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2924 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-06 02:05:39 +00:00
theli
bd3710a974 *) new xml template to view peer profile as xml
*) bugfix for wrong profile display (some fields where displayed twice)
*) new soap functions to get and set peer profile

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2919 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-05 16:26:25 +00:00
theli
d1afe1ce6b *) adding xml template to get the message list as xml
*) Bugfix in client stub jar generation (too many files where added)
*) new soap service to manage peer messages

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2918 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-05 15:18:33 +00:00
orbiter
8fdefd5c68 generalization of payload definition of index storage
this is one step forward to the migration to a new collection data format

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2912 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-05 02:10:40 +00:00
allo
a75f895884 memory and traffic informations
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2904 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-03 19:44:31 +00:00
daburna
78d65e128e -small changes to German translation
-changed <i> tags to <em>

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2897 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-02 20:45:19 +00:00
auron_x
f80a1304c2 *) check if xmx is greater or equal xms did not work in every case
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-11-01 18:42:48 +00:00
auron_x
62ad1476ac *) fix for missing picture-file, may be improved to support skins
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2880 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-29 17:21:04 +00:00
daburna
96604218eb -removed unused strings as suggested by Rostislav Svoboda (not all, but many)
-updated language file
-replaced <b> tags with <strong> tags

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2879 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-29 14:28:17 +00:00
orbiter
d3431433b0 more anonymization in logging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2876 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-28 22:28:33 +00:00
(no author)
5141fa5942 combinedVersionString2PrettyString(..) renamd to combined2prettyVersion(..), new parameter "computerName" added to indentify the source of problems
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2871 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-28 11:33:05 +00:00
(no author)
8c6e1531e6 a bugfix against empty paramter "user"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2870 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-28 01:20:10 +00:00
orbiter
78b7f6f7fd bugfix for index remove bug,
appeared after search where snippet-loading triggered word removal

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2869 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-28 00:22:10 +00:00
orbiter
147d88cf23 re-design of database caching
this should reduce IO a lot, because write caches are now actived for all databases
- added new caching class that combines a read- and write-cache.
- removed old read and write cache classes
- removed superfluous RAM index (can be replaced by kelonodroRowSet)
- addoped all current classes that used the old caching methods
- more asserts, more bugfixes


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2865 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-26 13:50:50 +00:00
allo
36f8b2c05a missing space :-(
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2864 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-26 10:30:03 +00:00
allo
63a2616eb7 -If you click on "Administration", you can log-in.
-better Linktext on Status.html


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2863 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-26 10:11:14 +00:00
orbiter
2a9d868f6d - removed object cache from kelondroTree
- generalized object caching and added new object caching class
- added object caching wherever kelondroTree was used
- added object caching also to usage of kelondroFlex
- added object buffering (a write cache) to NURLs
- added many assert statements; fixed bugs here and there
- added missing close methods to latest added classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2858 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-24 13:48:16 +00:00
theli
777e39cea0 *) new template to display the dir-listing in xml format.
This can e.g. be done by using the url http://localhost:8080/share/?format=xml

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2856 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-24 12:13:46 +00:00
allo
2ba56f70a8 XML-safe put.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2848 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-23 10:35:48 +00:00
orbiter
6a73d858de voting of surftipps can now be done with comments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2846 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-23 01:10:29 +00:00
allo
5a6488256d catch the "username too short" exception
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2844 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-22 21:40:16 +00:00
theli
ac13fa763a *) bugfix for blacklist remove (blacklist was not informed about remove)
*) adding new soap service class for blacklist management
*) new junit class to test soap blacklist service

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2841 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-22 08:32:55 +00:00
daburna
6251944012 -updated languagefile
-corrected little mistakes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2837 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-21 15:44:41 +00:00
allo
a831c83025 create servletProperties, with the servlet specific funktions from serverObjects
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2835 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-21 15:01:53 +00:00
allo
a17c43779f removed wrong part of template
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2830 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-20 14:50:57 +00:00
allo
27f9e0b1c6 xml interface for blacklists
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2829 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-20 14:47:18 +00:00
orbiter
06854988da - full integration of new LURL database in INDEX
- added migration method for urlHash.db into INDEX

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2819 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-19 21:14:37 +00:00
theli
52466067d8 *) Bugfix for ArrayIndexOutOfBoundsExceptions which occure because SimpleDateFormat is not thread-safe
See: http://www.yacy-forum.de/viewtopic.php?t=2995

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2810 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-19 08:33:53 +00:00
orbiter
b79e06615d - added new LURL.Entry class for next database migration
- refactoring of affected classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2802 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-18 22:25:07 +00:00
daburna
c97984bbac -corrected link and updated language file for simpleheader.template
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2799 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-18 18:41:46 +00:00
karlchenofhell
b14a500b88 - removed debug output from PerformanceMemory_p
- added URL escaping (tested, nevertheless watch out for possibly broken URLs)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2797 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-18 14:51:37 +00:00
karlchenofhell
ebf0da2a45 - now the fix http://www.yacy-forum.de/viewtopic.php?t=2974 works
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2796 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-18 12:07:17 +00:00
karlchenofhell
98a84ddb12 - reverted last change partly, can't handle the template system
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2793 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-17 22:22:36 +00:00
karlchenofhell
b5e40e2fa2 - fix for http://www.yacy-forum.de/viewtopic.php?t=2974 (no cache-sizes for new db)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2792 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-17 21:01:35 +00:00
daburna
6d1db21d0b -updated German language file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2790 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-17 11:08:06 +00:00
orbiter
77a59a115d refactoring of indexing methods
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2787 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-16 15:04:16 +00:00
orbiter
688cbfb776 - bugfixing for flextable bug
- bugfixing for collection index bug
- several other bugfixes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2785 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-16 00:27:25 +00:00
allo
74f09a0510 some more xml-backend files.
ConfigAdvanced_p.java: list settings after changing.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2784 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-15 21:41:47 +00:00
allo
a29b4d4fb5 extended Supertemplates for Headerincludes.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2780 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-15 13:43:46 +00:00
theli
3bebe72544 *) Default Rex.Exp. changed back to .*.*
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2778 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-15 08:37:19 +00:00
daburna
ea9411f9d2 -surftips now working correct
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2775 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-14 14:13:12 +00:00
theli
5b114249ce *) Bugfix for ViewLog problem with multiline logging messages
See: http://www.yacy-forum.de/viewtopic.php?t=2972

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2774 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-14 13:21:07 +00:00
daburna
a1736675ca -ups
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2769 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-14 11:19:43 +00:00
daburna
2de939f544 -updated translation
-removed wrong spelling; there is only 1 p in the English tip. I think the surftipps.java have to be updated.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2768 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-14 11:17:14 +00:00
auron_x
c628df43a4 *) removed unused image-file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2762 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-13 09:23:55 +00:00
orbiter
50f2578c55 - some bugfixing and code cleanup
- now assortments can completely left out if they do not exist
  before startup and collection index is selected.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2757 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-13 01:19:26 +00:00
orbiter
a5dd0d41af - refactoring of plasmaCrawlLURL.Entry to prepare new Entry format
- added test migration method to migrate the old LURL to a new LURL
the new LURL will be splitted into different tables for each month
this solves several problems:
- the biggest table in YaCy is splitted in different parts and can
  also be managed in filesystems that are limited to 2GB
- the oldest entries can easily be identified, used for re-crawl und
  deleted
- The complete database can be limited to a specific size (as wanted many times)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2755 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-12 23:14:41 +00:00
auron_x
e126598a0f *) small enhancement to webinterface, progressbars are now not stretched images, but <div>'s with colored background
-> all skin files were set to use green progressbars (should be changed to colors fitting the skins appearence)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2751 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-12 17:10:28 +00:00
rramthun
581dd2ec72 *)Proper arrow-function on Network.html, but ordering is still broken. Perhaps someone could fix that?
*)Removed double creation of DATA directory. New warning message in case of insufficient rights.
*) Removed roland-ramthun.de-seedlist temporarily, because of server changes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2747 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-11 18:27:38 +00:00
orbiter
918b59dc5e - bugfix for snippet profile (no delete button)
- bugfix for search process (avoided null pointer exception in case other peer does not respond)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2742 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-10 20:16:20 +00:00
orbiter
2bb529cedb added peer tags for peers in robinson mode
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2741 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-10 20:09:26 +00:00
low012
f7447894f1 *) fixed link to WatchCrawler_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2740 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-10 12:39:29 +00:00
orbiter
afbb547f3d extended options for abstracts generation in remote search interface
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2739 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-10 12:22:16 +00:00
allo
3730ec3440 moving to a _p page.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2738 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-10 10:31:21 +00:00