danielr
4b71912e76
fixed wrong class name
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4894 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-06 17:13:31 +00:00
danielr
7feae906aa
- organize imports
...
- removed potential null pointer accesses
- removed unnecessary casts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-06 16:01:27 +00:00
det
f597185026
Initial import of the resource observer framework
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4892 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-06 13:10:21 +00:00
orbiter
c10eaf9bdb
- fix for pop-up page upon first start
...
- added comments in opensearchdescription to explain fast mode
- release 0.59
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4890 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 20:46:31 +00:00
danielr
d3037c2950
Accept all SSL-certificates (not only valid and self-signed), but put a warning into log file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4888 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 15:21:43 +00:00
orbiter
e0e7f86f82
some bugfixes for the peer-ping process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 12:52:27 +00:00
danielr
cbe722c480
small code cleanUp
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4884 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 12:41:55 +00:00
orbiter
b21598bdd0
- enhanced handling of own IP address inside seed
...
- prevention of false information of own IP address
- enabled searching before an own IP address is assigned (before first ping happened)
- removed warning about limited search function
- added better time-out settings for peer-ping process (10 seconds complete, 5 seconds for back-ping)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 11:01:20 +00:00
orbiter
40d7f485f3
- fixed several NPE bugs
...
- fixed loosing of own seed hash (hopefully)
- fixed a bug with crawl start s beginning with (bookmark) files
- added better IP recognition during hello process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4882 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-04 22:24:00 +00:00
orbiter
2f381b8d7a
- fixed at least two causes for a NPE after a use case switch.
...
A large refactoring was neccessary
- added another crawl start option: automatic restriction to sub-path
- removed crawlStartSimple and renamed crawl start expert
to crawl start (without expert)
- some changes to texts in crawl start
- added some more deletions when an web index is deleted:
delete also queues and robots cache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-04 21:34:57 +00:00
orbiter
2a604b7402
added superfast search result computation which can be obtained for local search when snippet fetching is disabled. An example search for the rss interface would be:
...
http://localhost:8080/yacysearch.rss?query=yacy&Enter=Search&contentdom=text&count=10&resource=local&verify=false
(just add "&verify=false")
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4878 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-03 23:06:01 +00:00
orbiter
9bef20b537
- added cleanup for unused server loggings: they are removed after the client had not been seen since one hour
...
- removed configBasic popup trigger when no password is set
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4875 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-02 21:49:59 +00:00
orbiter
5f35ba6f05
added a list for content of the brute-force registration hashtable in access tracker
...
the purpose of this list is not only to view attempts from read attacks, but also to show if the
yacy-yacy protocol is working with respect to the bug that was fixed with SVN 4869
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4873 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-01 21:21:38 +00:00
orbiter
74e3a547db
more logging for mySeed loading error cases
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4871 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-01 11:24:46 +00:00
orbiter
6f1a3fce05
BF Bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4869 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-29 17:27:38 +00:00
lotus
b09af53643
proper links to directories in repository dirlisting
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4867 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 19:23:44 +00:00
lotus
ba4091c5b2
proxy sends status code now
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4860 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-27 13:11:06 +00:00
orbiter
1a1841392c
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4859 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-26 22:55:55 +00:00
orbiter
698293ef32
fix for lonely peers in networks with only one peer, especially intranet peers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4858 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-26 20:48:14 +00:00
orbiter
8a0e401320
- fix for bad code in peer actions
...
- fix for bad images in basic config
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4854 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-25 22:56:28 +00:00
orbiter
0b52ef3e4b
- update of grafics
...
- check for startsWith("127.") instead of equals("127.0.0.0")
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4853 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-25 20:30:37 +00:00
orbiter
18ad12eceb
added another fix for localhost addresses in seeds
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4852 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-25 18:41:56 +00:00
orbiter
11e00a0849
- refactoring of seedURL handling
...
- additional check for seedURL pointing to localhost: deny such peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4851 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-25 18:35:38 +00:00
orbiter
e91bf4c8cc
- fix for bad reset of index / bad index location after deletion
...
- some modification of rssTerminal window location and size
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4850 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 21:30:22 +00:00
lotus
f284386b63
update deploy improvements for windows - ready for release now :-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4849 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 20:03:11 +00:00
f1ori
fd8bd5d0d1
* fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1176 (encoding issue)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4848 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 16:12:16 +00:00
orbiter
25192e0d36
added a deletion button to indexControlRWIs that deletes the complete web index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4847 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 12:30:50 +00:00
orbiter
01b3e9431a
- fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1140&p=7626#p7626
...
- less dots for ppm bar in watchcrawler (one dot for each 10 ppm)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4846 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 11:30:16 +00:00
orbiter
8be462986e
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1174&p=7841#p7841
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4845 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 11:04:44 +00:00
orbiter
f8b015949c
fix for bug in html scraper that appears if opening and closing tag are not both in same case
...
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1173&p=7836#p7836
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4844 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 10:47:22 +00:00
orbiter
d8277e6af1
- added parsing of numeric html entities for crawler
...
- fixed a bug in search response
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4843 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 10:26:24 +00:00
low012
f06c046f6c
*) refactoring (several instances of Indetificator can be created and used parallel now)
...
*) fixed a potential NPE
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4841 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-23 18:12:44 +00:00
orbiter
0c173821fd
more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4838 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-23 09:45:33 +00:00
lotus
eac62a6882
* ported restart on Windows to unix-style, works on _noconsole now
...
* removed Win9x scripts from build for more tidiness and less decisions for newbies
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4835 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-22 15:48:51 +00:00
orbiter
03438ee977
added missing implementation of network-path reference
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4834 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-22 00:08:14 +00:00
orbiter
2ba7914f0b
fix for NPE exception while fetching remote crawl jobs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4833 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-21 23:07:37 +00:00
lotus
4a48717017
* automatic update for windows
...
pleas disable before release because 2nd update fails at the moment
and commandline handling has to be improved for windows
* update via new unTar class
please review stream- and exceptionhandling because I'm fairly new to Java
maybe it can be done concurrent
* updated windows startscripts to values from yacy.init
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4832 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-21 15:23:56 +00:00
orbiter
faed00d75d
added use cases to basic configuration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4831 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-20 13:21:55 +00:00
orbiter
4229cd275c
fixed several details about network switching, default password, random password and localhost authentification
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4830 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-20 09:29:01 +00:00
orbiter
d9d1c8de70
more protection against remote shutdown attacks: prevent loading using the crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4829 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-19 23:05:19 +00:00
orbiter
c1d721dd2d
fix for attacks on localhost-authorized peers from web pages with links to localhost addresses:
...
checking of referer in access
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4828 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-19 22:17:53 +00:00
orbiter
6aa9bf43f9
fixed server port change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4826 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-19 20:51:09 +00:00
low012
a7dadf7f2f
*) first version of a way to determine the language a text is written in (not perfect, but it works)
...
*) statistical data of languages can be found in the *.lng files in the new directory called "langfiles"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4824 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-18 21:24:05 +00:00
orbiter
1127d62b64
some enhancements to the access tracker (less synchronization)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4812 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-16 23:33:59 +00:00
orbiter
56a300f92a
bugfix / local-search predicate
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4811 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-16 21:17:55 +00:00
orbiter
2f29ab8779
more target server access security
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4809 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-16 19:50:28 +00:00
orbiter
3bd1db776a
implemented switch for admin authorization from localhost:
...
- access is granted for localhost users to administration pages by default
- the default setting can be changed in the BasicConfig.html page
- if the BasicConfig page was accessed with post and no password was submitted, a random password is generated
- a headless installation MUST give a password upon first call of the configuration page, otherwise they will not be able to access it again
- if no password is given within 10 minutes after start-up, a random password is generated
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4804 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-15 11:26:43 +00:00
orbiter
cfe6790498
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
...
from the ConfigNetwork online interface
- to make this possible, a large refactoring and reorganisation of data structures was necessary
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4803 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-14 21:36:02 +00:00
orbiter
78087da287
- changed seed file storage to clear text
...
- fixed kill script
- fixed saving of seed file (had been corrupted by latest changes)
- some refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4799 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-14 20:30:44 +00:00
orbiter
5fde679acb
- fixed problem in performance configuration
...
- extended rss fetch size for rssTerminal
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4798 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-13 15:28:55 +00:00