Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,601 Commits 1 Branch 20 Tags 836 MiB
0727bb1e63
Commit Graph

2952 Commits

Author SHA1 Message Date
det
0727bb1e63 rework of console message handling; add of debugging output 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4914 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-11 18:43:12 +00:00
lotus
43c47218ef fox for open browser on Windows 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4912 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-11 10:18:01 +00:00
orbiter
f5ef7f222e - fixed a bug in parser (directory paths had not been recognized) 
- no access check when a search is made only local without snippet fetch
- added comment and status message in resourceObserver (this takes very long at startup time!)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4911 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-11 09:54:58 +00:00
lotus
ed24eab737 small fix for windows in resource observer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4909 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-10 19:19:54 +00:00
hermens
75b4a5ced4 reinstate old timeout values for transferRWI and transferURL 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4903 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-07 23:48:46 +00:00
orbiter
3330181aa0 refactoring: 
find a better way to store BLOBs; generalize current BLOG data structure (kelondroDyn)
and prepare it to replace it with something better. The best candidate is the kelondroHeap,
which will become the kelondroBLOBHeap;
removed also some never-used classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4902 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-07 23:12:24 +00:00
orbiter
9a9737a54e fix for "no more elements available" exception 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4901 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-07 22:07:25 +00:00
lotus
260553c3a5 better messages 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4897 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-07 14:24:11 +00:00
det
6afeb535cd another bugfix for the windows drive check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4896 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-07 12:51:07 +00:00
det
b416af7568 bugfix for the windows drive check 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4895 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-06 20:38:09 +00:00
danielr
4b71912e76 fixed wrong class name 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4894 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-06 17:13:31 +00:00
danielr
7feae906aa - organize imports 
- removed potential null pointer accesses
- removed unnecessary casts


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4893 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-06 16:01:27 +00:00
det
f597185026 Initial import of the resource observer framework 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-06 13:10:21 +00:00
danielr
d3037c2950 Accept all SSL-certificates (not only valid and self-signed), but put a warning into log file 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4888 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-05 15:21:43 +00:00
orbiter
e0e7f86f82 some bugfixes for the peer-ping process 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-05 12:52:27 +00:00
danielr
cbe722c480 small code cleanUp 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-05 12:41:55 +00:00
orbiter
b21598bdd0 - enhanced handling of own IP address inside seed 
- prevention of false information of own IP address
- enabled searching before an own IP address is assigned (before first ping happened)
- removed warning about limited search function
- added better time-out settings for peer-ping process (10 seconds complete, 5 seconds for back-ping)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-05 11:01:20 +00:00
orbiter
40d7f485f3 - fixed several NPE bugs 
- fixed loosing of own seed hash (hopefully)
- fixed a bug with crawl start s beginning with (bookmark) files
- added better IP recognition during hello process


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-04 22:24:00 +00:00
orbiter
2f381b8d7a - fixed at least two causes for a NPE after a use case switch. 
A large refactoring was neccessary
- added another crawl start option: automatic restriction to sub-path
- removed crawlStartSimple and renamed crawl start expert
   to crawl start (without expert)
- some changes to texts in crawl start
- added some more deletions when an web index is deleted:
   delete also queues and robots cache


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-04 21:34:57 +00:00
orbiter
2a604b7402 added superfast search result computation which can be obtained for local search when snippet fetching is disabled. An example search for the rss interface would be: 
http://localhost:8080/yacysearch.rss?query=yacy&Enter=Search&contentdom=text&count=10&resource=local&verify=false
(just add "&verify=false")

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-03 23:06:01 +00:00
orbiter
9bef20b537 - added cleanup for unused server loggings: they are removed after the client had not been seen since one hour 
- removed configBasic popup trigger when no password is set

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4875 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-02 21:49:59 +00:00
orbiter
5f35ba6f05 added a list for content of the brute-force registration hashtable in access tracker 
the purpose of this list is not only to view attempts from read attacks, but also to show if the
yacy-yacy protocol is working with respect to the bug that was fixed with SVN 4869

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-01 21:21:38 +00:00
orbiter
74e3a547db more logging for mySeed loading error cases 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-06-01 11:24:46 +00:00
orbiter
6f1a3fce05 BF Bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-29 17:27:38 +00:00
lotus
b09af53643 proper links to directories in repository dirlisting 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4867 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-28 19:23:44 +00:00
lotus
ba4091c5b2 proxy sends status code now 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4860 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-27 13:11:06 +00:00
orbiter
1a1841392c small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-26 22:55:55 +00:00
orbiter
698293ef32 fix for lonely peers in networks with only one peer, especially intranet peers 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4858 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-26 20:48:14 +00:00
orbiter
8a0e401320 - fix for bad code in peer actions 
- fix for bad images in basic config

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-25 22:56:28 +00:00
orbiter
0b52ef3e4b - update of grafics 
- check for startsWith("127.") instead of equals("127.0.0.0")

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-25 20:30:37 +00:00
orbiter
18ad12eceb added another fix for localhost addresses in seeds 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-25 18:41:56 +00:00
orbiter
11e00a0849 - refactoring of seedURL handling 
- additional check for seedURL pointing to localhost: deny such peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4851 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-25 18:35:38 +00:00
orbiter
e91bf4c8cc - fix for bad reset of index / bad index location after deletion 
- some modification of rssTerminal window location and size

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4850 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 21:30:22 +00:00
lotus
f284386b63 update deploy improvements for windows - ready for release now :-) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4849 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 20:03:11 +00:00
f1ori
fd8bd5d0d1 * fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1176 (encoding issue) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4848 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 16:12:16 +00:00
orbiter
25192e0d36 added a deletion button to indexControlRWIs that deletes the complete web index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4847 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 12:30:50 +00:00
orbiter
01b3e9431a - fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1140&p=7626#p7626 
- less dots for ppm bar in watchcrawler (one dot for each 10 ppm)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4846 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 11:30:16 +00:00
orbiter
8be462986e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1174&p=7841#p7841 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4845 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 11:04:44 +00:00
orbiter
f8b015949c fix for bug in html scraper that appears if opening and closing tag are not both in same case 
see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1173&p=7836#p7836

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4844 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 10:47:22 +00:00
orbiter
d8277e6af1 - added parsing of numeric html entities for crawler 
- fixed a bug in search response

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4843 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-24 10:26:24 +00:00
low012
f06c046f6c *) refactoring (several instances of Indetificator can be created and used parallel now) 
*) fixed a potential NPE


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4841 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-23 18:12:44 +00:00
orbiter
0c173821fd more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4838 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-23 09:45:33 +00:00
lotus
eac62a6882 * ported restart on Windows to unix-style, works on _noconsole now 
* removed Win9x scripts from build for more tidiness and less decisions for newbies

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4835 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-22 15:48:51 +00:00
orbiter
03438ee977 added missing implementation of network-path reference 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4834 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-22 00:08:14 +00:00
orbiter
2ba7914f0b fix for NPE exception while fetching remote crawl jobs 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4833 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-21 23:07:37 +00:00
lotus
4a48717017 * automatic update for windows 
pleas disable before release because 2nd update fails at the moment
and commandline handling has to be improved for windows
* update via new unTar class
please review stream- and exceptionhandling because I'm fairly new to Java
maybe it can be done concurrent
* updated windows startscripts to values from yacy.init

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4832 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-21 15:23:56 +00:00
orbiter
faed00d75d added use cases to basic configuration 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4831 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-20 13:21:55 +00:00
orbiter
4229cd275c fixed several details about network switching, default password, random password and localhost authentification 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4830 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-20 09:29:01 +00:00
orbiter
d9d1c8de70 more protection against remote shutdown attacks: prevent loading using the crawler 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4829 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-19 23:05:19 +00:00
orbiter
c1d721dd2d fix for attacks on localhost-authorized peers from web pages with links to localhost addresses: 
checking of referer in access

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4828 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2008-05-19 22:17:53 +00:00