Commit Graph

5030 Commits

Author SHA1 Message Date
danielr
8422ee5ec4 - fixed UnsupportedEncoding (in proxy) using defaultCharset if no characterEncoding can be determined
- serverFileUtils.copy* use now Charset instead of String
- added some warnings for ignored exceptions


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5043 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-09 12:00:31 +00:00
hermens
3ac1988059 Add some sanity checks for invalid seeds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5042 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-08 13:56:29 +00:00
hermens
cff4393f0c Fix HTCache so oldest Files get deleted first
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5041 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-08 08:06:06 +00:00
danielr
31d97f2b9f replaced httpd.parseMultipart() by a 'right' implementation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5040 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-08 01:40:28 +00:00
danielr
621b473b18 * removed some warnings of findbugs (http://findbugs.sf.net)
- removed unnecessary code (unused variables, String.toString)
- corrected some calculations (cast int to double or long ;)
- improved little performance (using Integer.valueOf() instead of new Integer)
- log if some File-actions fail (mkdir(), delete(), ...) and some ignored exceptions
- finalized some (more) fields
- finally close some streams
- made inner classes static if not using environment
- generalized some equals (from specificClass to Object)
- fixed some potential nullpointer accesses


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5039 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-06 19:43:12 +00:00
lotus
5627ca1c60 * rename yacy.nsi to build.nsi
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5038 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-06 19:32:55 +00:00
f1ori
d72846f898 * moved nsisant library in seperate libbuild-directory to keep root directory clean
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5037 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-06 17:02:56 +00:00
apfelmaennchen
3f871b57de - again an error in defaults/autoReCrawl.conf
- you have to delte or edit DATA/SETTINGS/autoReCrawl.conf to fix this problem, sorry!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5036 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-05 18:57:25 +00:00
apfelmaennchen
0500b1179e added a 2 min start up delay to serverBusyThread autoReCrawl to avoid a Null Pointer Exception...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5035 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-05 05:50:15 +00:00
apfelmaennchen
3b6229d2f3 small fix - parseBoolean doesn't recognize 1 and 0 as true and false in autoReCrawl.conf
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5034 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-04 21:57:57 +00:00
apfelmaennchen
e1574fe02e - added autoReCrawl folders to bookmarks (DATA/SETTINGS/autoReCrawl.conf)
- the serverBusyThread checks folders every 60 min. (==> autoReCrawl_idlesleep in yacy.conf)
- added option to create bookmarks from CrawlStart URL

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5033 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-04 20:43:36 +00:00
orbiter
ebb40d324b enhanced memory chart: shows now also the size of the word cache as third vector.
The PPM is now shown without a scale, but with a new anotation at the chart entry.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5032 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-04 10:47:26 +00:00
danielr
17b7845eb5 * refactoring
- moved constants from plasmaSwitchboard to own class (all 232 ;)
- moved remoteProxy-Methods to httpRemoteProxyConfig, better names
- removed some unnecessary code (else-statements)
* formatting (correct indentation)
* minor bugfixes (due to findbugs.sf.net)
* hopefully fixed "missing quote" (announcing StringParts as UTF-8)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5031 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-02 13:57:00 +00:00
danielr
3bb870bfcd added final where possible
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5030 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-02 12:12:04 +00:00
lotus
7e92484400 fix for open browser on windows 2000
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5029 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-01 12:58:36 +00:00
f1ori
b0724e5ec0 * add config option to disable cookie monitoring (disabled by default)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5028 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 21:19:06 +00:00
lotus
f0dfb858d8 reverted balloon messages from r5014. don't try to annoy the user. ;)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5027 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 07:42:02 +00:00
lotus
cafa1a952f - performance settings refactoring: made headlines to fieldsets
- show performance profiles more prominent for easier configuration

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5026 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-30 07:37:11 +00:00
f1ori
6952b13c08 * fix automatic decrementing accepted remote crawl limit:
-> http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1355


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5025 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-29 18:52:48 +00:00
f1ori
d02a26d642 * added lock icon to ConfigAppearance menu item
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5024 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-28 21:09:19 +00:00
lotus
0b2f67577e Index Transfer:
- fix for chunk size calculation
- fix: if chunk size was 1, an infinite selection loop ran because no entries were found. if chunk size fails <=3 it will be set back to 500

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5023 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 18:53:51 +00:00
f1ori
0baa8d651e * marked some text as labels for checkboxes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5022 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 11:39:42 +00:00
lotus
694084c570 fix for NPE on shutdown
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5021 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 06:59:56 +00:00
lotus
f9fb2d0fee hide memory tables by default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5020 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 06:59:24 +00:00
lotus
5f77f55ed7 possible fix for negative speed values
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5019 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-27 06:58:35 +00:00
danielr
79dba5445d init-script: fixed some variables to general defaults
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5018 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 19:04:35 +00:00
danielr
785688ef82 - creating pid-file under linux
- added modified init-script (using startYACY.sh instead of doing the same thing)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5017 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 18:56:29 +00:00
orbiter
50ef5c406f - refactoring of robots parser (removed opaque Objects[] result vector)
- added Allow-component to robots result object

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5016 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 11:54:37 +00:00
danielr
7913bdb75b Flextable: filename in errormessage if inconsistent
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5015 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 08:22:36 +00:00
lotus
d42eae25f8 yacyTray:
fix for unproper shutdown
some messages

installer:
start shortcuts minimized

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5014 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 06:49:30 +00:00
danielr
7cec908813 dont't show HTTPC debug messages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5013 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-23 17:08:40 +00:00
orbiter
5f41913043 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1347&hilit=&p=9216#p9216
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5012 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 21:52:51 +00:00
orbiter
c3d461d191 - removed superfluous copyright statement
- updated my email address

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 17:14:51 +00:00
orbiter
3ca98fee42 removed superfluous copyright statement
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 00:21:07 +00:00
danielr
c049d80fbd fixed login problem with yacy as proxy (POST and Cookies)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5009 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-19 15:10:00 +00:00
lotus
62afea0c9f some improvements for yacyTray
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5008 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-18 14:17:52 +00:00
danielr
af616a92ff fixed welcome message above image on custom search page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5007 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-18 13:41:06 +00:00
danielr
7c110e07f0 removed debug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5006 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-16 12:39:38 +00:00
danielr
10d01fdd0d addendum to 5002
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-16 09:47:48 +00:00
danielr
eadc204130 gzip POST wiederholbar gemacht (macht transferURL stabiler)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5004 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-16 09:46:25 +00:00
danielr
d14e8d348f - times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5003 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-15 17:35:02 +00:00
lotus
28c39e2aa4 fix for new starter files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5002 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 18:41:11 +00:00
danielr
b63a519456 fixed build problem
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5001 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 17:44:49 +00:00
danielr
e12438142e - warning instead of NPE if urlHash is not in index of CrawResults
- times of LOCAL_SEARCH are shown in milliseconds


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 09:12:58 +00:00
lulabad
5784070f6e added user agent
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4999 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 08:38:11 +00:00
lulabad
3e26aca356 added startYACY_debug.bat to dist Target
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4998 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 20:32:28 +00:00
lotus
fa695c2d9f tray is now only shown on Windows and doesn't block on linux
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4997 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 19:03:38 +00:00
lotus
d77ed28e2f temporary disabled tray because of flaws on only-shell-linux
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4996 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 08:41:39 +00:00
lotus
adeb881288 fix for building Windows installer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4995 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 08:17:20 +00:00
lotus
b704cf1fbc * no need to update the searchpage links anymore
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4994 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-13 07:55:20 +00:00