Commit Graph

70 Commits

Author SHA1 Message Date
orbiter
5fe828fa06 - replaced pdfbox and fontbox version 1.1.0 with 1.2.1
- added some clear statements that shall clear static cache size within the pdfbox library
- the pdfbox library contains a memory leak; it is unsafe to run a peer with pdf parser permanently on.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7120 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-09-07 17:13:47 +00:00
orbiter
72a096fccb using -XX:-UseGCOverheadLimit when starting java.
see also: http://forum.yacy-websuche.de/viewtopic.php?p=20709#p20709

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7108 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-09-05 14:19:02 +00:00
orbiter
b3f0d06444 fixed a problem with restarts in YaCy mac applications: the DATA directory path was not submitted when doing a restart. This solves the problem by:
- storing the startup properties when yacy is started
- using the properties in the restart-script again. this transports also the DATA directory location as parameter of the -gui option that is used when the Mac version of YaCy is started

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7102 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-09-03 23:08:43 +00:00
orbiter
698730c4eb better utf-8 support everywhere using a default utf-8 encoding for all string conversions.
todo: add this also for debian start script (how do I do that?)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7098 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-09-03 22:18:10 +00:00
lotus
93d2c22e60 adapted memory for first run to current standard values
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7079 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-08-27 18:38:02 +00:00
orbiter
ec72387165 added a very early test version of a YaCy gui component.
The gui currently does nothing else than providing a search window that sends the search string to the browser
The gui is started when YaCy is started with the option -g or --gui, like
./startYACY.sh -g
The gui will primary be used to provide a 'real' macintosh version that can be started and operated like any other macintosh application. A special mac application wrapper will follow.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7021 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-08-05 10:43:03 +00:00
low012
67dd376a33 *) hopefully solving ipv4/ipv6 issue described in http://www.yacy-forum.org/viewtopic.php?f=2&t=252&start=30#p1248 and http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2554
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6626 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 19:22:14 +00:00
orbiter
8df1694288 - added options to switch on/off search domains (text, image, audio, video, app)
- more memory by default


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6605 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:03:02 +00:00
orbiter
f6731c6240 more logging etc.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6589 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-17 00:41:50 +00:00
orbiter
267108470f testing jmx console for yacy:
- start YaCy with startYACY.sh -l
- open jconsole and open localhost:9999

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6484 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-11-18 14:54:30 +00:00
orbiter
a8ce192f63 - shifted main classes to new package net.yacy
- fixed some bugs in last commit

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6427 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-10-18 01:38:07 +00:00
orbiter
db1b030276 fixed class path in startup scripts; omitting old classes path; all classes are now in lib/yacycore.jar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6318 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-09-15 17:29:18 +00:00
orbiter
1ddaf16466 added generation of a yacycore.jar yacy library file:
when a ant dist is envoked, the release is built using the new yacycore.jar without the class files in classes
YaCy consists currently of two main parts: the YaCy core and the YaCy interface. This change will make it
possible to use the YaCy core as part of other projects.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6311 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-09-14 17:06:09 +00:00
low012
ae334c7b83 *) -l and -d enable asserts now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5923 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-05 18:49:51 +00:00
orbiter
d2ac0aa682 - fixed possible bugs in Stack (may affect Crawler reset) and RandomAccess handling
- increased default memory size to 180MB
- fixed possible bug in http client reset (there was a deadlock)
- bug in BOBHeap marked, but not solved, cause is still unknown.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5912 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-05-02 01:40:03 +00:00
f1ori
aaafe05c02 * revert debug change
* contains instead of startsWith, because there might me localizied strings
* decode punycode for every domainpart seperately (see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1749)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5516 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-01-24 00:33:38 +00:00
f1ori
5570fa817b * remove & from openBrowser command (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728&hilit=#p12321)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5515 6c8d7289-2bf4-0310-a012-ef5d649a1542
2009-01-23 22:37:00 +00:00
orbiter
78ad58cd42 the UseConcMarkSweepGC option caused a full CPU usage - bug on Darwin (Mac OS X)
but it was reported that the same option causes a good performance on Solaris
Therefore it is now only used if YaCy runs on solaris.
Pleas make comparisment tests with/without this option on linux and change start script
if it is obvious that the option causes the linux JVM to work better. (with Java 1.5 !)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5156 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-14 20:35:50 +00:00
danielr
73519cbdca fixed pid-file for linux start-script
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5090 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-27 19:18:38 +00:00
f1ori
04310a7255 * added long options and help-option to linux startscript
* redirect all error messages to /dev/null


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5078 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-25 17:17:01 +00:00
danielr
f9a715dc33 simplified Linux start-script
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5064 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-20 07:57:47 +00:00
danielr
59c4e35aaf corrected LargePages-detection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5049 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-10 13:03:36 +00:00
low012
f825e88a09 *) large memory pages will only be used if start script can confirm that Linux supports them or that the OS is Solaris, this should eliminate all sorts of weird behavior including not working shutdown
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5048 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-10 12:02:11 +00:00
danielr
785688ef82 - creating pid-file under linux
- added modified init-script (using startYACY.sh instead of doing the same thing)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5017 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-24 18:56:29 +00:00
orbiter
f8af00d7e8 added some experimental jvm startup properties which helped the metager peer to get more stable.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4931 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-15 21:41:46 +00:00
danielr
c5d1d7faca undo wrong commited files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4685 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-04-12 15:22:57 +00:00
danielr
2617f4dcdb Connections_p.html: better formatting and remove very old entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4684 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-04-12 15:19:18 +00:00
danielr
9d0af17c5b removed debug from startYACY.sh *ups*
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4578 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 13:02:39 +00:00
danielr
bf3e5807b0 fixed typo and remove redundant code from startYACY.sh
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4577 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-17 12:51:46 +00:00
orbiter
7150b463ff changed handling of default values and database paths:
- the default files yacy.init and for the network definition is now moved to the path defaults
- the httpProxy.conf is renamed to yacy.conf
- the DATA/INDEX/PUBLIC is renamed to the actual network nickname, which should be freeworld or sciencenet
more menu entries
- added apfelmaennchens alternative search page to the menu
- added the new thread dump page to the server log menu point as submenu
modifications
- modified the thread dump page: sorting by thread type

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4575 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 22:31:54 +00:00
low012
ce8adf9907 *) *NIX start script displays the right port number now instead of always displaying 8080 no matter what the port is set to
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4521 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-01 12:08:24 +00:00
orbiter
efd5807a7c - some renaming of variables to support DC
- initial 120mb RAM for fresh peers
- release 0.57

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4445 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-04 22:58:40 +00:00
low012
0856cabb37 *) fixed typo that caused log being written to console under Ubuntu and OpenSolaris, probably also fixes problem with FreeBSD
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4416 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-01-29 21:27:06 +00:00
low012
0e27febe47 *) fixed more links
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4068 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-09-01 11:24:23 +00:00
low012
0339c65ee2 *) note to myself: Just because it works with Linux and most of it works with OpenSolaris does not mean the whole thing works with OpenSolaris. Being lazy never pays off!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4018 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-07-31 20:41:54 +00:00
low012
507afa7d6e *) start script should be POSIX compliant now, solution as suggested by Fuchs in http://forum.yacy-websuche.de/viewtopic.php?t=203
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4008 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-07-29 15:29:49 +00:00
low012
d36786bf37 *) startYACY.sh is compatible with OpenSolaris now (see http://forum.yacy-websuche.de/viewtopic.php?t=203 for details)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4007 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-07-27 21:56:49 +00:00
orbiter
40b0547611 - documentaton changes (removed old forum links)
- different handling of link quotation
- different handling of link normalization
- enhanced html/unicode en/de-coding

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3993 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-07-19 15:32:10 +00:00
low012
93a898f1f0 *) skripts are compatible with Sun Solaris 10 now, OpenSolaris has not been tested yet (http://www.yacy-forum.de/viewtopic.php?p=37345#37345)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3910 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-06-17 21:19:00 +00:00
karlchenofhell
d114a0136e - crawl profile: don't add null-values
- added some settings and statistics for url-fetcher 'server'-mode
- added own stack for fetchable URLs
- added possibility to fill stack via shift from peer's queues, via POST (addurls=$count and url$num=$url) or via file-upload
- added "htroot" to classpath of linux start-script

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3370 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-02-17 19:16:53 +00:00
allo
d98420a563 fix for startscript
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3160 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-03 20:54:14 +00:00
karlchenofhell
a27e884a8c - fixed http://www.yacy-forum.de/viewtopic.php?p=29488
- some HTML-stuff

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3153 6c8d7289-2bf4-0310-a012-ef5d649a1542
2007-01-02 23:16:18 +00:00
theli
d83f453fce *) dont display stderr messages while running in background
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2764 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-13 12:12:30 +00:00
allo
a723c2809d -t(aillog) option, to start monitoring the log after startup. So you see the log, but can stop viewing it with ctrl+c, without stopping yacy.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2697 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-02 16:00:04 +00:00
allo
fda7031991 further cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2696 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-02 15:52:20 +00:00
allo
f0ed7f43c4 more sh (i.e. /bin/dash instead of /bin/bash as sh) compatibility
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2695 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-10-02 15:29:52 +00:00
allo
cbfba2026d removing the prefix option.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2370 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-08-09 17:51:20 +00:00
allo
d7e8e7da1e more flexible classpath in linuxscript
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2335 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-07-26 20:21:24 +00:00
allo
4435d916d4 print-only option for use in other scripts.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2334 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-07-26 18:22:14 +00:00
rramthun
748971112e typos
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2037 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-04-24 13:15:42 +00:00