1556 Commits

Author	SHA1	Message	Date
orbiter	e9aadb2e11	quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2041 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-25 15:21:17 +00:00
theli	727aac4768	*) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem ... See: http://www.yacy-forum.de/viewtopic.php?p=20358 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2039 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-25 05:29:20 +00:00
theli	cd4aeffea2	*) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly ... See: http://www.yacy-forum.de/viewtopic.php?t=2265 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2036 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-23 11:01:31 +00:00
theli	a10072b5c0	*) Adding timeout to ftpc.java ... See: http://www.yacy-forum.de/viewtopic.php?t=2268 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2035 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-23 10:35:46 +00:00
theli	76ea16a6cb	*) Removing Keep-Alive header (is also a hopByHop header) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2034 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-22 15:00:35 +00:00
orbiter	b0036249c1	added some attributes to network picture ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-21 21:21:35 +00:00
hermens	cbcf7418ef	Cleanup synchronization in plasmaWordIndex ... - only synchronize when changing data in more than one database see: http://www.yacy-forum.de/viewtopic.php?t=2167 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2031 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-20 14:00:47 +00:00
orbiter	60e5aff9fc	some enhancements to the remote crawl trigger ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2030 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-20 11:53:15 +00:00
orbiter	dbe96e6541	added hand-over of search filter and prefer ranking to yacy protocol ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-20 10:15:00 +00:00
rramthun	0604203bce	Updated and corrected German language file ... Changed Italian language file for an Italian/English interface and not Italian/German git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2024 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-18 11:37:03 +00:00
low012	4639c0ac6d	*) cleaned up code ... *) fixed a bug where a line like <pre><pre>text</pre></pre><pre>text</pre> caused an exception *) fixed a bug where a line like [=[=text=]=][=text=] caused an exception git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2023 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-17 19:37:09 +00:00
orbiter	00a5d435e2	- fixed some bugs with domain filter ... - added new ranking filter "prefermask": urls that match the filter are ranked better git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-13 23:19:36 +00:00
orbiter	14d6e476c9	tried to solve some problems with new picture viewer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-10 22:34:47 +00:00
low012	23cdf319be	*) cleaning up code ... *) fixed a bug concerning [= =] and <pre></pre> in tables git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2018 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-10 22:04:52 +00:00
orbiter	9324425165	fix for remote crawl reject ... see http://www.yacy-forum.de/viewtopic.php?p=20075#20075 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2017 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-10 21:34:17 +00:00
borg-0300	30e4fc39a5	HTCache extended ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2015 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-08 13:05:04 +00:00
orbiter	d0dd8b14d2	fixed picture tag and presentation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 22:09:59 +00:00
borg-0300	da6a8bafa2	rename currCacheSize -> curCacheSize; ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2010 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 13:15:15 +00:00
borg-0300	92110aea32	nullpointer fix for profile(); other minor change; ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2009 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-07 12:43:59 +00:00
orbiter	f0833b0328	introduced simple search interface ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 21:48:24 +00:00
orbiter	bd283b8443	fixed bugs: ... - null pointer exception during startup of a robinson-configured peer - wrong time calculation of default value of re-crawl option git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-06 16:28:28 +00:00
orbiter	47b541b2d1	added better option handling in yacysearch ... added depth option for image presentation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-05 10:34:24 +00:00
orbiter	c9e16bfd48	first try to insert image search (does not work yet) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 23:12:10 +00:00
orbiter	f77775220b	fixed parser error ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1999 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 22:28:46 +00:00
auron_x	0bf2eb4813	*) fixed Blog updating timestamp on edit (now always keeps creation-date) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 15:10:59 +00:00
orbiter	22de954a57	added some log output to parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1996 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 15:01:21 +00:00
orbiter	83e0e765ec	redesigned some parts of the html scanner & parser ... to better support image tags git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-04 14:36:01 +00:00
orbiter	ac114d69c0	tried to fix some problems with time-outs during search ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1994 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 23:26:08 +00:00
orbiter	e2e8d0c188	some kind of refactoring of yacysearch: ... made 'room' for new picture search result presentation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 22:47:59 +00:00
orbiter	6b63e26cbb	- removed search function from index.html/java, only imput left ... - added media fetcher/crawler class (not ready yet) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-03 15:36:53 +00:00
orbiter	bc3e80fe42	quickfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1990 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 23:03:17 +00:00
orbiter	d8d0ac29c3	added image-viewer servlet that can do: ... - each image that is requested is stored in the cache - the image is taken from the cache if exists there - the image can be scaled The purpose of creation a scaled image is because of copyright problems In a further stept the retrieval of not-shrinked images is restricted to either access from localhost or with given authentication This servlet can be used for image-preview purpose after an image search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 22:59:53 +00:00
orbiter	ddc6394d9b	fixed bug about auto-depth 0 ... see http://www.yacy-forum.de/viewtopic.php?p=19751#19751 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1988 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 21:30:04 +00:00
orbiter	60351fa3f7	small fix to previous commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1987 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 20:52:34 +00:00
orbiter	a469874e3f	added and fixed time-out behaviour during search ... see also: http://www.yacy-forum.de/viewtopic.php?p=19823#19823 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1986 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 20:40:07 +00:00
orbiter	1d0b0d6e2a	synchronized local searched to prevent that several searches are performed at the same time ... see also: http://www.yacy-forum.de/viewtopic.php?p=19761#19761 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1985 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-04-02 18:51:18 +00:00
hermens	22b9d03bbf	Correcting remaining time issue in getContainers ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1984 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-31 09:52:55 +00:00
orbiter	5defe97ccb	fixed a problem / possible bug with ordering implementation (did not rotate always) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1983 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-31 00:07:56 +00:00
orbiter	d58788b753	added some synchronisation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1982 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-30 15:38:46 +00:00
orbiter	e566d1d8d6	some bugfixes regarding new crawling options ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1980 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-28 22:54:36 +00:00
orbiter	c7f1300300	-fixes for last commit ... -some more ranking attributes (comments only) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1979 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-28 15:37:45 +00:00
orbiter	f2421f6a47	some small attribut changes regarding cache flush ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1974 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-27 23:14:04 +00:00
orbiter	7a650d0023	several bugfixes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1971 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-27 16:45:29 +00:00
borg-0300	245cc34d51	small fix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1969 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-26 18:21:41 +00:00
borg-0300	e2853f357d	added more lowercase to url normal form generation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1968 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-26 17:43:36 +00:00
orbiter	59d52fb4a9	fixed some problems with crawl profiles ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-26 14:52:01 +00:00
orbiter	4a5b5515b5	added a lowercase to url normal form generation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1966 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-26 12:01:00 +00:00
allo	44d72f06c4	more Caching ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 15:08:27 +00:00
allo	918445a2f4	Bugfix for last commit. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 14:34:27 +00:00
orbiter	708cc6c8d9	fixed some bugs for auto-filter and added monitor in profile list ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-24 00:38:40 +00:00
allo	c58789177f	bookmarkCache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 21:33:09 +00:00
rramthun	250864406f	... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1955 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 20:24:53 +00:00
rramthun	42b0b10a95	-Adding Windows Media to types which are not sended compressed ... -Renaming writeandzip to writeandgzip to avoid confusion about type of compression -Adding new startup message to windows script -The usual language "enhancements" ;-) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 20:12:23 +00:00
allo	2ed4fa96b7	tagCache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1952 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 19:04:05 +00:00
allo	330eb9c74f	bookmarkDB cleanup ... (preparation for tagCache) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1951 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 17:56:32 +00:00
orbiter	e82899ba57	fixed missing urls map initializer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1950 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 16:13:23 +00:00
orbiter	63f39ac7b5	added 3 new crawling steering options: ... - re-crawl by age of page (enter in minutes) - auto-domain-filter - maximum number of pages per domain NOT YET TESTED! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-23 16:05:16 +00:00
orbiter	1fc3b34be6	some pre-work (without function yet) to implement: ... - re-crawl (by age of last crawl) - auto-crawl-filter by crawl depth (to be explained..) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 15:28:17 +00:00
theli	c9e6b5e391	*) check size of indexing-queue and crawler pool before processing remote triggered crawl jobs ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1946 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 14:19:03 +00:00
orbiter	1509314ea6	set tighter control during DHT index and peer selection ... see http://www.yacy-forum.de/viewtopic.php?p=19329#19329 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1945 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 13:54:35 +00:00
hydrox	fcc0683200	*) undoing last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1944 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 09:01:25 +00:00
hydrox	9411961eec	*) another little fix for DHT-Transfer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1943 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-22 08:49:39 +00:00
borg-0300	77f3237de3	adapted for isListed() ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1942 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-21 20:55:59 +00:00
hydrox	8b14a0c833	*) little fix for DHT-Transfer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1941 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-21 10:35:57 +00:00
orbiter	1f4412a146	adopted isListed to discussed new behavior as discussed (url, getFile) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-20 22:31:59 +00:00
orbiter	59fc55ea1e	added checks to protect peers from wrong seeds ... see also: http://www.yacy-forum.de/viewtopic.php?p=19249#19249 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1939 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-20 20:31:51 +00:00
orbiter	063ef4660a	bug? ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1936 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 22:06:15 +00:00
orbiter	82358677a9	added another shiftK2W to flushCacheSome ... this should fix the bug that the DHT cache is not flushed if there is no indexing git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1935 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 21:33:31 +00:00
orbiter	128e4ab199	- in serverSystem: maxPathLength is now a variable, not a method ... - upon startup the calculated maximum path length is shown git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1932 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 01:33:20 +00:00
orbiter	a37b09e303	implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1931 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 01:27:33 +00:00
orbiter	30e3e3a0fd	adopted MAXPATHLENGTH to host system capabilities ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1930 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-19 00:29:27 +00:00
borg-0300	d808765087	something Javadoc ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1929 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 21:47:04 +00:00
borg-0300	85bb8e32a1	Bugfix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1928 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 19:05:56 +00:00
borg-0300	3fe402069f	try to fix ... see: http://www.yacy-forum.de/viewtopic.php?p=19175#19175 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1927 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 18:51:52 +00:00
orbiter	f16f1f15cd	bugfix for 100% CPU bug; thanks to Matthias for analysis ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1926 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 16:14:24 +00:00
borg-0300	254a13efd9	MAXPATHLENGTH used ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1925 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 15:20:50 +00:00
borg-0300	8865948e4e	Cleanup; ... Methode replaceRegex added; Constant MAXPATHLENGTH added; git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1923 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 13:34:32 +00:00
orbiter	6c70f4a0cf	renamed wordHashes for a word hash set generation to wordHashSet ... This was done because the wordHashes iterator will get another integer parameter and then conflicts with the wordHashes set generation git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 01:04:16 +00:00
orbiter	d5f8f40c31	removed correcting iterator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1920 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 01:01:00 +00:00
orbiter	526407f32e	adoptions, fixes for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1919 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-18 00:21:34 +00:00
orbiter	488a0ed580	replaced old keyIterator and rowIterator by buffered iterators ... that are synchronized with database access Main change is done in kelondroTree, other classes are only adoptions git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1918 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 23:43:24 +00:00
hermens	4e9a8f41fd	rwiDBCleaner + dbImporter: Iterate over small excerpts of ... word hashes instead of the whole DB especially while changing the DB in the process. see http://www.yacy-forum.de/viewtopic.php?p=19136#19136 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1917 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 23:39:10 +00:00
hermens	474379ae63	remove TABs from plasmaDbImporter.java ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1916 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 21:52:36 +00:00
orbiter	dba02f399f	starting of re-design of kelondroTree iterator ... - new access to iterator - added many IOException handling in other Classes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 20:52:43 +00:00
orbiter	f02b426073	made kelondroTree.nodeIterator private ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1910 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 18:10:48 +00:00
borg-0300	5f6fdf1786	Bugfix for getCachePath(URL url) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1909 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 16:39:29 +00:00
orbiter	303b6463a8	added debug line to URL storage for testing ... see http://www.yacy-forum.de/viewtopic.php?p=19129#19129 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1908 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 16:30:31 +00:00
orbiter	431a4f3609	eliminated correcting iterator in kelondroTree ... VERY EXPERIMENTAL! NOT TESTED! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1907 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 14:20:04 +00:00
orbiter	91dca2cd8d	fixed a bug in last commit: LURL entries cannot be written, ... because a stored property was not set to false (but true) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1906 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 13:07:34 +00:00
orbiter	3286b1f498	re-organisation of lurl-creation and -stacking ... this was necessary to prevent useless write to the database in case of blacklist appearance of the url git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-17 10:16:07 +00:00
orbiter	9cca36a107	no more strict comparator checking in map exclude method if not needed ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1901 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 22:46:32 +00:00
orbiter	0b903c5317	removed usage of kelondroNaturalOrder from plasmaCondenser to experimental ... exclude cause of a 100% bug. see http://www.yacy-forum.de/viewtopic.php?p=19076#19076 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1900 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 22:26:04 +00:00
orbiter	4239db0d1c	fixed new ordering for backup iterator TreeSet ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1899 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 22:20:28 +00:00
borg-0300	399538b7de	Bugfix: wrongly compared ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1898 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 20:57:06 +00:00
orbiter	33eba5ecb8	temporary disabling last change, does not work (cannot debug right now) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1896 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 16:50:56 +00:00
orbiter	f0464042fc	fix for latest iterator-replacement-fix: ... iterator generated TreeSet which did not resprect rotations this has now be implemented using kelondroOrder Objects and by adding this rotation-rules to the ording git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1895 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-16 16:44:29 +00:00
borg-0300	ec21c585cb	try to fix path too long ... see http://www.yacy-forum.de/viewtopic.php?p=19079 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1893 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-15 20:16:15 +00:00
orbiter	a6a3f4b694	fix for svn 1888 ... this is a redesign of the no-iterator solution git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1892 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-15 16:01:42 +00:00
hydrox	8da13088e9	*)removed multiple DHT_Distribution_Threads ... *)boosted DHT_Distribution sending chunk parallel to multiple peers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1890 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-15 11:27:43 +00:00
orbiter	283a7181c6	try to fix new 100% cpu bug, possibly caused by iterator method ... see http://www.yacy-forum.de/viewtopic.php?p=18900#18900 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1888 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-14 23:22:49 +00:00
theli	34c075c1c7	testcommit with subversive ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1886 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-14 08:54:44 +00:00
orbiter	f588c0724f	removed cache flush in case of DHT receive ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1885 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-13 23:23:45 +00:00
orbiter	e94b374d56	update to cache flush method ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1884 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-13 23:06:06 +00:00
orbiter	bcd99fe83e	introduced a second RAM cache for DHT transfer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1880 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-13 10:43:12 +00:00
hydrox	360a460da8	*)URL-Cleaner: moved logging-statement to correct position ... *)plasmaURLPattern: host is now added to the hashset in lowercase git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1879 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-12 18:08:48 +00:00
orbiter	02f9765013	quickfix for time problem during cache restore ... see http://www.yacy-forum.de/viewtopic.php?p=18810#18810 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1878 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-11 21:55:32 +00:00
orbiter	69d26045eb	quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1876 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-10 20:45:14 +00:00
allo	b3df5ce2b8	another local iprange ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1875 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-10 18:34:53 +00:00
hermens	ad119f06af	*) Don't overwrite new entries with older ones ... see: http://www.yacy-forum.de/viewtopic.php?t=2015 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1874 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-10 16:28:01 +00:00
orbiter	be88687d8c	fixed some problems with new cache flush karenz ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1873 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-10 13:57:30 +00:00
theli	d3da7c9a08	*) Adding support for robots Allow directive ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1872 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 14:03:54 +00:00
theli	734d18f283	*) more correct robots.txt validation ... - isDisallowed now uses getFile instead of getPath git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1870 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 13:04:57 +00:00
hydrox	f046e1814a	*fix or last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1869 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 12:35:50 +00:00
hydrox	c55c51e2a8	*)added keywords to IndexCleaner_p.java ... *)updated Logging git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 12:23:05 +00:00
theli	f0ad0d2b2b	*) better robots.txt support ... - previously rules for all crawlers and special rules for yacy where combined using AND. Now the general rule will be ignored if there is a special rule for yacy (according to rfc) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1867 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 12:19:46 +00:00
orbiter	ddbeda738e	added minimum age of word in cache to performance menu ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 11:31:17 +00:00
orbiter	f188611fc6	apply blacklist on rwis during dht receive ... very experimental! git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1865 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 10:46:02 +00:00
theli	915812f597	*) Undoing robots parser policy changes from svn rev. 1421 ... - crawling is not allowed if server returned a 403 statuscode (according to rfc) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-09 10:17:37 +00:00
orbiter	0ec28b8f8e	added DBCleaner from Hydrox ... see http://www.yacy-forum.de/viewtopic.php?p=18093#18093 The servlet is now named IndexCleaner_p. See http://localhost:8080/IndexCleaner_p.html The Servlet was adopted to fit in the overall architecture git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1863 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 22:06:11 +00:00
theli	5ee0125046	*) adding possibility to configure the server port for seed uploading via scp. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1861 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 16:34:05 +00:00
allo	2065138a41	reverted last Commit. ... @Orbiter: kannst du dich dann mal drum kümmern, wenn ich versuche die ganze Sache ans Laufen zu bringen, hast du jedesmal was dagegen. Dann mach du es bitte, du wirst ja wissen was du willst... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1860 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 13:35:38 +00:00
allo	7afa5c1b8e	staticIP fix ... tried to solve http://www.yacy-forum.de/viewtopic.php?p=18663#18663 D 2006/03/08 07:08:20 YACY yacyClient.publishMySeed mySeed error - not proper: IP is not proper: -UNRESOLVED_PATTERN- git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1859 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 12:23:26 +00:00
theli	fb4100d47b	*) undoing last commit. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1856 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 07:59:32 +00:00
theli	a84cc71218	*) removing getTotalRuntime ... - not needed anymore git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1855 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 07:37:21 +00:00
low012	1965a8cf70	*) bugfix for previous commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1853 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 00:38:39 +00:00
low012	1c3b415c35	*) nicer anchors (TOC) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1852 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-08 00:24:49 +00:00
low012	6000a38a05	*) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1851 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 23:58:30 +00:00
auron_x	dce08771d1	*) Fix for wrong estimated and elapsed times when import was paused ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1850 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 22:51:18 +00:00
hermens	b34713324a	DBImport: remove words from source index even if nothing has been added to home index ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1849 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 22:19:39 +00:00
orbiter	3237fe1cc7	added IOException for httpc client error ... see also http://www.yacy-forum.de/viewtopic.php?p=18615#18615 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1842 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 19:38:10 +00:00
orbiter	520b60f15b	fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1841 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 19:28:06 +00:00
theli	c7ececbfb2	*) httpd.mime: adding jar mimetype ... *) httpd.java: charset is only appended to mimetype for text mimetypes git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1839 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-07 15:58:50 +00:00
orbiter	ae536c4608	fixed soap service: index.soap -> yacysearch.soap ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1827 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-05 15:28:40 +00:00
orbiter	bae3783d38	added a snippet marking ... (search words are now bold in snippets) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1823 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-05 01:11:06 +00:00
orbiter	f0a38873eb	* added yacysearch page with better view on search results ... the old search page is obsolete and will be removed * ConfigBasic.html is now the default page instead of index.html as long as no password is set git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1815 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-04 18:52:04 +00:00
orbiter	f0041d504d	remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1811 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-04 00:10:49 +00:00
auron_x	b92a00172e	*) modified Blog ... - added delete-option - fixed displaying of admin options git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1805 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-03 16:47:41 +00:00
allo	68ec572df0	bugfix for staticIP ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1803 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-03 16:24:21 +00:00
theli	89286478e7	*) removing thread pool eviction for now. Not needed at the moment ... See: http://www.yacy-forum.de/viewtopic.php?p=18290#18290 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1801 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-03 09:09:36 +00:00
theli	759800f543	*) Bugfix for storeHTCache problem ... - content was not indexed if storeHTCache was off See: http://www.yacy-forum.de/viewtopic.php?p=18269 See: http://www.yacy-forum.de/viewtopic.php?t=1882 See: http://www.yacy-forum.de/viewtopic.php?t=241 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1800 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-03 08:30:08 +00:00
orbiter	a4682e2810	fixed problems in basic config and added language setting ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1799 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-02 22:25:46 +00:00
orbiter	a8548c0484	* several bugfixes regarding basic configuration ... * extended number of search target peers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1794 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-01 23:24:57 +00:00
orbiter	1b9b8922d9	* fixed problems with new basic 1-2-3 configuration (now authentication required) ... * fixed graphics problem * fixed some other problems with default values * 1-2-3 config now appears automatically on start-up if no password is set * added new config menu * moved profile to new config menu git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1792 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-01 22:27:20 +00:00
auron_x	8c6f38fe70	*) added Blog to YaCy (atm not reachable through interface) -> Blog.html ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1790 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-01 07:40:25 +00:00
orbiter	c51603a405	added two new kelondro classes that will handle the new index data structures (not used yet) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1789 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-03-01 00:25:02 +00:00
orbiter	ce5274c194	yacybot user agent ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1786 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-28 19:08:58 +00:00
allo	3b7e66ab48	staticIP should now work ... (with resolved Conflict) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1785 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-28 12:31:57 +00:00
theli	8558000bd9	*) better handling of port forwarding ... - button is disabled if libx is not installed - bugfix for disconnect git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1782 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-28 09:50:56 +00:00
allo	32d4c3e4c6	static IP is proper ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1779 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-28 08:57:20 +00:00
orbiter	f96238e9be	cosmetic ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1778 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-27 22:25:27 +00:00
low012	d6cc0ec3d8	*) Fixed a bug: Images in tables were not displayed if alt or align attributes were added. ... *) Align for images only accepts valid parameters (bottom, top, center, middle, left , right) now. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1775 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-27 12:33:34 +00:00
hermens	351bd0a678	*) dbImport: convert cacheSize to kb when creating plasma* objects ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1773 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-27 01:58:37 +00:00
orbiter	eaffcfefe2	* added more ranking attributes (without function; this will be added later) ... * added ranking coefficient transmission to remote peer (without evaluation on server side, will be added later) * changed ranking coefficients slightly git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1770 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-26 11:30:37 +00:00
orbiter	87e90b9d8c	refinements in ram cache flush procedure and default timing ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1768 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-25 21:05:19 +00:00
orbiter	d31a4e0b4f	some small enhancements with cache flushing parameters and data structures ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1767 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-25 16:10:31 +00:00
orbiter	3703f76866	- fixed re-search bug: after a search with several words, a second search could not ... find the same words as before. This was caused because indexContaines stored the url references with a hashtable. A tree was needed to work with the index conjunction-by-numeration - added permanent ram cache flush (again) - removed direct flush of ram cache after a large container is added. this happens especially during DHT transmission and therefore this fix should speed up DHT transmission on server side. - removed unused and out-dated methods git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1765 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-25 08:42:45 +00:00
theli	fbbbf5f411	*) remote trigger for proxy-crawl ... - remote crawling can now be enabled for the proxy crawling profile See: http://www.yacy-forum.de/viewtopic.php?p=17753#17753 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1758 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-24 09:35:54 +00:00
low012	f31b633b2e	*) Fixed yet another small bug in the wiki. (no blank between image URLs, align and alt) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1755 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-24 01:50:29 +00:00
low012	8bdbf0dfff	*) Fixed a bug in code for tables and hopefully eliminated XSS vulnarability which Allo pointed out to me. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1754 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-24 01:14:38 +00:00
theli	dc9174c809	*) Implementing snippet fetching via ajax ... Snippets that are not available on page load time will be fetched using ajax requests. see: http://www.yacy-forum.de/viewtopic.php?p=16479 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1748 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-23 13:29:07 +00:00
theli	468ca5b0e6	*) Bugfix for url.toString problem in yacyClient crawlOrder ... Thanks to Stephan for the advice git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1737 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-22 07:18:27 +00:00
low012	62d0f7a334	*) added TOC for pages in wiki as requested in http://www.yacy-forum.de/viewtopic.php?t=1987 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1734 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-22 00:53:14 +00:00
orbiter	1d8ca6e082	serialized dhtChunk deletion with indexing ... The dht selection, transmission and deletion is now completely serialized with indexing git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1731 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 23:08:07 +00:00
allo	ff476c19a5	tuning User.html ... FIXED: Now admin can logout ADDED: Nice Progressbar, representing your remaining onlinetime. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1727 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 15:51:09 +00:00
low012	2e8221050a	*) removed redundancy, no changes in functionality ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1725 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 12:24:44 +00:00
theli	2336f0f013	*) allow pausing/resuming of crawlJob Threads separately ... - pausing/resuming localCrawls - pausing/resuming remoteTriggeredCrawls - pausing/resuming globalCrawlTrigger See: http://www.yacy-forum.de/viewtopic.php?t=1591 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1723 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 11:18:48 +00:00
allo	af1da090bb	blogRight in UserDB. ... Look at the Fileshare, for how to use it. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1722 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 09:45:09 +00:00
borg-0300	2ee5796e76	added keywords, properties; ... change '\n' -> '\r\n' git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1720 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-21 00:30:38 +00:00
orbiter	60dac4325e	serialized indexing with dht selection ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1719 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 23:57:50 +00:00
orbiter	a840755964	moved parts of index transfer logic back to switchboard ... this is needed to merge the dht selection with the indexing thread git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1718 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 23:27:11 +00:00
orbiter	134253a603	fixed bug with cache flush ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1717 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 23:25:48 +00:00
borg-0300	149409ba5c	move description -> javadoc ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1716 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 23:15:39 +00:00
borg-0300	00975359c5	added keywords, properties ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1715 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 22:57:42 +00:00
orbiter	c2d863855d	different flush limit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1713 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 22:21:53 +00:00
borg-0300	64441b1f78	ADDED: yacy.badwords list to filter the topwords ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1711 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 17:50:42 +00:00
allo	d7da273d7e	using ArrayList instead of Vector ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1710 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 07:42:41 +00:00
allo	d6f7bd44ae	fix for public tags ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1709 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 06:34:44 +00:00
orbiter	f9063e2040	added some synchronization to avoid that several tasks can trigger a cache flush simultanously ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1708 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-20 00:06:03 +00:00
orbiter	2c4e4ae6a2	further refactoring of dht selection, transfer and flushing ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1707 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 23:47:45 +00:00
orbiter	73dad68cf1	outsourced thelis DHT flush class into own file ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1706 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 21:54:46 +00:00
allo	aa4b04e3dd	reverted last change ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1705 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 19:05:46 +00:00
allo	467216d4c7	bugfix for umlaute and html-specialchars in wikiCode ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1704 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 18:54:38 +00:00
allo	4b0dae8fcf	added a possiblity to get the ranking values for an url. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1703 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 11:08:06 +00:00
orbiter	85ac7d8386	* moved DHT transfer thread to own class file, needed for further modularization ... * changed status handling * added forced cache flush when cache has containers with too high number of index entries git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1702 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 01:36:42 +00:00
orbiter	34341a868e	code cleanup ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1701 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 00:39:16 +00:00
orbiter	7df2e6e571	bugfix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1700 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-19 00:35:23 +00:00
orbiter	cd41e9a0eb	moved DHT index selection to new object that holds indexes to be send away to other peer. ... This was made to make it possible that RWI selections can be serialized with indexing. Serialization will be implemented in another step. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1698 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 19:34:16 +00:00
allo	e3dd67bba0	bookmarks import. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1697 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 17:49:24 +00:00
allo	dda143df79	We NEED this here for the XML-Files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1696 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 14:57:25 +00:00
theli	42a5f56723	*) Bugfix for broken dht thread configuration ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1695 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 14:51:01 +00:00
allo	bfd37e34aa	using other XML Parser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1693 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 12:00:13 +00:00
theli	aa87df35e1	*) To avoid confusion location will now also be displayed for own peer ... See: http://www.yacy-forum.de/viewtopic.php?p=17283#17283 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1692 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-18 10:27:56 +00:00
rramthun	15ed57f9b7	Updated German language, by VT100, NN, rramthun ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1690 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 21:23:45 +00:00
allo	0b5a736280	bugfix for nullpointer on unparsable date. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1688 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 19:40:01 +00:00
allo	f503df04f8	sort the Bookmarks with newest First. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1686 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 18:14:11 +00:00
allo	3b4a99ff6a	fix for java 1.4.x ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1685 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 17:55:13 +00:00
theli	651bce8e2f	*) adding missing function to transmit url chunks for crawl-order jobs ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1680 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 11:04:35 +00:00
theli	f95d98142f	*) displaying amount of items in the existsIndex caches ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1679 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 11:02:01 +00:00
theli	9b941fb773	*) bugfix for usage of yacy with extended port binding (e.g. #eth0:8080, 192.168.0.1:8080, etc.) ... - port was reported incorrectly to other peers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1678 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-17 10:53:20 +00:00
allo	2d4e1325cf	UTF-8 fix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1676 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 21:33:41 +00:00
hydrox	e2af2a3f45	*) it's now possible to run more then one indexDistribution-Thread ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1673 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 15:22:25 +00:00
theli	40dd6ec4fd	*) experimental restructuring of db import function ... - trying to reduce IO load by avoiding unnecessary db access - trying to presort url list git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1671 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 13:07:01 +00:00
hermens	c8f5adea4d	- don't send Message Body on HEAD requests, even in the case of an error ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1669 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 11:45:32 +00:00
theli	a7248fbb0a	*) bugfix for http/0.9 responses ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1668 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 11:07:17 +00:00
theli	2da18ab359	*) correcting logging output ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1667 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 10:56:17 +00:00
theli	a354bc2ec1	*) Bugfix for content length check ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1666 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 10:54:47 +00:00
theli	8ffc6e35ad	*) correcting logging output ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1665 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 10:28:54 +00:00
hermens	e974d0cb99	Improve compliance to rfc ... *) There is no status line in HTTP/0.9 *) Answers to HEAD requests should return the same headers as a GET request git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1664 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 10:27:21 +00:00
theli	556d242be0	*) Limited support of content-range requests ... - a simple continue download request should work now git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 09:23:27 +00:00
theli	8fcb25f9f9	*) Setting via header according to rfc ... - can be disabled via settings dialog git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 09:20:57 +00:00
theli	980e986b64	*) Re enabling short cycle for already removed nurl entries ... See: http://www.yacy-forum.de/viewtopic.php?p=17147#17147 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1660 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-16 06:59:34 +00:00
orbiter	218cd6561c	fixed problem with wrong hash length in file share ... see: http://www.yacy-forum.de/viewtopic.php?p=16565#16565 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1658 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 22:12:53 +00:00
orbiter	56516fd8e6	added refresh parser to htmlFilterContentScraper ... * getRefreshSeconds() - number of seconds until refresh * getRefreshPath() - url path See also: http://www.yacy-forum.de/viewtopic.php?p=16851#16851 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1657 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 21:55:15 +00:00
orbiter	ba5fe0b287	fixed (again) nullPointerException in kelondroTree ... see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 21:33:10 +00:00
allo	e6c2f700b1	public Tagview ... IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 14:35:30 +00:00
allo	672b384fc7	refactoring setTagsTable and setBookmarksTable. ... preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 13:16:10 +00:00
theli	040624e361	*) better support for http head requests of servlets ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1648 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 12:51:24 +00:00
theli	62ffb5ece0	*) httpdFileHandler.java: adding real streaming support for lage files ... - avoid to read the whole file into memory - support of chunked transfer-encoding for http/1.1 clients - support of gzip content-encoding suitable clients See: http://www.yacy-forum.de/viewtopic.php?p=17058#17058 *) MessageSend_p.html: better highlighting of peer response/status messages git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1646 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-15 12:31:52 +00:00
hermens	3b6328ad02	*) Consistent use of minCount for index transfer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1645 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 22:50:13 +00:00
orbiter	0017812b2e	bugfix for null compare ... see http://www.yacy-forum.de/viewtopic.php?p=16980#16980 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1644 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 22:18:45 +00:00
allo	b137c90015	BugFix for too long Usernames. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1642 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 20:19:40 +00:00
allo	9d6bae77ee	the best PPM ever! ;-p ... Now stopped indexingstop is recognized as 0 PPM. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1641 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 17:29:46 +00:00
hermens	0b60b9bf51	*) Remove entries from AssortmentCluster before reinserting the rest into the ramCache ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1640 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 13:06:32 +00:00
hydrox	8ab1d6ff4b	*) fixed NullPointerException in plasmaWordIndexEntity ... See: http://www.yacy-forum.de/viewtopic.php?t=1921 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1638 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 11:40:36 +00:00
allo	a26574c894	Migration from tagName as key to wordhash(tagName) as key for bookmarkTags.db ... (just deleting the old db, rebuildTags does the rest) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1637 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 10:00:12 +00:00
theli	eeba8b055e	*) guessing, testing and suggesting alternative hostnames on "unknown host" error ... See: http://www.yacy-forum.de/viewtopic.php?t=1879 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1636 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 09:55:09 +00:00
orbiter	7eb10675b3	re-organization of index management ... this was done to be prepared for new storage algorithms git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1635 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-14 00:12:07 +00:00
allo	a8a5ad959a	using TAG_NAME for getFriendlyName() and the lowercaseversion for getTagName() ... Removed TAG_FRIENDLY_NAME git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1634 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-13 21:27:50 +00:00
allo	73f18ed5b2	git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-13 14:42:19 +00:00
allo	bc6d400b03	bookmarktags with wordhashs. ... to Come: Migration please test this...1) backup bookmarks.db 2) delete bookmarksTags 3) test it... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1626 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-13 08:38:32 +00:00
allo	addc802cf3	workaround for kelondro Umlaut-Problem. ... his will only fix öäüÖÄÜß ...just do not use other special chars ;-) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1621 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-12 15:18:46 +00:00
allo	fb5c387368	XML import works. ... Please backup your bookmarks.db before trying it, i had many kelondro errors while importing del.icio.us xml-Files git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1620 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-12 14:51:04 +00:00
allo	a4513523d6	hide add/edit/import bookmarks per default. ... xml-bookmark import (this does not work, yet) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1619 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-12 14:03:56 +00:00
orbiter	1e4578aab6	VERY EXPERIMENTAL removal of index ram cache flushing thread. ... The cache will fill up and flushed explicitely when it is full. This shall remove double-access of assortments (indexing and flush) during indexing process. Hopefully this should reduce IO. The main idea is: the cache shall mainly be flushed by DHT transfer, and only indexes that shall be hosted by the own peer are flushed to the assortments. This needs further work. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1617 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-11 23:19:01 +00:00
theli	44996afd79	*) Bugfix for handling of http/0.9 clients. ... - nothing was send as response git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1610 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-11 15:21:04 +00:00
orbiter	01c668fe1b	experimental disabling of db write buffer ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1605 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-11 11:31:44 +00:00
hermens	954f02d22e	*) Bugfix: Prevent wordIndex.getContainer() from returning and even manipulating ... the containers from the ram cache. Return a new container instead. *) Speedup flushFromMem by reducing the number of searches in the TreeMap git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1604 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-11 03:15:14 +00:00
orbiter	4438a96b87	tried to fix "Object type or Object type combination not supported" bug ... see http://www.yacy-forum.de/viewtopic.php?p=16588#16588 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1592 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-09 22:32:18 +00:00
orbiter	c70befbe9c	added xml read/write example file: kelondroXMLTables ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1591 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-09 22:16:46 +00:00
allo	27b6b3d714	public Tags. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1589 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-09 20:08:45 +00:00
hydrox	a627162f13	*)fixed logginglevel for Debugmsg ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1585 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-09 09:10:49 +00:00
orbiter	fe39493145	changed default ranking parameters ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1582 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-09 00:23:54 +00:00
allo	5ef57211a6	trim was just too easy... ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1579 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-08 18:48:38 +00:00
allo	38e79aec94	Fix for wrong(?) httpheader: ... " pragma: no-cache" (IIS specific?) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1578 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-08 18:06:26 +00:00
allo	a8eff9a0ae	xml/bookmarks/posts/all.xml to list all public Bookmarks ... bookmarksIterator now accepts an option, if you want all(with private) or only public bookmarks. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1577 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-08 17:13:27 +00:00
allo	d04e7d724e	fix for deleting tags. ... string2vector should return an empty vector on "" git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1576 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-08 16:37:05 +00:00
orbiter	365a3fff8e	fixings for ranking attributes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1569 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-07 23:16:46 +00:00
orbiter	785763d070	added debug output for "Object type or Object type combination not supported" bug. ... See also: http://www.yacy-forum.de/viewtopic.php?p=16306#16306 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1568 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-07 22:48:22 +00:00
theli	2a88232cee	*) Bugfix for httpd security but ... - authentication was only required for html files. See: http://www.yacy-forum.de/viewtopic.php?p=16510 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1563 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-07 06:54:23 +00:00
orbiter	8e55098b74	fixed detailed search ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1562 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-06 23:13:54 +00:00
theli	ebc5b1eafb	*) adding a servlet that can be used to generate a Firefox search-plugin for yacy.logging ... - You can access this servlet via YaCySearchPluginFF.html - The generated search plugin has the name YaCySearchPluginFF.src git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1555 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-06 14:41:59 +00:00
orbiter	0cb940a8e5	added detailed search. ... ranking profiles do not work properly yet git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1551 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 23:38:00 +00:00
orbiter	c695928f7c	adopted search page to new detailed search (to be commited later) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1550 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 22:51:37 +00:00
orbiter	45323e7b76	fixed null pointer exception during search ... see http://www.yacy-forum.de/viewtopic.php?p=16429#16429 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1547 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 14:59:30 +00:00
allo	1fce0ea263	xml api for deleting bookmarks. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1546 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 14:54:07 +00:00
allo	6b16c13b20	showing the public/privat flag. ... TODO: Some nice icons. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1545 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 14:03:33 +00:00
rramthun	49647583b2	language update ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1544 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 13:55:18 +00:00
allo	670356fa4e	code cleanup ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1543 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 13:27:04 +00:00
orbiter	fb7411d7bb	re-structuring of ranking application: ... concentration of all ranking attributes in the plasmaSearchRankingProfile git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1541 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 01:47:51 +00:00
hermens	5f5eee1ae9	*) replace System.out.println with log ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1540 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-05 01:17:08 +00:00
orbiter	d98418390b	- introduced rankingProfile Class ... - selection of ranking and timing profiles for each search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1539 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 23:51:00 +00:00
orbiter	eab1805bca	refactoring: plasmaSearchProfile -> plasmaSearchTimingProfile ... This was made to distiguish this profile from the (to-be-implemented) plasmaSeachOrderProfile git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1538 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 23:11:31 +00:00
orbiter	6eef848954	re-design of post-ranking process ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1537 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 23:00:31 +00:00
allo	af2127f3ad	allow multiple #File: Sektions for one File in translations. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1534 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 18:08:01 +00:00
allo	1bb768178f	simple check for unused Translations. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1533 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 17:49:10 +00:00
orbiter	be77fe1a88	code clean-up ... @Martin: bitte schaue mal warum die Variablenzuweisung in plasmaCrawlNURLImporter war. So wie sie waren, waren sie überflüssig. Das hattest du dir bestimmt nicht so gedacht. Sollten es ggf. globale Variablen sein? git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1529 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 15:25:48 +00:00
orbiter	0bc2aaeb42	added normalization to search attributes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1528 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 14:13:54 +00:00
allo	7bd61ab0e5	Locales will now be in DATA/HTDOCS. So it works with readonly htroot. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1527 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-04 10:50:22 +00:00
theli	008bcb7fb8	*) simplifying code by moving closeTransferIndexes into final block ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1522 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-03 13:14:30 +00:00
theli	50d85657b8	*) new import function for IndexImport_p.html ... - can be used to import the crawling queue (noticeUrlDB + stacks) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1518 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-02 16:46:58 +00:00
theli	214302284e	*) undoing last commit because of problems with getUpdateTime ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1514 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-02 10:05:16 +00:00
theli	408de3beee	*) avoiding to search in the treemap two times for the same key ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1513 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-02 10:03:47 +00:00
borg-0300	139ba4e0c8	Bugfix for getCachePath(URL url) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1510 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-02-01 19:07:49 +00:00
theli	442807cb29	*) Bugfix for last commit ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1506 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 15:26:11 +00:00
theli	22fd1ca9aa	*) minor changes ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1505 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 12:39:10 +00:00
theli	6a99304b2b	*) Redesign of db import functionality ... - restructuring to allow different import tasks to be controlled via one gui - adding possibility to import a single assortment file - adding possibility to set the cache size that should be used git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1504 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 12:30:24 +00:00
hermens	56936139ae	Fix logging in kelondroTree: ... *) Use java.util.logging.* (via kelondroRecords) without de.anomic.server.logging.serverLog *) Log "CORRECTING ITERATOR" only in debug mode (happens way too often to be a useful warning and is corrected anyway) *) Log when correctedNodeIterator stumbles on incorrectly ordered data (now this one deserves throwing a warning at the user) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1503 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 02:01:32 +00:00
orbiter	3834675084	fixed bug that caused wrong behavior of search result preparation ... (second search on same topic resulted in less links) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1502 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 01:20:28 +00:00
hermens	31c8476b5d	plasmaWordIndexCache.getContainer: ... *) Also get entries from cache *) calculate available remaining time for backend.getContainer correctly git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1501 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 01:04:23 +00:00
hermens	bb1664b63e	*) Remove workaround from SVN 1472: It is not needed anymore ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1500 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-31 00:45:48 +00:00
orbiter	ec5d88664a	tried too fix serverSwitch synchronization problems ... see also: http://www.yacy-forum.de/viewtopic.php?p=16110#16110 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1499 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 23:07:20 +00:00
orbiter	3419b3bcdd	fix for bug that caused the peer-counter problem. ... See http://www.yacy-forum.de/viewtopic.php?p=16016#16016 The kelondroDyn now uses a generic fill character. kelondroDyn-Tables containing peer/word/url-hashes must not use '_' as fill character. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1498 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 22:16:55 +00:00
allo	9bc62bfdac	typo ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1497 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 20:57:11 +00:00
allo	cdc595ab67	another ppm fix. no more unknown ppm ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1496 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 20:42:02 +00:00
hermens	4f43816ec0	*) Fix wrong class cast in indexSize() ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1495 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 17:09:07 +00:00
orbiter	a7f0adf6fa	bugfix in entity iterator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1490 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 12:50:40 +00:00
orbiter	fa90c3ca7a	- removed some usage of indexEntity ... - changed index collection process: indexes are not first flushed to indexEntity, but now collected directly from ram cache and assortments git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1489 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 12:42:06 +00:00
orbiter	aea3e00864	cleanup: removed unused temporary index management in indexEntity. ... This is replaced by indexContainers git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1486 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 01:18:25 +00:00
orbiter	03c65742ba	changes towards the new index storage scheme: ... - replaced usage of temporary IndexEntity by EntryContainer - added more attributes to word index - added exact-string search (using quotes in query) - disabled writing into WORDS during search; EntryContainers are used instead git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1485 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-30 00:42:38 +00:00
rramthun	84a00e5673	Use YaCy logging instead of something I don't understand. ... Problem was: YaCy under Linux wrote every CORRECTING ITERATOR message to syslog an your logfiles get VERY big if you run YaCy 24/7. Approx. 20MB/day. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1483 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-29 16:04:20 +00:00
theli	ab7a911bb3	*) Trying to solve pool not open problem ... See: http://www.yacy-forum.de/viewtopic.php?t=1798 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1482 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-29 08:54:19 +00:00
allo	a6245a302f	even better ppm ;-) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1481 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 19:22:30 +00:00
hydrox	d665f3c39c	*) fixed Threadnames for stackCrawl-Threads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1480 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 19:06:21 +00:00
theli	3d5347bc8e	*) changing loglevel for some messages ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1479 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 17:40:24 +00:00
theli	0fcd113c42	*) last bugfix part. Seems to work now for the stackCrawler ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1478 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 17:25:19 +00:00
theli	b9c9eaeb44	*) next try todo a bugfix :-(( ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1477 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 17:05:47 +00:00
theli	4b4b93c413	*) next try todo a bugfix :-( ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1476 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 16:55:05 +00:00
theli	d9fbad71b9	*) next try todo a bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1475 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 16:38:25 +00:00
theli	6da97bd2e4	*) next bugfix for threadpool problem ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1474 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 16:31:40 +00:00
theli	bea2b9edee	*) further redesign of threadpools to solve too many thread problem ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1473 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 16:18:07 +00:00
hermens	2d1283da34	This is an extremely ugly workaround for an incompatibility between yacySeed hashes and kelondroDyn keys ... See: http://www.yacy-forum.de/viewtopic.php?p=15955#15955 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1472 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 15:26:56 +00:00
theli	784fd50437	*) more verbose thread names ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1471 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 15:26:47 +00:00
theli	56e4dbeb71	*) displaying current active + current idle threads in PerformanceQueues_p.html now ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1470 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-28 15:17:04 +00:00
theli	859c6a88f5	*) testing various thread pool eviction settings to avoid outOfMemory - Thread creation problem ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1467 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-27 16:51:29 +00:00
allo	7197f171d3	better ppm calculation ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1464 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-27 11:51:27 +00:00
orbiter	f2b18cede9	AND-bugfix ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1461 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-27 03:58:38 +00:00
orbiter	b946e28e61	some ranking enhancements ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1460 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-27 02:48:27 +00:00
rramthun	6c02f889f7	Cosmetic changes. ... Corrected version numbering as described in http://www.yacy-websuche.de/wiki/index.php/De:Versionsnummern git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1453 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-26 15:12:44 +00:00
theli	b191f06d16	*) Adding additional logging message to locate problems with stackcrawl threads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1452 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-26 14:24:29 +00:00
theli	5c56b9ed59	*) catch exceptions that could occur during url decoding ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1451 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-26 13:57:49 +00:00
theli	d9bcd73d93	*) Bugfix for exception ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1448 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-26 12:15:59 +00:00
theli	f5abfe8d57	*) more failsafe threadpools ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1446 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-26 09:37:43 +00:00
orbiter	47344e8df0	removed referrer fake (too many complaints, too less use) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1444 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-25 18:54:46 +00:00
hermens	ad0de69607	Yet another bug fix for svn 1441. It should work now. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1443 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-25 13:32:04 +00:00
hermens	58fd40e1c1	Aaargh ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1442 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-25 13:28:03 +00:00
hermens	b08af0c2cb	*) Force download of seed file when checking upload success ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1441 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-25 13:25:48 +00:00
hermens	66c889138e	*) Bugfix: Principals are reported back as 'principal', so IWasAccessed should also be true ... *) make it easier to include legacy peers switching between timezones +0100 and +0200 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1438 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-25 01:50:24 +00:00
orbiter	a56fefe0d3	added missing forced-flush for index cache ... see http://www.yacy-forum.de/viewtopic.php?p=15732#15732 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1434 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 16:24:15 +00:00
hermens	78bcb8014a	*) Limit range for selection of indexes for distribution to a DHTDistance of 0.2 ... (For wider ranges enough suitable targets are not probable) *) Migrate Indexes from ClassicDB back to AssortmentCluster if transfer fails *) Remove class iterateFiles from plasmaWordIndex (The class iterateFiles from plasmaWordIndexClassicDB is used instead) git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1430 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 14:58:15 +00:00
hermens	861aae678d	*) cleanup cacheAge database when cleaning up the HTCache ... *) Log directory deletes with level Fine git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1427 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 14:21:01 +00:00
orbiter	b9d73f63e7	replaced String object in loop detection by byte[] to omit String-generation ... which could cause locks. See http://www.yacy-forum.de/viewtopic.php?p=15738#15738 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1425 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 13:12:38 +00:00
low012	927c2c3709	*) Fixed a minor bug in code for tables. {|border"1" did not work, {| border"1" did. Now the space is not needed anymore. ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1423 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 11:15:20 +00:00
theli	75aad0fe66	*) Bugfix for URLs containing spaces ... See: http://www.yacy-forum.de/viewtopic.php?t=1640 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1422 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 09:30:58 +00:00
theli	754a35877f	*) Changing robots parser cxclusion policy ... - crawling is now allowed if server returned a 403 statuscode when trying to download the robots.txt See: http://www.yacy-forum.de/viewtopic.php?t=1612 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1421 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 08:53:30 +00:00
hermens	a2e2d583f9	*) small bugfix regarding peerPingMaxRunning ... *) beautify log git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1419 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-24 01:16:22 +00:00
theli	b4e2efef10	*) first test of new iteration function ... ATTENTION: please don't use it at the moment git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1418 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 17:20:30 +00:00
rramthun	a4e90c4b11	Fixed spelling bug. ... I think this is important for other programmers, who don't make the same mistake as the original author. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1417 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 15:08:39 +00:00
low012	c45517db46	*) replaced code for table with better version (by kane) ... *) split replaceHTML into replaceCharacters and replaceHTMLonly, replaceHTML can still be used to ensure compatibility git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1416 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 13:59:40 +00:00
orbiter	eabf4a0386	fix for null pointer exception during shut-down ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1415 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 13:45:14 +00:00
orbiter	47843e69e2	auto-reset for switchboard queue stack ... bugfix for http://www.yacy-forum.de/viewtopic.php?p=15684#15684 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1414 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 12:41:08 +00:00
orbiter	a70970f993	fixed increment in content iterator ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1413 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 12:11:32 +00:00
hermens	62ab8d18c1	*) Bugfix for peer sorting method. This seems to cause funny side effects in the SeedDB ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1412 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-23 01:42:26 +00:00
hermens	75b268f16d	*) use majority voting for peer type decision ... *) reduce the number of peer pings sent out see: http://www.yacy-forum.de/viewtopic.php?t=1748 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1411 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 23:14:37 +00:00
orbiter	d6581c445b	added content iterator for corrupted database files ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1406 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 17:12:16 +00:00
theli	ecdc1f7547	*) Bugfix for crawling URLs with query parameters ... See: http://www.yacy-forum.de/viewtopic.php?p=14065 *) Preparation for http://www.yacy-forum.de/viewtopic.php?t=1719 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1405 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 16:39:10 +00:00
low012	eb80156233	*) added Kane's code for tables ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1403 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 15:41:49 +00:00
low012	ef22fa8bf2	*) beautifying code and a little comment ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1401 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 14:20:38 +00:00
orbiter	fc4ae899f7	added word-position to ranking (this is only a first step) ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1395 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 02:16:09 +00:00
orbiter	bb2095fe39	assortment files are now not deleted, but shifted to a backup directory. ... See also: http://www.yacy-forum.de/viewtopic.php?p=15458#15458 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1394 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 01:03:01 +00:00
orbiter	7366e39dd3	tried to fix 100% CPU bug. ... See http://www.yacy-forum.de/viewtopic.php?p=15569#15569 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1393 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 00:50:05 +00:00
orbiter	f14d49fae9	enhancements, bugfixes and additions to word index attribute storage ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1392 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-22 00:07:00 +00:00
allo	4d33020f56	Migration to WORK ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1389 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-21 16:39:57 +00:00
rramthun	1e5feedf0e	Fix for http://www.yacy-forum.de/viewtopic.php?p=15547#15547 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1388 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-21 11:20:26 +00:00
orbiter	f4ffa9aee5	- implemented more attributes to index entries ... - implemented hand-over of new word index attributes during remote search - implemented word-distance computation during search git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1382 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-20 15:14:21 +00:00
theli	026dcdfcc0	*) Bugfix from mbirth for ftpc bug ... See: http://www.yacy-forum.de/viewtopic.php?p=15496#15496 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1381 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-20 13:37:42 +00:00
rramthun	34a7802a36	.bat files create DOS-window with title "YaCy" as suggested in http://www.yacy-forum.de/viewtopic.php?p=15470#15470 ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1380 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-20 12:01:12 +00:00
orbiter	90b940e90e	fixed position storage problem. ... Now the word position is properly stored. No use of that now, but can be used for better ranking. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1378 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-20 00:26:55 +00:00
orbiter	0371494010	tried to add word position to index ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1377 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-19 14:13:39 +00:00
orbiter	f1cfee7703	removed tabs from condenser ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1376 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-19 12:24:35 +00:00
hermens	37791fd529	*) Close indexEntities when "found not enough peers for distribution" ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1375 6c8d7289-2bf4-0310-a012-ef5d649a1542	2006-01-18 20:47:05 +00:00