Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,792 Commits 1 Branch 20 Tags 836 MiB
8da13088e9
Commit Graph

1792 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hydrox
8da13088e9 *)removed multiple DHT_Distribution_Threads 
*)boosted DHT_Distribution sending chunk parallel to multiple peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1890 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 11:27:43 +00:00
daburna
7605ddd450 just testing my new svn-client with linux - daburna - if login is possible... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1889 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 23:24:05 +00:00
orbiter
283a7181c6 try to fix new 100% cpu bug, possibly caused by iterator method 
see http://www.yacy-forum.de/viewtopic.php?p=18900#18900

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1888 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 23:22:49 +00:00
(no author)
5ddc32f49a just testing my new svn-client with linux - daburna 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 22:56:41 +00:00
theli
34c075c1c7 testcommit with subversive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1886 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 08:54:44 +00:00
orbiter
f588c0724f removed cache flush in case of DHT receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1885 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 23:23:45 +00:00
orbiter
e94b374d56 update to cache flush method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 23:06:06 +00:00
rramthun
9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 20:12:31 +00:00
allo
1a13c8b78e right wordCachesize after orbiters commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 18:09:09 +00:00
allo
6b056610e3 updated watchcrawler for the recent changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 16:33:47 +00:00
orbiter
bcd99fe83e introduced a second RAM cache for DHT transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 10:43:12 +00:00
hydrox
360a460da8 *)URL-Cleaner: moved logging-statement to correct position 
*)plasmaURLPattern: host is now added to the hashset in lowercase

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1879 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-12 18:08:48 +00:00
orbiter
02f9765013 quickfix for time problem during cache restore 
see http://www.yacy-forum.de/viewtopic.php?p=18810#18810

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1878 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-11 21:55:32 +00:00
rramthun
5d4f144f3f some de polish... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1877 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-10 21:53:22 +00:00
orbiter
69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1876 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-10 20:45:14 +00:00
allo
b3df5ce2b8 another local iprange 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1875 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-10 18:34:53 +00:00
hermens
ad119f06af *) Don't overwrite new entries with older ones 
see: http://www.yacy-forum.de/viewtopic.php?t=2015



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1874 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-10 16:28:01 +00:00
orbiter
be88687d8c fixed some problems with new cache flush karenz 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1873 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-10 13:57:30 +00:00
theli
d3da7c9a08 *) Adding support for robots Allow directive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1872 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 14:03:54 +00:00
auron_x
7fe0658f8b *) updated german language 
- cleaning of most <a>-Tags

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1871 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 14:03:24 +00:00
theli
734d18f283 *) more correct robots.txt validation 
- isDisallowed now uses getFile instead of getPath

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1870 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 13:04:57 +00:00
hydrox
f046e1814a *fix or last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1869 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:35:50 +00:00
hydrox
c55c51e2a8 *)added keywords to IndexCleaner_p.java 
*)updated Logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:23:05 +00:00
theli
f0ad0d2b2b *) better robots.txt support 
- previously rules for all crawlers and special rules for yacy where 
     combined using AND. Now the general rule will be ignored if there is
     a special rule for yacy (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1867 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:19:46 +00:00
orbiter
ddbeda738e added minimum age of word in cache to performance menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 11:31:17 +00:00
orbiter
f188611fc6 apply blacklist on rwis during dht receive 
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1865 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 10:46:02 +00:00
theli
915812f597 *) Undoing robots parser policy changes from svn rev. 1421 
- crawling is not allowed if server returned a 403 statuscode (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 10:17:37 +00:00
orbiter
0ec28b8f8e added DBCleaner from Hydrox 
see http://www.yacy-forum.de/viewtopic.php?p=18093#18093
The servlet is now named IndexCleaner_p.
See http://localhost:8080/IndexCleaner_p.html
The Servlet was adopted to fit in the overall architecture

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 22:06:11 +00:00
borg-0300
74ffb9b842 added more info/examples 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1862 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 17:25:43 +00:00
theli
5ee0125046 *) adding possibility to configure the server port for seed uploading via scp. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 16:34:05 +00:00
allo
2065138a41 reverted last Commit. 
@Orbiter: kannst du dich dann mal drum kümmern, wenn ich versuche die ganze Sache ans Laufen zu bringen, hast du jedesmal was dagegen. Dann mach du es bitte, du wirst ja wissen was du willst...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1860 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 13:35:38 +00:00
allo
7afa5c1b8e staticIP fix 
tried to solve http://www.yacy-forum.de/viewtopic.php?p=18663#18663
D 2006/03/08 07:08:20 YACY yacyClient.publishMySeed mySeed error - not proper: IP is not proper: -UNRESOLVED_PATTERN-


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 12:23:26 +00:00
allo
f6452879d5 prevent nullpointer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1858 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 11:31:39 +00:00
allo
04ab5da350 fixing server & proxy access settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1857 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 08:45:46 +00:00
theli
fb4100d47b *) undoing last commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1856 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 07:59:32 +00:00
theli
a84cc71218 *) removing getTotalRuntime 
- not needed anymore

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1855 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 07:37:21 +00:00
theli
f108048a2c *) Bugfix for NullpointerException in hello.java 
*) Correcting for loop in hello.java   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 06:40:38 +00:00
low012
1965a8cf70 *) bugfix for previous commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1853 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 00:38:39 +00:00
low012
1c3b415c35 *) nicer anchors (TOC) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1852 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 00:24:49 +00:00
low012
6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1851 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 23:58:30 +00:00
auron_x
dce08771d1 *) Fix for wrong estimated and elapsed times when import was paused 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1850 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 22:51:18 +00:00
hermens
b34713324a DBImport: remove words from source index even if nothing has been added to home index 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1849 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 22:19:39 +00:00
orbiter
3385b5720d documentation update + start of next development cycle 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1847 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 21:04:51 +00:00
allo
f6762688ec last commit 
yacybar will be in addons


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1846 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 20:19:16 +00:00
allo
33ae45681b installerscript 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1845 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 20:01:15 +00:00
orbiter
1fa3d8cfbe * release 0.44 
* documentation update

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1844 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 19:46:03 +00:00
allo
7872c5fab1 some more skins 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1843 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 19:42:12 +00:00
orbiter
3237fe1cc7 added IOException for httpc client error 
see also http://www.yacy-forum.de/viewtopic.php?p=18615#18615

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1842 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 19:38:10 +00:00
orbiter
520b60f15b fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1841 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 19:28:06 +00:00
orbiter
7cbd995df2 documentation update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1840 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 16:45:42 +00:00