Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,869 Commits 1 Branch 20 Tags 836 MiB
59d52fb4a9
Commit Graph

752 Commits

Author SHA1 Message Date
orbiter
59d52fb4a9 fixed some problems with crawl profiles 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-26 14:52:01 +00:00
allo
44d72f06c4 more Caching 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 15:08:27 +00:00
allo
918445a2f4 Bugfix for last commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:34:27 +00:00
orbiter
219d847aaa fix for appearance of radio buttons 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1963 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:07:23 +00:00
orbiter
8cac4a1e73 syntax fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1962 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 14:00:28 +00:00
orbiter
7310d2de1f small fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1961 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 13:56:58 +00:00
orbiter
0c9b61820e enhanced re-crawl settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1960 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 13:45:01 +00:00
orbiter
708cc6c8d9 fixed some bugs for auto-filter and added monitor in profile list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-24 00:38:40 +00:00
orbiter
1f32ad8fd9 very small enhancements to indexCreate page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1958 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 23:32:04 +00:00
allo
c58789177f bookmarkCache 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 21:33:09 +00:00
rramthun
42b0b10a95 -Adding Windows Media to types which are not sended compressed 
-Renaming writeandzip to writeandgzip to avoid confusion about type of compression
-Adding new startup message to windows script
-The usual language "enhancements" ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 20:12:23 +00:00
orbiter
63f39ac7b5 added 3 new crawling steering options: 
- re-crawl by age of page (enter in minutes)
- auto-domain-filter
- maximum number of pages per domain
NOT YET TESTED!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-23 16:05:16 +00:00
orbiter
1fc3b34be6 some pre-work (without function yet) to implement: 
- re-crawl (by age of last crawl)
- auto-crawl-filter by crawl depth (to be explained..)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-22 15:28:17 +00:00
orbiter
0a4c2e89ed remote crawl orders are now only accepted if sum over all 
queues is less than 100 (the indexing queue was not measured before)
see also: http://www.yacy-forum.de/viewtopic.php?p=19374#19374

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1947 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-22 14:23:24 +00:00
orbiter
1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-20 22:31:59 +00:00
borg-0300
cb23fc3d83 keywords added 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1934 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 12:36:39 +00:00
borg-0300
1258df8133 no "[0-9]+" in topwords 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1933 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-19 12:33:50 +00:00
orbiter
6c70f4a0cf renamed wordHashes for a word hash set generation to wordHashSet 
This was done because the wordHashes iterator will get another integer
parameter and then conflicts with the wordHashes set generation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-18 01:04:16 +00:00
orbiter
dba02f399f starting of re-design of kelondroTree iterator 
- new access to iterator
- added many IOException handling in other Classes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 20:52:43 +00:00
allo
d2f34a2e94 skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable). 
preference of skinfiles:
-style.css will be overwritten on every new SVN, if "DATA/SKINS/"+currentSkin+".css" exists.
-DATA/SKINS will be overwritten with defaultskins from /skins
so develop your skins in DATA/SKINS, and put them into skins for distribution.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1913 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 20:48:00 +00:00
orbiter
3286b1f498 re-organisation of lurl-creation and -stacking 
this was necessary to prevent useless write to the database
in case of blacklist appearance of the url

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-17 10:16:07 +00:00
hermens
289da326e5 *) Bugfix: remove blacklisted URL from loadedURL, when received via DHT transfer 
see: http://www.yacy-forum.de/viewtopic.php?p=18976#18976



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1904 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:58:44 +00:00
borg-0300
9b94b374cc Bugfix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1903 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:16:01 +00:00
orbiter
60995a3a67 changed behaviour of "search again" appearance 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1902 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-16 23:07:59 +00:00
orbiter
3881f9ccde fixed total number in network list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1894 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 22:40:30 +00:00
orbiter
a6a3f4b694 fix for svn 1888 
this is a redesign of the no-iterator solution

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1892 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 16:01:42 +00:00
auron_x
1fc494858d *)added blog to the nav-bar 
*)added some padding to blog entries (looks nicer)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1891 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-15 15:51:25 +00:00
daburna
7605ddd450 just testing my new svn-client with linux - daburna - if login is possible... 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1889 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 23:24:05 +00:00
(no author)
5ddc32f49a just testing my new svn-client with linux - daburna 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1887 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-14 22:56:41 +00:00
orbiter
e94b374d56 update to cache flush method 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1884 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 23:06:06 +00:00
rramthun
9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1883 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 20:12:31 +00:00
allo
1a13c8b78e right wordCachesize after orbiters commit. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1882 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 18:09:09 +00:00
allo
6b056610e3 updated watchcrawler for the recent changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1881 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 16:33:47 +00:00
orbiter
bcd99fe83e introduced a second RAM cache for DHT transfer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1880 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-13 10:43:12 +00:00
hydrox
c55c51e2a8 *)added keywords to IndexCleaner_p.java 
*)updated Logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 12:23:05 +00:00
orbiter
ddbeda738e added minimum age of word in cache to performance menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 11:31:17 +00:00
orbiter
f188611fc6 apply blacklist on rwis during dht receive 
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1865 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-09 10:46:02 +00:00
orbiter
0ec28b8f8e added DBCleaner from Hydrox 
see http://www.yacy-forum.de/viewtopic.php?p=18093#18093
The servlet is now named IndexCleaner_p.
See http://localhost:8080/IndexCleaner_p.html
The Servlet was adopted to fit in the overall architecture

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1863 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 22:06:11 +00:00
borg-0300
74ffb9b842 added more info/examples 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1862 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 17:25:43 +00:00
theli
5ee0125046 *) adding possibility to configure the server port for seed uploading via scp. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1861 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 16:34:05 +00:00
allo
7afa5c1b8e staticIP fix 
tried to solve http://www.yacy-forum.de/viewtopic.php?p=18663#18663
D 2006/03/08 07:08:20 YACY yacyClient.publishMySeed mySeed error - not proper: IP is not proper: -UNRESOLVED_PATTERN-


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1859 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 12:23:26 +00:00
allo
04ab5da350 fixing server & proxy access settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1857 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 08:45:46 +00:00
theli
f108048a2c *) Bugfix for NullpointerException in hello.java 
*) Correcting for loop in hello.java   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1854 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-08 06:40:38 +00:00
theli
20ba05ad41 *) Bugfix for 'Dangling meta character' bug 
See: http://www.yacy-forum.de/viewtopic.php?p=18585#18585

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1838 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-07 08:33:28 +00:00
auron_x
6f1d45aaa3 *) re-added possibility to de-/select all parsers at one time (JS-only) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1828 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-05 15:28:31 +00:00
orbiter
bae3783d38 added a snippet marking 
(search words are now bold in snippets)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1823 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-05 01:11:06 +00:00
orbiter
bfec51969d moved skin selection to config menu 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1822 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-05 00:27:28 +00:00
orbiter
70dc288aaa * removed 'catch up more links' 
* automatic re-naming of search button
  (shows now 'catch up more links' by default)
* works also without javascript (then the button is simply named 'Search')

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1821 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-04 23:55:36 +00:00
orbiter
34b383dcbe cosmetic fixes (those code fragments will be removed in the near future 
to fully support yacysearch.html)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1819 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-04 19:56:14 +00:00
orbiter
a74687d3c1 fixed problem with snippet fetch 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1818 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2006-03-04 19:54:03 +00:00