Commit Graph

1920 Commits

Author SHA1 Message Date
hydrox
c55c51e2a8 *)added keywords to IndexCleaner_p.java
*)updated Logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-09 12:23:05 +00:00
theli
f0ad0d2b2b *) better robots.txt support
- previously rules for all crawlers and special rules for yacy where 
     combined using AND. Now the general rule will be ignored if there is
     a special rule for yacy (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1867 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-09 12:19:46 +00:00
orbiter
ddbeda738e added minimum age of word in cache to performance menu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-09 11:31:17 +00:00
orbiter
f188611fc6 apply blacklist on rwis during dht receive
very experimental!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1865 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-09 10:46:02 +00:00
theli
915812f597 *) Undoing robots parser policy changes from svn rev. 1421
- crawling is not allowed if server returned a 403 statuscode (according to rfc)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-09 10:17:37 +00:00
orbiter
0ec28b8f8e added DBCleaner from Hydrox
see http://www.yacy-forum.de/viewtopic.php?p=18093#18093
The servlet is now named IndexCleaner_p.
See http://localhost:8080/IndexCleaner_p.html
The Servlet was adopted to fit in the overall architecture

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1863 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 22:06:11 +00:00
borg-0300
74ffb9b842 added more info/examples
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1862 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 17:25:43 +00:00
theli
5ee0125046 *) adding possibility to configure the server port for seed uploading via scp.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1861 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 16:34:05 +00:00
allo
2065138a41 reverted last Commit.
@Orbiter: kannst du dich dann mal drum kümmern, wenn ich versuche die ganze Sache ans Laufen zu bringen, hast du jedesmal was dagegen. Dann mach du es bitte, du wirst ja wissen was du willst...


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1860 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 13:35:38 +00:00
allo
7afa5c1b8e staticIP fix
tried to solve http://www.yacy-forum.de/viewtopic.php?p=18663#18663
D 2006/03/08 07:08:20 YACY yacyClient.publishMySeed mySeed error - not proper: IP is not proper: -UNRESOLVED_PATTERN-


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1859 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 12:23:26 +00:00
allo
f6452879d5 prevent nullpointer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1858 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 11:31:39 +00:00
allo
04ab5da350 fixing server & proxy access settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1857 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 08:45:46 +00:00
theli
fb4100d47b *) undoing last commit.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1856 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 07:59:32 +00:00
theli
a84cc71218 *) removing getTotalRuntime
- not needed anymore

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1855 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 07:37:21 +00:00
theli
f108048a2c *) Bugfix for NullpointerException in hello.java
*) Correcting for loop in hello.java   

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1854 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 06:40:38 +00:00
low012
1965a8cf70 *) bugfix for previous commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1853 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 00:38:39 +00:00
low012
1c3b415c35 *) nicer anchors (TOC)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1852 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-08 00:24:49 +00:00
low012
6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1851 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 23:58:30 +00:00
auron_x
dce08771d1 *) Fix for wrong estimated and elapsed times when import was paused
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1850 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 22:51:18 +00:00
hermens
b34713324a DBImport: remove words from source index even if nothing has been added to home index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1849 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 22:19:39 +00:00
orbiter
3385b5720d documentation update + start of next development cycle
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1847 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 21:04:51 +00:00
allo
f6762688ec last commit
yacybar will be in addons


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1846 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 20:19:16 +00:00
allo
33ae45681b installerscript
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1845 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 20:01:15 +00:00
orbiter
1fa3d8cfbe * release 0.44
* documentation update

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1844 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 19:46:03 +00:00
allo
7872c5fab1 some more skins
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1843 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 19:42:12 +00:00
orbiter
3237fe1cc7 added IOException for httpc client error
see also http://www.yacy-forum.de/viewtopic.php?p=18615#18615

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1842 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 19:38:10 +00:00
orbiter
520b60f15b fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1841 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 19:28:06 +00:00
orbiter
7cbd995df2 documentation update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1840 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 16:45:42 +00:00
theli
c7ececbfb2 *) httpd.mime: adding jar mimetype
*) httpd.java: charset is only appended to mimetype for text mimetypes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1839 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 15:58:50 +00:00
theli
20ba05ad41 *) Bugfix for 'Dangling meta character' bug
See: http://www.yacy-forum.de/viewtopic.php?p=18585#18585

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1838 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 08:33:28 +00:00
orbiter
c6e542688a documentation update towards 0.44
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1836 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-07 00:13:32 +00:00
daburna
2114e0e630 again updated translation. just forgot something...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1830 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-06 16:31:25 +00:00
daburna
c0cdca5e68 updated translation
by the way: orbiter was is mit Config_p.html??? ist ja das gleiche in configadvanded drin oder?

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1829 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-06 15:33:52 +00:00
auron_x
6f1d45aaa3 *) re-added possibility to de-/select all parsers at one time (JS-only)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1828 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 15:28:31 +00:00
orbiter
ae536c4608 fixed soap service: index.soap -> yacysearch.soap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1827 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 15:28:40 +00:00
allo
210941397a example skin.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1826 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 10:09:08 +00:00
allo
a8fa9990aa default skins support
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1825 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 10:07:52 +00:00
orbiter
b9d522884c added YBR ranking files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1824 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 09:00:25 +00:00
orbiter
bae3783d38 added a snippet marking
(search words are now bold in snippets)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1823 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 01:11:06 +00:00
orbiter
bfec51969d moved skin selection to config menu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1822 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-05 00:27:28 +00:00
orbiter
70dc288aaa * removed 'catch up more links'
* automatic re-naming of search button
  (shows now 'catch up more links' by default)
* works also without javascript (then the button is simply named 'Search')

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1821 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 23:55:36 +00:00
orbiter
0fa0dd60f0 added ranking path to distribution built
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1820 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 22:28:06 +00:00
orbiter
34b383dcbe cosmetic fixes (those code fragments will be removed in the near future
to fully support yacysearch.html)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1819 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 19:56:14 +00:00
orbiter
a74687d3c1 fixed problem with snippet fetch
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1818 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 19:54:03 +00:00
orbiter
5484788cf3 * cleanup of unnecessary code (see: new yacysearch.* pages)
* documentation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1817 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 19:15:42 +00:00
orbiter
f0a38873eb * added yacysearch page with better view on search results
the old search page is obsolete and will be removed
* ConfigBasic.html is now the default page instead of index.html
  as long as no password is set

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1815 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 18:52:04 +00:00
rramthun
eb872033c6 Saving 64k (shrinks YaCy and improves loading-time)
Adding transparency to failed.png

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1814 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 15:40:50 +00:00
auron_x
70005b66e0 *) fixed some broken entries in de.lng and cleaned it a bit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1813 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 15:15:30 +00:00
orbiter
3173b5c9b3 fixed port parsing during shutdown for extended port format
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1812 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 11:07:01 +00:00
orbiter
f0041d504d remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1811 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-03-04 00:10:49 +00:00