Commit Graph

1616 Commits

Author SHA1 Message Date
orbiter
7df2e6e571 bugfix for last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1700 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-19 00:35:23 +00:00
allo
6b20ccaa0f count to the next update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1699 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 20:05:55 +00:00
orbiter
cd41e9a0eb moved DHT index selection to new object that holds indexes to be send away to other peer.
This was made to make it possible that RWI selections can be serialized with indexing.
Serialization will be implemented in another step.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1698 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 19:34:16 +00:00
allo
e3dd67bba0 bookmarks import.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1697 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 17:49:24 +00:00
allo
dda143df79 We NEED this here for the XML-Files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1696 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 14:57:25 +00:00
theli
42a5f56723 *) Bugfix for broken dht thread configuration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1695 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 14:51:01 +00:00
allo
91b78d9f04 missing File for IndexCreate
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1694 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 12:01:52 +00:00
allo
bfd37e34aa using other XML Parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1693 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 12:00:13 +00:00
theli
aa87df35e1 *) To avoid confusion location will now also be displayed for own peer
See: http://www.yacy-forum.de/viewtopic.php?p=17283#17283

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1692 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-18 10:27:56 +00:00
rramthun
851493624f MIME-Type setzen
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1691 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 21:38:46 +00:00
rramthun
15ed57f9b7 Updated German language, by VT100, NN, rramthun
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1690 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 21:23:45 +00:00
allo
62664d7252 AJAX Check for robots.txt before crawling.
Icons from herrlich
TODO: Style it nicely ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1689 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 20:55:31 +00:00
allo
0b5a736280 bugfix for nullpointer on unparsable date.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1688 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 19:40:01 +00:00
borg-0300
cf0993f516 added newline after excluded stopwords
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1687 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 18:46:04 +00:00
allo
f503df04f8 sort the Bookmarks with newest First.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1686 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 18:14:11 +00:00
allo
3b4a99ff6a fix for java 1.4.x
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1685 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 17:55:13 +00:00
low012
1d14958417 *) added link to profile of peer that sent a message (requested in http://www.yacy-forum.de/viewtopic.php?t=1957)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1684 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 17:41:21 +00:00
low012
8cf55537d7 *) changed name of COPYING and removed email address as suggested in the forum
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1683 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 17:08:59 +00:00
low012
d884796c7f *) new bookmark icons and file COPYING added
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1682 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 16:48:44 +00:00
theli
3dbaca03c7 *) correcting classpath for target compileHtdocsWWW
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1681 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 11:05:20 +00:00
theli
651bce8e2f *) adding missing function to transmit url chunks for crawl-order jobs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1680 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 11:04:35 +00:00
theli
f95d98142f *) displaying amount of items in the existsIndex caches
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1679 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 11:02:01 +00:00
theli
9b941fb773 *) bugfix for usage of yacy with extended port binding (e.g. #eth0:8080, 192.168.0.1:8080, etc.)
- port was reported incorrectly to other peers


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1678 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-17 10:53:20 +00:00
allo
26d7e8dd0d more escapes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1677 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 22:19:04 +00:00
allo
2d4e1325cf UTF-8 fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1676 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 21:33:41 +00:00
allo
a4b3981f33 all queues on WatchCrawler.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1675 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 21:08:34 +00:00
allo
127396436f more queues in the xml backend
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1674 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 20:26:10 +00:00
hydrox
e2af2a3f45 *) it's now possible to run more then one indexDistribution-Thread
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1673 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 15:22:25 +00:00
rramthun
4fe572164c My punishment for criticizing theli ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1672 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 14:28:39 +00:00
theli
40dd6ec4fd *) experimental restructuring of db import function
- trying to reduce IO load by avoiding  unnecessary db access
   - trying to presort url list

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1671 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 13:07:01 +00:00
theli
0b9f2d785d *) showing RemoteCrawlJobQueue and RemoteCrawlTriggerQueue in status table
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1670 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 11:56:42 +00:00
hermens
c8f5adea4d - don't send Message Body on HEAD requests, even in the case of an error
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1669 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 11:45:32 +00:00
theli
a7248fbb0a *) bugfix for http/0.9 responses
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1668 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 11:07:17 +00:00
theli
2da18ab359 *) correcting logging output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1667 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:56:17 +00:00
theli
a354bc2ec1 *) Bugfix for content length check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1666 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:54:47 +00:00
theli
8ffc6e35ad *) correcting logging output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1665 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:28:54 +00:00
hermens
e974d0cb99 Improve compliance to rfc
*) There is no status line in HTTP/0.9
*) Answers to HEAD requests should return the same headers as a GET request



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1664 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 10:27:21 +00:00
theli
556d242be0 *) Limited support of content-range requests
- a simple continue download request should work now

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 09:23:27 +00:00
theli
8fcb25f9f9 *) Setting via header according to rfc
- can be disabled via settings dialog

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 09:20:57 +00:00
theli
7a5af1e4df *) adding target that can be used to compile userspecific servlets located in htroot/www
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1661 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 07:34:26 +00:00
theli
980e986b64 *) Re enabling short cycle for already removed nurl entries
See: http://www.yacy-forum.de/viewtopic.php?p=17147#17147 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1660 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-16 06:59:34 +00:00
daburna
7e02f470ad migrate translation for bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1659 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 22:43:30 +00:00
orbiter
218cd6561c fixed problem with wrong hash length in file share
see: http://www.yacy-forum.de/viewtopic.php?p=16565#16565

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1658 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 22:12:53 +00:00
orbiter
56516fd8e6 added refresh parser to htmlFilterContentScraper
* getRefreshSeconds() - number of seconds until refresh
* getRefreshPath() - url path
See also: http://www.yacy-forum.de/viewtopic.php?p=16851#16851

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1657 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 21:55:15 +00:00
orbiter
ba5fe0b287 fixed (again) nullPointerException in kelondroTree
see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 21:33:10 +00:00
rramthun
4ceea34187 Fix for http://www.yacy-forum.de/viewtopic.php?p=16964#16964
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1655 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 19:18:01 +00:00
allo
99a970eda1 xml backend with verifyAuthentication
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1652 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 15:29:46 +00:00
allo
e6c2f700b1 public Tagview
IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 14:35:30 +00:00
allo
910a709d3f show number of bookmarks in a tag.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1650 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 13:34:14 +00:00
allo
672b384fc7 refactoring setTagsTable and setBookmarksTable.
preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542
2006-02-15 13:16:10 +00:00