Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,515 Commits 1 Branch 20 Tags 836 MiB
8b393744f1
Commit Graph

3515 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
daburna
8b393744f1 #first version of french language file by gDupont 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3749 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-23 10:43:54 +00:00
(no author)
b4b56a5475 *) Preparations for system-independent restart using the wrapper. Not functional yet. 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3748 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-22 20:41:15 +00:00
orbiter
a585b4d41b added web structure image 
see http://localhost:8080/WatchWebStructure_p.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3747 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-22 15:20:50 +00:00
orbiter
33ad0c8246 added a web structure computation and logging: 
- all web page parsing operations will now increase a web structure file
- the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database)
- the file can be used externally to analyse the link structure of the crawled pages
- the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml
- the short-term purpose is the computation of a link-graph image (before linuxtag!)
- a long-term purpose could be a decentralized computation of the citation rank



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-22 08:13:48 +00:00
auron_x
cd3494a04c *) hint for idle indexer only appears if indexer is idle now 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3744 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-21 11:57:57 +00:00
karlchenofhell
7904175338 - sorry for typos 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3743 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-20 16:22:46 +00:00
karlchenofhell
baa9402b97 - wiki-parser is now configurable via the config setting wikiParser.class which holds the class-name for the parser to use 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3742 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-20 16:19:25 +00:00
karlchenofhell
601fc7d1c5 - added source to J7Zip-modifed.jar and it's license (changelog is still to come) 
- moved HTML-*replace-methods from wikiCode to de.anomic.data.htmlTools
- prepared use of different wiki parsers as suggested here: http://www.yacy-forum.de/viewtopic.php?p=34444#34444

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3741 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-20 13:29:12 +00:00
karlchenofhell
0a64047081 - plasmaParserDocument can process subdocuments now (other archive-parsers may want to use this method) 
- added 7zip parser
- added 'text/sgml' to realtime parseable mimetypes (sometimes returned by the mime type parser)
- added new cached output stream class, very suitable for parsers because of limited memory

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3740 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 23:13:44 +00:00
theli
b1680ab71f *) bugfix for ArrayIndexOutOfBoundsException in robots-parser (thanks to low012) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3739 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 13:39:08 +00:00
theli
b30e64daab *) passing homepath to serverLog.configureLogging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3738 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 13:04:26 +00:00
theli
9a4375b115 *) robots.txt: adding support for crawl-delay 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3737 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-18 13:00:42 +00:00
orbiter
11ac7688d5 reverted a part of last commit 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3736 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 17:52:11 +00:00
orbiter
b3f97b5c38 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542 2007-05-16 17:45:39 +00:00
orbiter
3c5ff7f735 adopted kelondroBytesIntMap to kelondroIntBytesMap 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3734 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 15:20:15 +00:00
orbiter
5551ff5306 enhanced index storage data structure kelondroBytesIntMap 
this stores now two index structures, one for data that is aquired during start-up
and one for data that is aquired during run-time. This reduces the grow factor, and should reduce the memory amount in case that a index-reorganisation happens.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3733 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 14:36:56 +00:00
orbiter
872eb46cb9 some redesign of the handling of the index for kelondroFlexTable 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3732 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 10:48:26 +00:00
karlchenofhell
086239da36 - added servlet: remote crawler queue overview 
- added servlet: crawl profile editor

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3731 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-16 10:11:25 +00:00
theli
4dc45d6e97 *) adding tags for skype 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3729 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-15 16:18:51 +00:00
karlchenofhell
8ba81e0995 - added some comments (will get more in the near future) 
- added missing <label> to the search field in Network.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3728 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-15 15:48:28 +00:00
allo
eda8696e33 http://www.yacy-forum.de/viewtopic.php?p=35721 
wrong startindex


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3727 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 21:27:48 +00:00
allo
65a8a9fc58 fix for nullpointer 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3726 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 16:56:13 +00:00
orbiter
b05e2314cf another dht selection fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3725 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 12:52:39 +00:00
karlchenofhell
03c6551b0c - fix for http://www.yacy-forum.de/viewtopic.php?t=3747 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3724 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 12:44:44 +00:00
orbiter
b28e5d0ee9 protection against wrong word hash length 
see http://www.yacy-forum.de/viewtopic.php?p=35657#35657

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3723 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 10:00:23 +00:00
orbiter
e897eb9b4a fix for DHT selection target 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3722 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-14 08:17:36 +00:00
theli
4e68a10cd9 *) Updating News.rss 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3721 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-13 23:40:57 +00:00
rramthun
419183c686 *) Updater now writes logfile 
*) Update-Thread now terminates correctly


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3720 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-13 19:43:17 +00:00
orbiter
0384b8771b fix for http://www.yacy-forum.de/viewtopic.php?p=35700#35700 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3719 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-13 19:37:16 +00:00
rramthun
23f6150a5b *) Updater now checks for updates even while waiting for user to approve update 
*) Changed YaCy version back to dev scheme

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3718 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-13 12:51:03 +00:00
orbiter
9f96eeee7f documentation update (download links and english forum) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3717 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-12 18:22:24 +00:00
orbiter
c3589ecdc2 demo update 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3716 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-12 09:32:10 +00:00
orbiter
578c2ef130 release 0.52 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3715 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 22:12:29 +00:00
orbiter
4abaa80b79 different memory settings 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3714 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 21:06:24 +00:00
rramthun
00611a6f27 *) Language changes 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3713 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 20:40:31 +00:00
orbiter
756a27049b last-minute-feature 'newbie-selection' for workshop purpose: 
for remote search, always select all peers that are less than a day old
(should be removed someday in the future if load is too high, which could mean when pph > 100)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3712 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 19:55:19 +00:00
orbiter
c73b7588ed documentation update / release info 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3711 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 19:01:47 +00:00
(no author)
424146f027 more XHTML validation 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3710 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 18:19:09 +00:00
orbiter
46367afaaa update of memory-protection values 
see http://www.yacy-forum.de/viewtopic.php?p=35539#35539

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3709 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 18:02:48 +00:00
rramthun
ea87fe5d78 *) Updated German translation 
*) Changed "Lost Handle" error to warning (masses of it if deleting crawl-profile)
*) Removed unnecessary code from Windows script 

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3708 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 17:48:22 +00:00
auron_x
841e51e15e *) addition to last commit (just commited html-changes) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3707 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 11:00:17 +00:00
auron_x
15ad9ff32e *) removed unneccessary debug-lines 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3706 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-11 10:56:03 +00:00
rramthun
d5e634d06b *) Updater r3 - Please test and report major problems (don't use this version for stable-release, r3 updates always to latest dev-version of YaCy) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3703 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 20:47:23 +00:00
orbiter
d78f5785d2 added more dyndns addresses 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3702 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 14:12:07 +00:00
orbiter
85035dc319 addition to svn 3699: check send/receive if p2p-mode is activated 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3701 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 13:27:38 +00:00
borg-0300
709b4c1905 added switches for the columns 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3700 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 11:36:04 +00:00
auron_x
1d1685c588 *) added some JS to give more direct feedback 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3699 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-10 11:15:55 +00:00
orbiter
26f05d1fd0 avoid division by zero if search is done for no words 
this case is relevant if the bluewords (yacy.blue) are used

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3698 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 22:10:12 +00:00
orbiter
2fa8b50e54 reverting svn 3691+3692 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3696 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 19:31:40 +00:00
daburna
ea591630cb *small update 
TO DO:
- remove unused strings
- update translation for Wikihelp

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3695 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2007-05-09 19:22:52 +00:00