Commit Graph

6359 Commits

Author SHA1 Message Date
orbiter
ada0ce9de3 refactoring of bookmarks: there is a big performance problem in the bookmarks code and furthermore the bookmarks
will loose its leading role for the re-crawl funtion when the new api tables will work. To be prepared for a replacement
of such functions the bookmark class is re-organised.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6637 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 22:18:56 +00:00
orbiter
3751ab4ae2 added sixcoolers patch and more checks/removed unnecessary code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6636 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 16:11:00 +00:00
orbiter
d8d8562c59 fill key with zeros during normalization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6635 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 15:40:16 +00:00
orbiter
a131ebbcb5 one more fix for NPE, see
http://forum.yacy-websuche.de/viewtopic.php?p=19010#p19010

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6634 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 11:28:37 +00:00
mikeworks
dcb7166594 Updated German translation:
* Reversed translation of "all" and "admin" to not break funtionality in Wiki.html
* Cleaned up translation and got rid of all unused strings
* Added some translations for the Rich Client (New UI)
  - for some a modification of translator.java to include .js files is needed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6633 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-31 13:50:28 +00:00
lotus
8926d824c6 small modification
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6632 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-31 12:09:42 +00:00
orbiter
24060885b6 - added Tables abstraction in data.Tables.java
fix for
http://forum.yacy-websuche.de/viewtopic.php?p=18910#p18910
http://forum.yacy-websuche.de/viewtopic.php?p=18894#p18894
http://forum.yacy-websuche.de/viewtopic.php?p=18814#p18814


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6631 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 18:02:09 +00:00
orbiter
7fdf59a77f misc NPE check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6630 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 15:59:24 +00:00
orbiter
a512aef6ad fix for http://forum.yacy-websuche.de/viewtopic.php?p=18918#p18918
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6629 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 10:33:20 +00:00
mikeworks
1cb4506325 Updated German translation adding the following pages:
* ConfigLiveSearch.html
    * ConfigPortal.html
    * ConfigSearchBox.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6628 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-28 06:22:50 +00:00
suessthomas
a29b17a2fd Minor HTML Changes, Images recompress.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6627 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-27 21:38:54 +00:00
low012
67dd376a33 *) hopefully solving ipv4/ipv6 issue described in http://www.yacy-forum.org/viewtopic.php?f=2&t=252&start=30#p1248 and http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2554
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6626 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 19:22:14 +00:00
suessthomas
67b8d5149e Small Changes on Network.html - Specifying image dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6625 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 14:56:27 +00:00
lotus
5cbef63c37 fixed bad ip pattern
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6624 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 14:25:15 +00:00
mikeworks
8e130ae426 Updated German translation: Filling PerformanceMemory_p.html section
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6623 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-25 00:04:39 +00:00
mikeworks
21624a423e Updated German translation:
- translated free mem warning in Status and security localhost message

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6622 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 20:37:04 +00:00
lotus
38a3d55afd added more possible php extensions for html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6621 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 20:04:31 +00:00
mikeworks
e87f0e83a2 Updated German translation:
- Fixed a typo in ConfigPHPBB3Search.html
- Added section for ConfigPHPBB3Search.html and translation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6620 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 13:12:10 +00:00
mikeworks
5bffc58261 Updated German translation:
- updated section for Performance_p.html
- added section for Tables_p.html which is no longer present in current SVN version

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6619 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 12:32:28 +00:00
mikeworks
2be9021157 Updated German translation:
- Covered Filter & Blacklists starting from Blacklist_p.html
- Fixed some errors and missed lines

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6618 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-23 02:36:16 +00:00
mikeworks
d915deaa2b Fixed type in CrawlStart_p.html
Changed to German language file:
- Updated Crawl Start Page
- Added section for indexing MediaWikis
- Fixed some more start and end tags so that syntax highlighting works correctly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6617 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 23:00:05 +00:00
orbiter
4403304957 bugfix for list()
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6616 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 16:00:56 +00:00
orbiter
3889438db6 fix for bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6615 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 14:20:24 +00:00
orbiter
feacf7294b removed unused folder xml; all classes that had been in xml had been moved to api
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6613 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:36:09 +00:00
orbiter
23bcca07a3 removed directly linked servlets that had been there to test memory failures that appeared in that servlets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6612 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:30:20 +00:00
orbiter
69c29acb6e no exception thread dump if parser cannot parse becuase that mime-type/extension is in the deny-set
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6611 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:21:37 +00:00
orbiter
0098e6e859 bugfix for heap iterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6610 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 10:26:50 +00:00
orbiter
597a410f58 ups
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6609 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:16:28 +00:00
orbiter
db19a941cf added new image index storage classes (not integrated yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6608 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:12:05 +00:00
orbiter
c8aece34a4 update to yacy/ai (just more testing)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6607 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:07:32 +00:00
orbiter
8ce936bcdd added an api recording function: it shall be possible to record
all operations on YaCy in a database that should make it possible
1) to re-create a setting on fresh peers
2) to transmit a setting from one peer to another
3) to re-create crawl starts after a complete deletion of the index
This functionality will also support
4) scheduled re-crawls (new implementation)
To implement this, a new database structure has been crated that stores maps into blob heaps. to encode maps the b-encoding technique was used (this is the same encoding that torrent files use)
- added a b-encoder
- enhanced the b-decoder
- added a b-encoded map heap data structure
- added a table organisation based on b-encoded heaps
- added a servlet to maintain such tables (see Tables_p.html)
- integrated the servlet into the Advanced Settings menu
- added an api recording based on the new tables

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6606 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:06:03 +00:00
orbiter
8df1694288 - added options to switch on/off search domains (text, image, audio, video, app)
- more memory by default


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6605 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:03:02 +00:00
mikeworks
19ff7da2b4 German language file change:
- Updated pages are Blog, Bookmarks, CookieMonitor*, CrawlResults, ProxyIndexingMonitor_p.htm, Wiki.html, yacyinteractive.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6604 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 01:44:29 +00:00
mikeworks
d4579377f8 Updated German language file
- Fixed some end tags (#-----------------------------) for syntax highlighting to properly detect the end
- Updated translation on pages in Search & Browse category

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6603 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 00:44:10 +00:00
mikeworks
3597dee3e3 Updated syntax highlighting support for YaCy lng (language) files in Notepad++
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6602 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 20:34:40 +00:00
mikeworks
c5322dd3a7 Updated German language file
- Updated changed lines in CrawlProfileEditor_p.html and WikiHelp.html
- Updated new navigation menu structure and some submenus

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6601 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:37:03 +00:00
mikeworks
ee52634daa Updated french language file due to changes to CrawlProfileEditor_p.html and WikiHelp.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6600 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:34:54 +00:00
mikeworks
eac3b696ab Fixed typos in WikiHelp.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6599 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:34:43 +00:00
mikeworks
03fb4a1980 Fixed typos CrawlProfileEditor_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6598 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:33:10 +00:00
orbiter
56e0d9bd01 - testings with image parser
- added image size as part of parsed text in images
- avoid unnecessary error messages if parsing of documents failed but one succeeded


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6597 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 14:59:58 +00:00
orbiter
e80e060ca6 - increased thread priority for server threads
- decreased thread priority for crawler threads

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6596 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 11:29:22 +00:00
orbiter
78daea95c3 show more navigation pages if there are too less locally
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6595 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 00:21:55 +00:00
mikeworks
25c545c4b0 first commit fixing two typos
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6594 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-18 07:25:41 +00:00
orbiter
234f733a3d - relocation of seed db is better for network switch than re-initialization because of the embedding of the peers object in other objects
- small refactoring of blacklist interface code to remove PMD warnings


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6593 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-18 00:07:20 +00:00
orbiter
473b11033d fixed network switch process - crawling did not work after a switch before this fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6592 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-17 23:33:15 +00:00
orbiter
fd7b348973 some fixes for the network switch
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6591 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-17 22:07:08 +00:00
orbiter
7d400b17d0 html parser support for .cfm files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6590 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-17 16:29:49 +00:00
orbiter
f6731c6240 more logging etc.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6589 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-17 00:41:50 +00:00
orbiter
007f8297de added php3 as extension type for html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6588 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-16 15:53:18 +00:00
orbiter
4f1f4863c4 fix for deadlock when initializing a SplitTable with a file of size 0, see also:
http://forum.yacy-websuche.de/viewtopic.php?p=18594#p18594

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6587 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-14 23:03:48 +00:00