Commit Graph

6416 Commits

Author SHA1 Message Date
orbiter
308a973503 refactoring of tables data organisation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6644 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-04 11:26:23 +00:00
lotus
85ca96227f fix for re-enable parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6643 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-03 19:33:59 +00:00
orbiter
8a76f38d26 Added a new steering servlet that can be used to repeat actions that had been made on the yacy interface. This can be used to:
- start again a previously started crawl
- submit settings (again). This option will be used to transmit
  all settings of one peer to another peer if the remote-peer
  steering function is ready
This steering framework will also be used for a 'schedule-everything'
which will also include a new scheduler for crawling.
  

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6642 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-03 09:31:12 +00:00
lotus
530b77d05a adapted loglevel for accepted urls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6641 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-02 09:47:43 +00:00
lotus
5f661d9f5d fix receive of crawl receipt in private peer mode
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2655

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6640 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-02 09:42:14 +00:00
orbiter
840527689b more simplification of bookmark class
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6639 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 23:04:52 +00:00
orbiter
d77782a8d5 removed bookmark tags file, tags are now stored only in RAM
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6638 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 22:44:59 +00:00
orbiter
ada0ce9de3 refactoring of bookmarks: there is a big performance problem in the bookmarks code and furthermore the bookmarks
will loose its leading role for the re-crawl funtion when the new api tables will work. To be prepared for a replacement
of such functions the bookmark class is re-organised.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6637 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 22:18:56 +00:00
orbiter
3751ab4ae2 added sixcoolers patch and more checks/removed unnecessary code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6636 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 16:11:00 +00:00
orbiter
d8d8562c59 fill key with zeros during normalization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6635 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 15:40:16 +00:00
orbiter
a131ebbcb5 one more fix for NPE, see
http://forum.yacy-websuche.de/viewtopic.php?p=19010#p19010

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6634 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-02-01 11:28:37 +00:00
mikeworks
dcb7166594 Updated German translation:
* Reversed translation of "all" and "admin" to not break funtionality in Wiki.html
* Cleaned up translation and got rid of all unused strings
* Added some translations for the Rich Client (New UI)
  - for some a modification of translator.java to include .js files is needed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6633 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-31 13:50:28 +00:00
lotus
8926d824c6 small modification
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6632 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-31 12:09:42 +00:00
orbiter
24060885b6 - added Tables abstraction in data.Tables.java
fix for
http://forum.yacy-websuche.de/viewtopic.php?p=18910#p18910
http://forum.yacy-websuche.de/viewtopic.php?p=18894#p18894
http://forum.yacy-websuche.de/viewtopic.php?p=18814#p18814


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6631 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 18:02:09 +00:00
orbiter
7fdf59a77f misc NPE check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6630 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 15:59:24 +00:00
orbiter
a512aef6ad fix for http://forum.yacy-websuche.de/viewtopic.php?p=18918#p18918
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6629 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-29 10:33:20 +00:00
mikeworks
1cb4506325 Updated German translation adding the following pages:
* ConfigLiveSearch.html
    * ConfigPortal.html
    * ConfigSearchBox.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6628 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-28 06:22:50 +00:00
suessthomas
a29b17a2fd Minor HTML Changes, Images recompress.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6627 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-27 21:38:54 +00:00
low012
67dd376a33 *) hopefully solving ipv4/ipv6 issue described in http://www.yacy-forum.org/viewtopic.php?f=2&t=252&start=30#p1248 and http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2554
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6626 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 19:22:14 +00:00
suessthomas
67b8d5149e Small Changes on Network.html - Specifying image dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6625 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 14:56:27 +00:00
lotus
5cbef63c37 fixed bad ip pattern
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6624 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-26 14:25:15 +00:00
mikeworks
8e130ae426 Updated German translation: Filling PerformanceMemory_p.html section
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6623 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-25 00:04:39 +00:00
mikeworks
21624a423e Updated German translation:
- translated free mem warning in Status and security localhost message

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6622 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 20:37:04 +00:00
lotus
38a3d55afd added more possible php extensions for html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6621 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 20:04:31 +00:00
mikeworks
e87f0e83a2 Updated German translation:
- Fixed a typo in ConfigPHPBB3Search.html
- Added section for ConfigPHPBB3Search.html and translation

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6620 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 13:12:10 +00:00
mikeworks
5bffc58261 Updated German translation:
- updated section for Performance_p.html
- added section for Tables_p.html which is no longer present in current SVN version

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6619 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-24 12:32:28 +00:00
mikeworks
2be9021157 Updated German translation:
- Covered Filter & Blacklists starting from Blacklist_p.html
- Fixed some errors and missed lines

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6618 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-23 02:36:16 +00:00
mikeworks
d915deaa2b Fixed type in CrawlStart_p.html
Changed to German language file:
- Updated Crawl Start Page
- Added section for indexing MediaWikis
- Fixed some more start and end tags so that syntax highlighting works correctly

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6617 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 23:00:05 +00:00
orbiter
4403304957 bugfix for list()
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6616 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 16:00:56 +00:00
orbiter
3889438db6 fix for bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6615 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 14:20:24 +00:00
orbiter
feacf7294b removed unused folder xml; all classes that had been in xml had been moved to api
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6613 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:36:09 +00:00
orbiter
23bcca07a3 removed directly linked servlets that had been there to test memory failures that appeared in that servlets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6612 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:30:20 +00:00
orbiter
69c29acb6e no exception thread dump if parser cannot parse becuase that mime-type/extension is in the deny-set
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6611 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 13:21:37 +00:00
orbiter
0098e6e859 bugfix for heap iterator
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6610 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-22 10:26:50 +00:00
orbiter
597a410f58 ups
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6609 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:16:28 +00:00
orbiter
db19a941cf added new image index storage classes (not integrated yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6608 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:12:05 +00:00
orbiter
c8aece34a4 update to yacy/ai (just more testing)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6607 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:07:32 +00:00
orbiter
8ce936bcdd added an api recording function: it shall be possible to record
all operations on YaCy in a database that should make it possible
1) to re-create a setting on fresh peers
2) to transmit a setting from one peer to another
3) to re-create crawl starts after a complete deletion of the index
This functionality will also support
4) scheduled re-crawls (new implementation)
To implement this, a new database structure has been crated that stores maps into blob heaps. to encode maps the b-encoding technique was used (this is the same encoding that torrent files use)
- added a b-encoder
- enhanced the b-decoder
- added a b-encoded map heap data structure
- added a table organisation based on b-encoded heaps
- added a servlet to maintain such tables (see Tables_p.html)
- integrated the servlet into the Advanced Settings menu
- added an api recording based on the new tables

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6606 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:06:03 +00:00
orbiter
8df1694288 - added options to switch on/off search domains (text, image, audio, video, app)
- more memory by default


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6605 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 22:03:02 +00:00
mikeworks
19ff7da2b4 German language file change:
- Updated pages are Blog, Bookmarks, CookieMonitor*, CrawlResults, ProxyIndexingMonitor_p.htm, Wiki.html, yacyinteractive.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6604 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 01:44:29 +00:00
mikeworks
d4579377f8 Updated German language file
- Fixed some end tags (#-----------------------------) for syntax highlighting to properly detect the end
- Updated translation on pages in Search & Browse category

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6603 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-21 00:44:10 +00:00
mikeworks
3597dee3e3 Updated syntax highlighting support for YaCy lng (language) files in Notepad++
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6602 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 20:34:40 +00:00
mikeworks
c5322dd3a7 Updated German language file
- Updated changed lines in CrawlProfileEditor_p.html and WikiHelp.html
- Updated new navigation menu structure and some submenus

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6601 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:37:03 +00:00
mikeworks
ee52634daa Updated french language file due to changes to CrawlProfileEditor_p.html and WikiHelp.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6600 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:34:54 +00:00
mikeworks
eac3b696ab Fixed typos in WikiHelp.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6599 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:34:43 +00:00
mikeworks
03fb4a1980 Fixed typos CrawlProfileEditor_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6598 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-20 07:33:10 +00:00
orbiter
56e0d9bd01 - testings with image parser
- added image size as part of parsed text in images
- avoid unnecessary error messages if parsing of documents failed but one succeeded


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6597 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 14:59:58 +00:00
orbiter
e80e060ca6 - increased thread priority for server threads
- decreased thread priority for crawler threads

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6596 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 11:29:22 +00:00
orbiter
78daea95c3 show more navigation pages if there are too less locally
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6595 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-19 00:21:55 +00:00
mikeworks
25c545c4b0 first commit fixing two typos
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6594 6c8d7289-2bf4-0310-a012-ef5d649a1542
2010-01-18 07:25:41 +00:00