Commit Graph

403 Commits

Author SHA1 Message Date
orbiter
7e24c51fd5 - removed alternative search page in main menue in favor of rich client search page
- added necessary option to search request of yacy-ui to get snippets

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5165 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-15 19:00:22 +00:00
apfelmaennchen
7c5867a832 Major update to YaCy-UI
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5162 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-15 17:18:07 +00:00
orbiter
4fbee21cea - added fetch-ahead again (had been removed in last commit)
- reverted default query mode to verify=false

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5111 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-03 23:50:13 +00:00
orbiter
05dbba4bab added logging conditions to all fine and finest log line calls
this will prevent an overhead for the generation of the log lines in case that they then are not printed

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5102 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-03 00:30:21 +00:00
lotus
3fbfd5a78b * fix for non-changing offset on new search term
* dht-heap doesn't has to be deleted (5097), we simply write a new one on exit
* do not install YaCy in startup because a Windows-shutdown might corrupt something. Installing YaCy as a service would solve this.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5099 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-09-02 15:09:31 +00:00
danielr
cd19d0aee6 - added warnings for failed transferRWI (dht-in)
- fixed parseMultipart (uncompress gzipped body) (dht-in)
- fixed parseMultipart (using content-length only if uncompressed)
- better gzipped POST (chunked instead of content-length) (dht-out)



git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5096 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-29 09:42:39 +00:00
orbiter
536e77e8b7 modifications towards a single database operation to read/write http header and cached file at once:
- removed distinction between header file types for http and ftp; ftp is simulated by using http properties
- removed all old resourceInfo classes that handled this distinction
- introduced a new distinction between http request and http response objects
- unified new response objects with two other object types that had been introduced elsewhere
- changed all servlet call methods to use the new http request header object type
- divided static object keys for http header properties into request and response types
- refactoring here and there (a large number of type changes and many methods merged/moved)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5079 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-25 18:11:47 +00:00
apfelmaennchen
296fa2265b YaCy-UI: removed unused Servlet ymarks.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5076 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-24 08:47:37 +00:00
apfelmaennchen
a9cf3b42c4 YaCy-UI: removed unused JavaScript
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5075 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-24 08:43:07 +00:00
apfelmaennchen
08bf3fd235 YaCy-UI: updated to jQuery-ui 1.6b
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5074 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-24 08:41:52 +00:00
danielr
753a1ae430 - changed default browser from netscape to firefox
- fixed "Inefficient use of keySet iterator instead of entrySet iterator" [WMI_WRONG_MAP_ITERATOR, FindBugs]
- fixed some possible null pointer accesses


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5063 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-20 07:54:56 +00:00
danielr
621b473b18 * removed some warnings of findbugs (http://findbugs.sf.net)
- removed unnecessary code (unused variables, String.toString)
- corrected some calculations (cast int to double or long ;)
- improved little performance (using Integer.valueOf() instead of new Integer)
- log if some File-actions fail (mkdir(), delete(), ...) and some ignored exceptions
- finalized some (more) fields
- finally close some streams
- made inner classes static if not using environment
- generalized some equals (from specificClass to Object)
- fixed some potential nullpointer accesses


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5039 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-06 19:43:12 +00:00
danielr
17b7845eb5 * refactoring
- moved constants from plasmaSwitchboard to own class (all 232 ;)
- moved remoteProxy-Methods to httpRemoteProxyConfig, better names
- removed some unnecessary code (else-statements)
* formatting (correct indentation)
* minor bugfixes (due to findbugs.sf.net)
* hopefully fixed "missing quote" (announcing StringParts as UTF-8)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5031 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-02 13:57:00 +00:00
danielr
3bb870bfcd added final where possible
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5030 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-08-02 12:12:04 +00:00
orbiter
c3d461d191 - removed superfluous copyright statement
- updated my email address

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 17:14:51 +00:00
orbiter
3ca98fee42 removed superfluous copyright statement
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-20 00:21:07 +00:00
danielr
10d01fdd0d addendum to 5002
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-16 09:47:48 +00:00
danielr
e12438142e - warning instead of NPE if urlHash is not in index of CrawResults
- times of LOCAL_SEARCH are shown in milliseconds


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-14 09:12:58 +00:00
orbiter
a6719dfd2b - refactoring of robots parser
- no more keep-order parameter in remove (it was not possible to make this strict, and not useful)
- some small enhancements in balancer
- robots parser without references in switchboard
- changes synchronization in robots

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4969 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-07-05 00:35:20 +00:00
danielr
7feae906aa - organize imports
- removed potential null pointer accesses
- removed unnecessary casts


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4893 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-06 16:01:27 +00:00
orbiter
0e1c7dfaaf small fix for testing environment that should not affect a production environment
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4886 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 13:08:40 +00:00
orbiter
e0e7f86f82 some bugfixes for the peer-ping process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4885 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 12:52:27 +00:00
orbiter
b21598bdd0 - enhanced handling of own IP address inside seed
- prevention of false information of own IP address
- enabled searching before an own IP address is assigned (before first ping happened)
- removed warning about limited search function
- added better time-out settings for peer-ping process (10 seconds complete, 5 seconds for back-ping)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4883 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-05 11:01:20 +00:00
orbiter
40d7f485f3 - fixed several NPE bugs
- fixed loosing of own seed hash (hopefully)
- fixed a bug with crawl start s beginning with (bookmark) files
- added better IP recognition during hello process


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4882 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-04 22:24:00 +00:00
orbiter
2f381b8d7a - fixed at least two causes for a NPE after a use case switch.
A large refactoring was neccessary
- added another crawl start option: automatic restriction to sub-path
- removed crawlStartSimple and renamed crawl start expert
   to crawl start (without expert)
- some changes to texts in crawl start
- added some more deletions when an web index is deleted:
   delete also queues and robots cache


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4881 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-06-04 21:34:57 +00:00
apfelmaennchen
c5f4f518e2 YaCy-Ui: fixed reverse order display of search results...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4868 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 19:25:53 +00:00
apfelmaennchen
e9a3b0f3da YaCy-Ui: fixed some bugs and updated to jQuery-ui 1.5b4
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4866 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 19:15:01 +00:00
apfelmaennchen
c80dc7e6b6 YaCy-UI: updated to jquery-1.2.6
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4865 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 16:56:00 +00:00
apfelmaennchen
64aaa81eda YaCy-UI: updated to jquery-1.2.6
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4864 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 16:47:41 +00:00
apfelmaennchen
16f98e7a5f YaCy-UI: introduction of modal window for edit bookmarks dialouge...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4863 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 16:34:54 +00:00
apfelmaennchen
17375a3d11 YaCy-UI: small fix for FF3 bug with pagination of search result
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4862 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-28 16:32:37 +00:00
orbiter
11e00a0849 - refactoring of seedURL handling
- additional check for seedURL pointing to localhost: deny such peers

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4851 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-25 18:35:38 +00:00
orbiter
01b3e9431a - fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1140&p=7626#p7626
- less dots for ppm bar in watchcrawler (one dot for each 10 ppm)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4846 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 11:30:16 +00:00
orbiter
d8277e6af1 - added parsing of numeric html entities for crawler
- fixed a bug in search response

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4843 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-24 10:26:24 +00:00
orbiter
0c173821fd more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4838 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-23 09:45:33 +00:00
orbiter
e4d93599e6 - added another network definition for personal web portals (replacing robinson peers in freeworld) for default use case selection. This solves the problem that the public network freeworld can spoil the personal web index during configuration phase with index entries that the user does not want for his personal web portal
- changed network selection to new network 'webportal' in ConfigBasic servlet
- removed unused servlets from yacy/ui


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4837 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-23 09:17:30 +00:00
orbiter
53dfe9fe9a added RECENT command for search query:
add RECENT (in uppercase letters) to the search words and results will be ordered by date (recent first)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4825 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-18 21:29:43 +00:00
apfelmaennchen
aa29a8c165 YaCy-UI: small optical changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4822 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-18 08:59:21 +00:00
apfelmaennchen
f494d944fd YaCy-UI: basic support for searching bookmark tags...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4821 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-18 08:53:13 +00:00
apfelmaennchen
c8c93c198b ywidget: added img file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4820 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 20:26:00 +00:00
apfelmaennchen
9b686fed35 ywidget: added config form (currently not functinoal)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4819 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 19:29:21 +00:00
apfelmaennchen
b5faea410b ywidget: added footer and small optical changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4818 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 16:40:32 +00:00
apfelmaennchen
ecc11da8ac moved styles to ywidget.css
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4817 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 10:33:12 +00:00
apfelmaennchen
4e0f031722 small feature fix that limited ywidget to 5 rss items
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4816 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 09:41:17 +00:00
apfelmaennchen
125b28622f needed for ywidget
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4815 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 09:23:59 +00:00
apfelmaennchen
1019fd91c0 - added /yacy/ui/ywidget.html
- it can be used with all yacy search parameters?search=yacy;contentdom=text;count=40;offset=0

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4814 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 09:17:20 +00:00
orbiter
3aa69dab94 prevent too high search request frequency submitted from the same peer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4813 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-17 00:11:35 +00:00
orbiter
cfe6790498 - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
from the ConfigNetwork online interface
- to make this possible, a large refactoring and reorganisation of data structures was necessary

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4803 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-14 21:36:02 +00:00
apfelmaennchen
7429687601 small bug fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4802 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-14 20:57:35 +00:00
apfelmaennchen
c689d6f061 YaCy-UI now supports searching Sciencenet...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4801 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-05-14 20:47:45 +00:00