Commit Graph

334 Commits

Author SHA1 Message Date
orbiter
117ae78001 speed enhancement for reading of eco-table indexes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4647 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-04-06 11:50:15 +00:00
danielr
5c3c1fdf41 replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4640 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-04-05 13:17:16 +00:00
orbiter
7f9f639d20 - refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
- refactoring of word/phrase handling: word abstraction from condenser becomes part of index element handling
- removed unused code parts from condenser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4603 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-26 15:37:49 +00:00
orbiter
d6050b9ffb - separated the LURL data storage and Crawl result stack for process supervision.
this is another step to enable multiple, concurrent fulltext-indexes
- another try to make the yacy-httpc more stable

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4602 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-26 14:13:05 +00:00
orbiter
541b817502 refactoring of switchboard queueing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4591 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-22 01:28:37 +00:00
apfelmaennchen
5fde618337 changed display of y-marks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4583 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-19 19:54:35 +00:00
apfelmaennchen
54cb097ea4 added .trigger("update") after paging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4574 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 22:05:50 +00:00
apfelmaennchen
82f17ccee2 just an example sidebar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4573 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 21:44:51 +00:00
apfelmaennchen
3c710f22cd added server side driven pagination for search tabs
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4572 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-16 21:44:20 +00:00
apfelmaennchen
368b8735b5 added 'close tab' function
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4560 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 15:59:56 +00:00
orbiter
fa1090113d - next try to fix the networking problem:
set the maximum transfer size to less than MTU=1500-52: buffer size <= 1448
- some refactoring of transfer methods (naming)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4558 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-14 00:16:04 +00:00
apfelmaennchen
f63bd26268 fixed search performance / dynamic display of results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4557 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 21:24:53 +00:00
orbiter
5530b8e1ca reverted changes to yacy protocol classes: they caused the sciencenet to loose connections
a comparisment with the main release 0.57 had been made: this showed a stable network
This is an emergency operation to ensure availability of the sciencenet network.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4553 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-12 00:05:18 +00:00
orbiter
b4ed937f1e - modified zone navigation (does still not work correctly)
- added dht switch in network definition
- 0.574

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4550 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-11 11:09:38 +00:00
apfelmaennchen
c75fa90206 adjusted display of search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4547 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:23:04 +00:00
apfelmaennchen
7a902424af adjusted display of search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4546 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 23:22:34 +00:00
orbiter
e0c481decb not class file in SVN .. I guess it is a mistake
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4545 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-10 19:05:06 +00:00
orbiter
9eddc1506b - one try to fix the httpd problem
- fix for handling of collection index that appears when removing elements
- added another navigation method (stub, not working yet)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4543 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 23:58:22 +00:00
apfelmaennchen
b4b370586a fixed the box headings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4541 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 17:25:09 +00:00
apfelmaennchen
f7a0804e83 small optical change for the sidebar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4540 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 13:04:34 +00:00
apfelmaennchen
c5f378c7a4 additional images
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4539 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:56:11 +00:00
apfelmaennchen
6ebc9b7325 additional images
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4538 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:55:26 +00:00
apfelmaennchen
3c686e4e0e for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4537 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:54:37 +00:00
apfelmaennchen
f238478cc3 for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4536 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:54:13 +00:00
apfelmaennchen
cb8625ca67 for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4535 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:53:50 +00:00
apfelmaennchen
2b43ea9f9d for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4534 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:53:00 +00:00
apfelmaennchen
12cac31be8 for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4533 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:52:42 +00:00
apfelmaennchen
94280b0a39 temporary check-in for testing puposes - new user interface based on jQuery and Ajax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4532 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-09 12:51:13 +00:00
orbiter
bfed9c2da6 - some refactoring in search process
- separated sidebars in new search interface and placed them in their own files
  which can be put in into the search page like plug-ins

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4529 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-03-05 21:46:55 +00:00
orbiter
3f321ece7d added a search history to the new search page
the history distinguishes between different users and identifies them by their ip
a history is only shown to the user who submitted the search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4510 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-25 21:26:49 +00:00
orbiter
c48e25d784 - fixed selection box for topwords
- fixed parser detail in condenser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4509 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-25 19:00:11 +00:00
orbiter
bd2d9f75ae introduced search navigation column on new search page
An alle JavaScript-Profis: die Anwahl einer neuen Suchseite über die Selectbox (hinter Category)
funktioniert bei mir nur mit Firefox, nicht aber mit Safari oder Camino. Kann da mal jemand
gucken woran das liegt?

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4508 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-25 18:19:22 +00:00
orbiter
a7abee3578 - fixed some data types in new search stack
- added image domain presentation to image preview
- added new search page to menu
- added automatic re-search when an old search profile is requested and a crawl is ongoing,
  to fetch newly crawled entries

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4501 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-21 23:40:38 +00:00
orbiter
bedd8dfbe2 - added image sorting by image size. This is the default now.
This is performed using a 3-stage sorting process:
  - sort by relevance, then do snippet-fetch
  - sort snippets by relevance then do image link extraction
  - sort image links by image size; unknown sizes are handled like small sizes
- only the exact amount of images as requested are shown

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4499 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-21 14:53:51 +00:00
orbiter
727feb4358 - fixed some bugs in ranking computation
- introduced generalized method to organize ranked results (2 new classes)
- added a post-ranking after snippet-fetch (before: only listed) using the new ranking data structures
- fixed some missing data fields in RWI ranking attributes and correct hand-over between data structures

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4498 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-21 10:06:57 +00:00
orbiter
f4c73d8c68 - fixed highslide usage
- some enhancement to index management, better types

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4497 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-19 14:13:35 +00:00
orbiter
3441ec3928 - some small changes to highslide integration to get it working... (does not work yet)
- performance enhancement for url list parser

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4495 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-18 23:49:03 +00:00
orbiter
6c3cd2b4f2 - added new way to watch images from the image search:
they appear as separate, floating window above the search results,
  not in a new window
- added highslide javascript library for feature mentioned above
- removed dir servlet. This thing was not used as it was supposed to be (as an example applet)
  and was a major problem for intranet-indexing when files are hosted on the same peer.
- added yacy-httpd-internal directory listing. Because YaCy is a search engine,
  directory listings are similar to search result listings. Intranet indexing from the same peer
  will get nice index pages for document collections.
- removed unused test applet

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4494 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-18 16:38:06 +00:00
orbiter
61a81820e3 - refactoring of search tracker
- added link to search history to repeat the search

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4493 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-17 23:35:48 +00:00
orbiter
4079c38ce0 - probably slightly better default ranking
- added experimental right column to new search page (no function, only container)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4487 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-16 12:13:38 +00:00
orbiter
8fd5e52f04 added basket icons and experimental gif animation class
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4485 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-16 10:40:00 +00:00
orbiter
451cde3d92 added images folder
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4484 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-16 10:36:10 +00:00
orbiter
cfe499d8c9 first test of alternative search interface (only a stub but working!)
try http://localhost:8080/yacy/user/ysearch.html

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4482 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-16 00:38:47 +00:00
orbiter
52a7cf0cc9 re-added list interface (blacklist imports need them)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4480 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-13 22:37:37 +00:00
borg-0300
22485dcca8 rename opeer -> oseed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4462 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-08 14:15:31 +00:00
borg-0300
77ba446332 seedDB helpers update/cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4461 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-08 14:06:34 +00:00
orbiter
bd63999801 - faster search: using different data structures that avoid multiplr calculations
- no more table copy for error-eco table
- optional table copy for lurl-entries
- more abstractions (less single constant strings)
- better logging (using host names instead of ips)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4459 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-07 22:16:36 +00:00
borg-0300
a8d336c379 undo 4448 (no bug)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4455 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-06 19:48:41 +00:00
borg-0300
d1758eb17d mistake corrected
cleanup

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4454 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-06 19:00:18 +00:00
borg-0300
9f69b1f08f small change (2)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4449 6c8d7289-2bf4-0310-a012-ef5d649a1542
2008-02-05 16:56:59 +00:00