Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-19 00:01:41 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity
7,754 Commits 1 Branch 20 Tags 836 MiB
ac5bda205f
Commit Graph

7754 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
orbiter
ac5bda205f - removed lower page navigation (it never looks nice) 
- added visibility of metadata and parser in search results since that shows what YaCy can do in a nice way

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8091 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 13:30:42 +00:00
orbiter
c659310e89 - removed option to search for audio, video and applications. These things are still experimental and should not be shown to new users since this would cause them to argue that YaCy does not work. The functions are stil available, because: 
- added a configuration option in ConfigPortal to swtich the search media types on or off

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8090 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 13:07:03 +00:00
orbiter
1120f0c93c update to network graphics: slightly less crawling activity, slightly stronger color for query activity 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8089 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 12:55:09 +00:00
orbiter
e799ee55b9 fix for web structure if there is no web structure 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8088 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 10:29:20 +00:00
orbiter
6cd27473f5 - better default values for caching and cache usage 
- set new caching and verification behavior according to use case automatically

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8087 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 10:22:02 +00:00
orbiter
709013385a fix for language fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8086 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 09:50:30 +00:00
orbiter
1019c36dad bug fixes and speed enhancements for search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8085 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-24 01:30:12 +00:00
orbiter
507c9d478d much better timing when search globally; less blocking; more results earlier! 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8084 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 23:39:34 +00:00
orbiter
8e0b2c5832 fixed cluster search 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8083 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 22:21:14 +00:00
orbiter
c0c6e9e7a5 fix for bad language encoding 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8082 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 22:03:08 +00:00
orbiter
368b51ed5b argh.. fixed bad SVN 8080 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8081 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 21:44:56 +00:00
orbiter
eb4436defb removed limitation to cluster peers if peer is asked remotely. This enables single-linked clusters which naturaly is there first if a new cluster is created 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8080 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 21:40:11 +00:00
orbiter
d0b4e5fa4d added grafics for tutorial page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8079 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 21:38:57 +00:00
orbiter
7463fafabe moved the Save button 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8078 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 20:13:57 +00:00
orbiter
ccd29e9ee3 moved the help menu point (it is not any more related to search but to YaCy itself) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8077 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 15:51:39 +00:00
orbiter
fa224c4bf7 removed Mac command file becuase the latest Mac OS does not support this. 
we will have a Mac Application instead

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8076 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 15:45:05 +00:00
orbiter
4fa8072b5b replaced old help page with tutorial movies 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8075 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 15:43:49 +00:00
orbiter
5866c73a09 fix for compare search: use scroogle instead of bing and get a default search if configured search engine is not available 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8074 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 15:17:46 +00:00
orbiter
9f3ea1d0f4 removed google from compare search because google does not allow embedding of the search page in iframes (it just does not work any more) 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8073 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-23 15:07:10 +00:00
apfelmaennchen
564374d1fe - included YMarks in addition to old bookmarks in yacysearchitem.html; don't get confused by the old bookmark dialog, the ymark is automatically added silently beforehand. 
- reworked bookmark creation on crawlstart
- many smaller adjustments to ymarks


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8072 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 23:50:49 +00:00
orbiter
05f34a3fa7 added a full, complete, database insert, update and delete API for the tables. 
Please see this example:

list all database tables:
http://localhost:8090/api/table_p.xml

now create a new table and insert some values into 'mytable'
http://localhost:8090/api/table_p.xml?table=mytable&pk=&commitrow=&col_termin=Release%20Machen&col_datum=24.11.2011&col_status=ongoing

list the table content:
http://localhost:8090/api/table_p.xml?table=mytable&pk=

update the table and change a single value inside. You must refer to the row using a primary key 'pk'
http://localhost:8090/api/table_p.xml?table=mytable&pk=000000000001&commitrow=&col_datum=29.11.2011

you can also select rows using a search operator
http://localhost:8090/api/table_p.xml?table=mytable&pk=&count=10&search=

now lets delete the row:
http://localhost:8090/api/table_p.xml?table=mytable&pk=&deleterows=pk_000000000001

and we can also delete the complete table:
http://localhost:8090/api/table_p.xml?table=mytable&deletetable=

You can use this to administrate the robots, bookmarks and API steering using an outside application!

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8071 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 12:31:07 +00:00
lotus
3cc93325f0 temporary remove compare search from tray 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8070 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 12:12:25 +00:00
lotus
d4ad01643c fix start on fresh windows. 
reason: -XX:ReservedCodeCacheSize=1024m may be too large (introduced in 7823)
error message: could not create virtual machine

there are more differences from the _debug.bat start script for the start parameters
please check whether they are needed:
-Xss256k -XX:MaxPermSize=256m -XX:+UseAdaptiveSizePolicy

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8069 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 12:04:24 +00:00
orbiter
d9d6ed3400 added api link to api page 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8068 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 10:38:32 +00:00
orbiter
393cdc517e added api link to YMarks.html 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8067 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 10:36:20 +00:00
orbiter
8e2bb17532 added api icon in table administration which appears automatically if a table was selected 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8066 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 10:18:56 +00:00
orbiter
c461c1eebf fixed xml output for table retrieval 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8065 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 10:18:13 +00:00
orbiter
d449547023 fix for http://bugs.yacy.net/view.php?id=72 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8064 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 00:22:09 +00:00
orbiter
c93f10417a add a bookmark automatically each time a new crawl is started 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8063 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-22 00:03:20 +00:00
orbiter
e4a82ddd8b produce a bookmark entry from every crawl start. these bookmarks are always private. 
these bookmarks will be used to get a source reference for the search in case of intranet or portal searches.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8062 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-21 23:10:29 +00:00
orbiter
257c399d29 added a 'fork me' banner to motivate people to get hands on the code 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8061 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-21 14:02:14 +00:00
apfelmaennchen
6287c2b4a9 YMarks: 
- introduced tag manager - a quite powerful tool (still not 100% stable, so be careful)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8060 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-20 22:42:15 +00:00
cominch
2236e01137 Minor correction to prevent useless comma at beginning of string, created from list 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8059 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-20 15:20:57 +00:00
apfelmaennchen
5581be12fb YMarks: 
- added backend and api for tag management


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8058 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-19 20:59:21 +00:00
orbiter
804e48888b smaller bug fixes for search behavior; should produce less unnecessary removals and an exact number of results as shown in counter 
should also be a little bit faster

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8057 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-18 13:09:07 +00:00
apfelmaennchen
a3eebfdcba YMarks: 
- show active/running crawls
- execute crawls (works currently only if API entry is available)
- various smaller fixes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8056 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-17 23:11:27 +00:00
orbiter
c50f8f9a06 code cleanup 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8055 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-17 13:40:22 +00:00
orbiter
84c3fc9d97 local/global fixes in search, better abstraction 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8054 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-17 01:05:45 +00:00
orbiter
aca0f33f08 enhancements for extended search options 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8053 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-17 00:19:14 +00:00
apfelmaennchen
4f95f72124 YMarks: 
- working direct importer for YaCy Crawl Starts
- working direct import for old bookmarks.db

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8052 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 23:10:53 +00:00
orbiter
a635e43f40 fix for global search attribute when selecting extended search options 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8051 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 22:57:15 +00:00
orbiter
aa322bc6d0 fix 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8050 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 15:36:30 +00:00
orbiter
97d1347adb added also a default accept field to robots.txt downloads 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8049 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 15:33:55 +00:00
orbiter
f183d3822c added a default accept header in http requests since some http fraud detection functions check that this header field exist 
see also: http://bad-behavior.ioerror.us/ in source file browser.inc.php

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8048 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 15:27:43 +00:00
orbiter
06352b8d6b more logging 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8047 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 14:09:50 +00:00
orbiter
a99934226e more logging for debugging of robots.txt 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8046 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 13:56:31 +00:00
orbiter
7a5841e061 fix for robot parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8045 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 13:12:46 +00:00
orbiter
458c20ff72 fix for robot parser 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8044 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 13:06:46 +00:00
orbiter
017a01714d - enhanced logging in robots.txt parser for remote debugging 
- robots.txt is now more robust against database operations

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8043 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 01:03:49 +00:00
orbiter
5a7cec59f3 moved ynetSearch to get all files out of htroot/api/util/ 
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8042 6c8d7289-2bf4-0310-a012-ef5d649a1542
 2011-11-16 00:21:56 +00:00