sixcooler
7545822db5
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-16 01:59:48 +01:00
orbiter
5a7cec59f3
moved ynetSearch to get all files out of htroot/api/util/
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8042 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-16 00:21:56 +00:00
apfelmaennchen
a410cfd7f3
- flexigrid images didn't load last time
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8041 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-15 21:55:00 +00:00
apfelmaennchen
a8dfe787ed
- updated to jquery flexigrid 1.1
...
- YMarks.html automatically recognizes if a bookmark is a crawl start
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8040 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-15 21:45:17 +00:00
sixcooler
710ea9fcb9
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-15 18:32:09 +01:00
cominch
cef8ebc41d
getpageinfo: Checks if there is a OAI repository behind the URL.
...
This check is only performed if oai parameter is set when calling e.g. getpageinfo_p.xml?actions=oai
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8039 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-15 12:22:19 +00:00
sixcooler
0aa5e134ea
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-15 02:31:27 +01:00
orbiter
eb1c7c041d
write info about robots.txt evaluation into getpageinfo_p.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8038 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-15 00:33:54 +00:00
orbiter
f8b8c82421
- refactoring of getpageinfo_p.xml (moved out of util)
...
- added more logging in getpageinfo_p.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8037 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-15 00:22:40 +00:00
apfelmaennchen
abba31f02e
- bugfix for correctly sorting ymarks
...
- some tuning for the autotagger (still not perfect)
- /api/ymarks/get_metadata.xml now provides info for crawlstarts
- removed unused code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8036 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-14 22:00:44 +00:00
orbiter
ff32469272
added a link to /api/util/getpageinfo_p.xml as API to crawl start info and to ViewFile.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8035 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-14 20:19:41 +00:00
sixcooler
3b70ff7046
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-14 19:25:30 +01:00
orbiter
3a15e58e28
- increased stability when opening the robots table
...
- increased stability when deleting tables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8034 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-14 15:33:35 +00:00
orbiter
775b44017e
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8033 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-14 15:11:57 +00:00
sixcooler
c99a4c0920
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-14 14:07:58 +01:00
orbiter
e914a30099
fix for npe
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8032 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-14 12:32:15 +00:00
sixcooler
b92c6bf897
Trying ImageIO instead of awt-Toolkit for parsing
2011-11-14 12:37:11 +01:00
sixcooler
db5ef90b0f
Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
2011-11-14 12:22:57 +01:00
sixcooler
69dcde5cc6
not checking for the pid-file
2011-11-14 12:21:36 +01:00
sixcooler
9f8240b350
script for clean copy of URL-tables
2011-11-14 12:20:59 +01:00
sixcooler
5c58eda45a
custom start-script
2011-11-14 12:20:33 +01:00
sixcooler
f40fef8243
custom logging settings
2011-11-14 12:19:58 +01:00
sixcooler
7cf8fac83f
some filtering
2011-11-14 12:19:27 +01:00
sixcooler
3ef9f301ba
some customize on Memory-Performance-Graph
2011-11-14 12:16:07 +01:00
sixcooler
8f25070460
weekly rewrite of blobs
2011-11-14 12:14:07 +01:00
sixcooler
d6c1ab4e0f
some more unreserved characters
2011-11-14 12:11:22 +01:00
sixcooler
f522f61af0
clean offline copy of URL Tables
2011-11-14 12:09:34 +01:00
sixcooler
ee2f8673a2
memory in Perfomance Graph - just like it was in the past
2011-11-14 12:08:01 +01:00
sixcooler
2a6712e4be
sixcooler.de in seed-list bootstrap locations
2011-11-14 12:06:05 +01:00
sixcooler
54193457bc
cutom keep alive strategy
2011-11-14 11:54:48 +01:00
sixcooler
249a78ff2a
G1 Memory Strategy - not used now
2011-11-14 11:54:03 +01:00
sixcooler
ccf1583188
cutom keep alive strategy
2011-11-14 11:52:29 +01:00
sixcooler
f280e339a8
no force on Memory Request for these parser
2011-11-14 11:46:30 +01:00
apfelmaennchen
5f7dbe1c42
- some refactoring (ymarks)
...
- improvement for autotagger (is now able to create/detect multi word tags e.g. 'open source')
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8031 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-13 23:19:47 +00:00
sixcooler
6567244f2a
git testing:
2011-11-12 12:26:42 +01:00
apfelmaennchen
2f03186252
- small bug fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8030 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-12 09:25:08 +00:00
apfelmaennchen
1e55e50c49
- removed unused code from search widget
...
- added more comments for documentation
- ALT key now submits global search
- various smaller bug fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8029 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-11 23:18:02 +00:00
apfelmaennchen
f0820a9d02
- more improvements for search widget (portalsearch)
...
- added proper error handling
- greatly increased robustness
- greatly increased usability of navigators
- some smaller speed improvements
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8028 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-10 23:18:58 +00:00
orbiter
78ce3b13be
typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8027 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-10 11:57:26 +00:00
apfelmaennchen
9067ab20b2
- included missing image for portalsearch.tar.gz in build.xml
...
- compressed (minify) yacy-portalsearch.js for better performance
- removed language selector, as it doesn't work really well (at least for me)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8026 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-10 09:13:58 +00:00
apfelmaennchen
c7d117505c
- portalsearch.js some fixes for paths, when remote loading method is used
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8025 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-10 08:54:55 +00:00
apfelmaennchen
a90a72a76b
- some smaller changes to search widget
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8024 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-09 23:37:35 +00:00
apfelmaennchen
a425fbd8d6
- created new target 'portalsearch' in build.xml to generate yacy-portalsearch.tar.gz for static hosting
...
- some refactoring for search widget and jquery
- update for ConfigLiveSearch.html to refelct latest changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8023 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-09 21:01:38 +00:00
orbiter
42425c8003
fixed directDocByURL (has now effect if switched off)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8022 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-09 15:54:01 +00:00
orbiter
85d6bf4ac4
fixed urls to media content during indexing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8021 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-09 15:40:14 +00:00
orbiter
0d858d48ec
replaced String with StringBuilder in suggestion process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8020 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-09 14:42:55 +00:00
apfelmaennchen
d871812621
fix for http://bugs.yacy.net/view.php?id=68 as well as for a far more serious bug in navigator handling in the portal search widget. Navigators are now quite usable, but the GUI has still some flaws...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8019 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-08 23:01:22 +00:00
orbiter
3a807e10cf
- added a cache for active crawl profiles to the crawl switchboard
...
- moved the domain cache for domain counter from the crawl switchboard to the crawl profiles. the crawl domain counter is now therefore relative for each crawl start, not for the whole crawler.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8018 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-08 15:38:08 +00:00
orbiter
37e35f2741
normalization of url using urlencoding/decoding
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8017 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-08 12:02:22 +00:00
orbiter
e58438c01c
- added a new retry connector for solr (for cases where solr responses are slow)
...
- added a new exist property into the metadataRepository which includes solr entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8016 6c8d7289-2bf4-0310-a012-ef5d649a1542
2011-11-08 11:49:04 +00:00
