Marown/yacy_search_server
1
0
Fork 0
mirror of https://github.com/yacy/yacy_search_server.git synced 2024-09-21 00:00:13 +02:00
Code Issues Actions Packages Projects Releases Wiki Activity

*) Bugfix for MalformedURL problem if Location header is empty.

Browse Source 
See: http://www.yacy-forum.de/viewtopic.php?p=14325#14325

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1247 6c8d7289-2bf4-0310-a012-ef5d649a1542
This commit is contained in:
theli 2005-12-25 13:56:11 +00:00
parent 28f890ee3e
commit d7b6dcbe2e
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
source/de/anomic/plasma/plasmaCrawlWorker.java
View File

@ -417,6 +417,11 @@ public final class plasmaCrawlWorker extends Thread {
String redirectionUrlString = (String) res.responseHeader.get(httpHeader.LOCATION);
redirectionUrlString = redirectionUrlString.trim();
if (redirectionUrlString.length() == 0) {
log.logWarning("CRAWLER Recirection of URL=" + url.toString() + " aborted. Location header is empty.");
return;
}
// normalizing URL
redirectionUrlString = htmlFilterContentScraper.urlNormalform(url, redirectionUrlString);