Commit Graph

14458 Commits

Author SHA1 Message Date
reger24
6a5f0b3684 Servlet IndexBroser_p add button "Add to blacklist"
allows to add the displayed host to add to the default blacklist
2022-01-30 21:01:23 +01:00
reger24
7ca7495b19 Update sub project GitComInf
- to complete without exception if not run in a git clone (to make the root build complete without build error)
- update gradle-wrapper to same version as root project (v7.3.3)
2022-01-30 19:31:31 +01:00
reger24
3208b2a54c Remove unnecessary jar destinationDir from Gradle build script
- 1. not needed as in dev environment IDE's and from commandline  gradlew run should/is be used to run YaCy (instead of startYACY) and Gradle makes sure yacycore.jar is on classpath

- 2. creates problem on compile if in source AND htroot some code has changed
as old yacycore.jar remains in lib (not removed by clean)
2022-01-30 19:26:07 +01:00
Lukas Fülling
111cf48642 add missing prop 2022-01-29 19:28:57 +01:00
reger24
5a65133da4 remove .settings - Eclipse specific local settings not needed in distribution
.settings is created locally by Eclipse upon import as gradle project to store Eclipse specific defaults.
No need to include in distribution.

Also
   - .project   and
   - .classpath
are Eclipse specific and created by gradle and should be deleted (as not needed and IDE specific)
- left them for now as files might be needed for building project with Ant (build.xml) which is  likely still used by some.
2022-01-29 14:07:14 +01:00
reger24
ee46c3333a remove .settings - Eclipse specific local settings not needed in distribution
.settings is created locally by Eclipse upon import as gradle project to store Eclipse specific defaults.
No need to include in distribution.

Also
   -  .project   and
   - .classpath
are Eclipse specific and created by gradle and should be deleted (as not needed and IDE specific)
- left them for now as files might be needed for building project with Ant (build.xml) which is  likely still used by some.
2022-01-29 14:02:49 +01:00
reger24
97e1b510f7 Update twelvemonkeys.imageio jar to version 3.8.1 2022-01-29 12:45:58 +01:00
reger24
f33e0ed7fd revert commit 17fd1a4616
wrong file selected
2022-01-29 12:18:07 +01:00
unknown
d990ec32db delete .idea not needed in distribution
.idea is created locally by IntelliJ IDEA upon import as gradle project to store IDEA specific settings.
No need to include in distribution
2022-01-29 10:48:44 +01:00
unknown
17fd1a4616 delete .idea not needed in distribution
.idea is created locally by IntelliJ IDEA upon import as gradle project to store IDEA specific settings.
No need to include in distribution
2022-01-29 10:45:37 +01:00
unknown
8415182e48 Updade Readme.md with hint no need for user to download Gradle
as we use gradle-wrapper (gradlew) which downloads needed archives automtically if not pesent.
2022-01-29 10:36:39 +01:00
unknown
a0f6c3be00 Update htroot compare_yacy servlet
- removed metager2.de -> is down

for me also others didn't work today (but left unchanged)
but added a html onerror event to inform if connection was refused.
2022-01-29 08:53:02 +01:00
Michael Peter Christen
96e44e11bb added more bootstrap addresses 2022-01-28 13:26:51 +01:00
Michael Christen
1d7f657620
Merge pull request #437 from lifeofguenter/feature/fix-banner-typo
Fix typo + remove dead seeds
2022-01-28 13:15:03 +01:00
Michael Christen
eec1fbb921
should not be part of this merge 2022-01-28 13:14:28 +01:00
unknown
3adab5eaae Replace hardcode 'build/...' substitution variable in Gradle build file 2022-01-28 04:04:33 +01:00
Burkhard
b943e0fb03
Merge pull request #420 from iansmirlis/IndexBrowser_p
In case of reload404, load only failed documents
2022-01-28 02:02:59 +01:00
unknown
ae178c453c simplify Gradle task copyDependenciesForDistribution
and prevent that distMacApp creates build/RELEASE/MAC directory during Gradle init withou that distMacApp was requested
2022-01-27 23:59:38 +01:00
unknown
4a55bb7515 Add distMacApp task to Gradle build script
I'm not a MAC user so I'd to do it blind !
but now it's migrated from Ant an can be fine tuned.
2022-01-27 20:30:09 +01:00
unknown
78c8ae7d05 Add Unix/Linux file permission to tar.gz distribution archives 2022-01-27 14:47:56 +01:00
unknown
5dbe071b4e Fix Test error in XZParserTest - class not found
due to missing but used dependency (org.tukaani.xz)
(declared as optional not automatically fetched by gradle)

harmonized used filterTokens
2022-01-27 01:01:24 +01:00
reger24
0e7251b445 Changed Gradle build regarding prepYaCyProperties to be more reliable
The properties contain info from the local git (the last commitDate and the number of commints since last distribution-label +9000)

currently Gradle build script must execute external jar (libbuild/GitComInf-All.jar) which creates a property file. other build targets relay on the properties - so here is a currently a timing problem.

1. nice would be we could get rid of the whole gitbuildnumber thing on work with current date etc.

Changed it now to create the property file at the end - after a build
so during init no external jar execution is required but just reading the prop file.
At least a bit more stable.

in addition I include it in the repository so that a fresh pime build has it available (even some measure included to use some fake if file is missing)
2022-01-26 14:54:18 +01:00
reger24
bec019049e Updated Readme "Compiling YaCy:" to reflect move to gradle 2022-01-26 14:42:09 +01:00
reger24
8d0f3d4208 Removed the Blacklist_p default=shared for new created blacklists issue https://github.com/yacy/yacy_search_server/issues/374
Is nice to be able to import blacklist from other peers
but shared by default is likely not intentional choosen by user
2022-01-26 14:31:52 +01:00
Michael Christen
1244aaad6e
Merge pull request #447 from WeNeedCoffee/patch-1
Typos, spelling, and grammar in README.md
2022-01-26 13:02:05 +01:00
Michael Christen
6ace9789b5
Merge pull request #448 from WeNeedCoffee/patch-2
Various javadoc fixes
2022-01-26 13:01:29 +01:00
Daleth Darko
3ced06c731 Various javadoc fixes 2022-01-26 11:22:43 +01:00
Daleth Darko
2954997027 Typos, spelling, and grammar in README.md 2022-01-26 10:47:13 +01:00
Burkhard
242745f622
Updated "To start developing YaCy in Eclipse:"
to reflect the change to Gradle
2022-01-26 08:52:57 +01:00
reger24
255a709a65 Cleanup Gradle local config dir
.gradle is greated locally by gradle wrapper no need to include in git clones
2022-01-26 07:24:19 +01:00
reger24
4d8b3311c4 Update to Gradle 7.3.3 2022-01-26 07:13:42 +01:00
reger24
6a1e259fd0 Fix NPE in Switchboard . getURL https://github.com/yacy/yacy_search_server/issues/441 2022-01-26 06:07:38 +01:00
reger24
3996fb0920 Config Gradle standard distZip/distTar to use legacy archive file name
distTar is configured to use tar+gzip compression and creates now a archive named like  yacy_v1.925_20220125_10199.tar.gz  or distZip like yacy_v1.925_20220125_10199.zip
The legacy migration from Ant  -> gradle task packageDist  creates the same archive names.

but NOW in directory build/distributions/legacyDistFiles
to be able to use both in parallel (until knowing which one works better)
2022-01-25 16:19:46 +01:00
reger24
68e5c41385 Fix for upgrade to Gradle 7.3.3
see comment https://github.com/yacy/yacy_search_server/issues/377#issuecomment-1021068633
2022-01-25 14:11:24 +01:00
reger24
475e1c7907 Fix build error for IntelliJ after fake sourceSet htroot has been add ( dfc7a23e60 )
commit dfc7a23e60  uncomments the fake additional Gradle sourceSet (to make htroot in IDE visible), resulting in build error in IntelliJ IDEA if one uses just the IDE build button (and the old Ant build.xml is not available ... what is to expect soon).
This button runs as to expect the default Gradle task
   > Task :htrootClasses    (not our task compileHtrootServlets)
result :
htroot\processing\domaingraph\applet\domaingraph.java:1: error: package processing.core does not exist
import processing.core.*; import traer.physics.*; import traer.animation.*; import processing.net.*; import java.applet.*; import java.awt.*; import java.awt.image.*; import java.awt.event.*; import java.io.*; import java.net.*; import java.text.*; import java.util.*; import java.util.zip.*; public class domaingraph extends PApplet {// Domain visualization graph for YaCy
2022-01-25 13:18:02 +01:00
Burkhard
459dfae4c0
add: To start developing YaCy in IntelliJ IDEA 2022-01-25 12:07:52 +01:00
Michael Christen
6c6cc28c13
Merge pull request #443 from WeNeedCoffee/gradle-idea-patch
Idea project files by Gradle not ANT
2022-01-25 11:50:49 +01:00
reger24
65034be1ee Fix IntelliJ IDEA prime build error
test case
- install IntelliJ IDEA
   - New -> Project from Version Control     .....  and clone from github
- IntelliJ   Infobox  "Gradle build script found" -> "Load Gradle Project"
- in UI  execute task build
result: build error in compileHtrootServlets - (which would require manual interaction to get rid of)

reason IntelliJ apparently creates build directory before run build.gradle or configured as gradle project

solution: use other check condition for compileHtrootServlets to run
2022-01-25 09:31:42 +01:00
Daleth Darko
e673c3b57f removed redundant line from gitignore 2022-01-25 07:40:07 +01:00
Daleth Darko
dfc7a23e60 Idea project files by Gradle not ANT
As per the comment by @reger24
2022-01-25 07:31:51 +01:00
reger24
c49e9039e8 Prevent build script failing on prime build with fresh git clone
reason of failure was task compileHtrootServlets executing during gradle init
and javac resulting in error as not dependencies available in build dir

- happened only on very first build with with a fresh cloned repository
2022-01-25 03:46:35 +01:00
Michael Christen
def68aeafa
Merge pull request #442 from WeNeedCoffee/idea-patch
Idea project files
2022-01-24 23:18:41 +01:00
Daleth Darko
f93c947c0d Idea project files 2022-01-24 18:27:35 +01:00
reger24
eae16287e9 Added epub (ebook) format to existing zipParser
*.epub files are zip files containing xhtml files with content and other artifact files,
which the zipParser can  already feed to index
- extension "epub"
- mime "epub+zip"
2022-01-24 13:51:27 +01:00
reger24
a751369246 Further cleaned out transient dependencies + optimizations
- updated some jar's (as Gradle build relies only on one jar in lib dir)
	- guava-31.0.1-jre.jar
	- jsoup-1.14.3.jar
	- pdfbox-2.0.25.jar
- removed the not overwrite loop in copyDependenciesForDistribution as target dir is buildDir (not lib)
2022-01-24 10:37:11 +01:00
reger24
06cd77f7bc Clean up some transient dependencies
- not needed for Gradle build
one reason to love Maven and Gradle handles it too.
2022-01-23 07:58:33 +01:00
reger24
fa2fd37a48 Added NSIS plugin to Gradle build create Win install executable
found this nice NSIS plugin which doesn't require local NSIS installation
allowing to implement similar function as in old Ant build
using the existing build.nsi

- task distWinInstaller
- resulting *.exe  in build/distributions
2022-01-23 01:48:02 +01:00
reger24
6dcb58a4b5 Configured Gradle javadoc, added distribution archive for portalsearch
- in case it's really used separately

with that most Ant build targets are available native in Gradle build (imho all targets we  really need - see list of legacy Ant targets)

- "readBuildProperties" = see no use
- "init" = not needed (ant internal prop initialization)
- "javadoc" = gradle-task javadoc
- "compile-core" = gradle-task build
- "compile-htroot" = gradle-task compileHtrootServlets
- "compile" = gradle-task build
- "all" = gradle-task build
- "copyMain4Dist" = gradle-task packageDist
- "compileTest" = gradle-task compileTestJava (std)
- "test" = gradle-task test (std)
- "dist" = gradle-task packageDist
- "portalsearch" = gradle-task packagePortalsearch (is that file still used?)
- "clean" = gradle-task clean (std)
- "run" = gradle-task run (std) or shell
- "run-single" = not needed (old stuff)
- "debug" = won't gradleize ide or run
- "stop" = just a shell script
- "create-doc" = gradle-task javadoc
- "distWinInstaller" = won't impl. external tool needed
- "distMacApp" = won't impl. external tool needed
- "deleteData" = hm, won't impl. use nomale system
2022-01-22 10:56:11 +01:00
reger24
2e177661c9 Implement creation of legacy distribution archive in Gradle
- Gradle task to execute "packageDist"
	- this will create *.tar.gz and *.zip archive
	- with legacy file name convention
- archive is created in build/distributions

- for the libbuild J7Zip-modified.jar use fallback as file dependency in lib
  as Gradle/Groovy use internal just the classes from subprojects with result
  that in above no jar is included in lib but a bunch of *.class files
- added also the option to publish J7Zip-modified.jar to mavenLocal() repo.
2022-01-22 06:27:14 +01:00
reger24
4df29edd03 Implement the Ant javac task to compile htroot direct in Gradle
- import of the build.xml not longer needed and removed
2022-01-21 07:42:47 +01:00