Azkaban全新部署2023

https://azkaban.readthedocs.io/en/latest/

1.下载zip文件
https://github.com/azkaban/azkaban/releases

2.安装 Gradle
https://gradle.org/releases/
gradle -v

要在本地安装 Gradle，可以按照以下步骤进行操作：

下载 Gradle 发行版
可以在 Gradle 的官网 https://gradle.org/releases/ 上下载最新版本的 Gradle 发行版。选择下载 Binary only 版本，下载完成后解压到一个合适的目录下。

配置环境变量
将解压后的 Gradle 目录路径添加到系统环境变量中。在 Linux 或者 Mac 系统中，可以编辑 /etc/profile 或者 ~/.bash_profile 文件，在文件最后添加如下内容：

bash
Copy code
export GRADLE_HOME=/path/to/gradle
export PATH=$PATH:$GRADLE_HOME/bin
在 Windows 系统中，可以在控制面板中编辑系统环境变量，添加一个新的环境变量 GRADLE_HOME，并将 Gradle 的目录路径设置为该变量的值。然后将 %GRADLE_HOME%\bin 添加到系统 PATH 环境变量中。

检查安装是否成功
打开命令行窗口，输入 gradle -v 命令，如果成功输出 Gradle 的版本信息，说明安装成功。

注意：如果你使用的是 Linux 或者 Mac 系统，需要使用 sudo 命令来以管理员身份执行以上步骤。

第一个问题，运行./gradlew build 报错

FAILURE: Build failed with an exception.

* What went wrong:
Could not create service of type ScriptPluginFactory using BuildScopeServices.createScriptPluginFactory().
> Could not create service of type CrossBuildFileHashCache using BuildSessionScopeServices.createCrossBuildFileHashCache().

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 0s

解决方案
原来root账号 没有java环境

vim /etc/profile
JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
source /etc/profile

第二个问题

ote: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.


FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':azkaban-web-server:restliTemplateGenerator'.
> Could not resolve all files for configuration ':azkaban-web-server:generateRestli'.
   > Could not resolve com.linkedin.pegasus:generator:28.3.11.
     Required by:
         project :azkaban-web-server
      > Could not resolve com.linkedin.pegasus:generator:28.3.11.
         > Could not get resource 'https://linkedin.bintray.com/maven/com/linkedin/pegasus/generator/28.3.11/generator-28.3.11.pom'.
            > Could not GET 'https://linkedin.bintray.com/maven/com/linkedin/pegasus/generator/28.3.11/generator-28.3.11.pom'.
               > Certificate for <linkedin.bintray.com> doesn't match any of the subject alternative names: [*.jfrog.io, *.int.jfrog.io, jfrog.io, *.pe.jfrog.io]
   > Could not resolve com.linkedin.pegasus:restli-tools:28.3.11.
     Required by:
         project :azkaban-web-server
      > Could not resolve com.linkedin.pegasus:restli-tools:28.3.11.
         > Could not get resource 'https://linkedin.bintray.com/maven/com/linkedin/pegasus/restli-tools/28.3.11/restli-tools-28.3.11.pom'.
            > Could not GET 'https://linkedin.bintray.com/maven/com/linkedin/pegasus/restli-tools/28.3.11/restli-tools-28.3.11.pom'.
               > Certificate for <linkedin.bintray.com> doesn't match any of the subject alternative names: [*.jfrog.io, *.int.jfrog.io, jfrog.io, *.pe.jfrog.io]

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 26s
24 actionable tasks: 24 executed

解决方案

第三个问题

* What went wrong:
Execution failed for task ':azkaban-web-server:nodeSetup'.
> Could not resolve all files for configuration ':azkaban-web-server:detachedConfiguration1'.
   > Could not resolve org.nodejs:node:8.10.0.
     Required by:
         project :azkaban-web-server
      > Could not resolve org.nodejs:node:8.10.0.
         > Could not get resource 'https://nodejs.org/dist/v8.10.0/ivy.xml'.
            > Could not GET 'https://nodejs.org/dist/v8.10.0/ivy.xml'. Received status code 403 from server: Forbidden

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 26s
58 actionable tasks: 36 executed, 22 up-to-date

yum install -y nodejs
yum install -y npm

其他：
azkaban-4.0.0/azkaban-exec-server/build/install/azkaban-exec-server/conf/azkaban.properties
azkaban-4.0.0/azkaban-web-server/build/install/azkaban-web-server/conf/azkaban.properties

关闭再启动
sudo ./bin/shutdown-exec.sh
sudo ./bin/shutdown-web.sh

sudo ./bin/start-exec.sh
sudo ./bin/start-web.sh

修改时区
添加邮箱告警

参考文档：
https://www.jianshu.com/p/4a26f9661f30
https://blog.csdn.net/wangzhongyudie/article/details/127249873