From 99948780051489a5de8c7d7f69aa96c064d60a51 Mon Sep 17 00:00:00 2001 From: zhangchunyang Date: Mon, 25 May 2020 17:59:30 +0800 Subject: [PATCH] Added instructions for ambari to add and remove Dolphin Schdumer components on nodes (#2806) * delete unnecessary configuration items * Added instructions for ambari to add and remove Dolphin Schdumer components on nodes * Added instructions for ambari to add and remove Dolphin Schdumer components on nodes --- ambari_plugin/README.md | 103 ++++++++++++++++++++++++++++------------ 1 file changed, 72 insertions(+), 31 deletions(-) diff --git a/ambari_plugin/README.md b/ambari_plugin/README.md index 2905580431..817b7abbcd 100644 --- a/ambari_plugin/README.md +++ b/ambari_plugin/README.md @@ -1,41 +1,41 @@ -### Dolphin Scheduler的Ambari插件使用说明 +### Instructions for using the Dolphin Scheduler's Ambari plug-in -##### 备注 +#### Note -1. 本文档适用于对Ambari中基本了解的用户 -2. 本文档是对已安装Ambari服务添加Dolphin Scheduler(1.3.0版本)服务的说明 +1. This document is intended for users with a basic understanding of Ambari +2. This document is a description of adding the Dolphin Scheduler(version 1.3.0) service to the installed Ambari service -##### 一 安装准备 +#### Installation preparation -1. 准备RPM包 +1. Prepare the RPM packages - - 在项目根目录下执行命令```mvn -U clean install -Prpmbuild -Dmaven.test.skip=true -X```即可生成(在目录 dolphinscheduler-dist/target/rpm/apache-dolphinscheduler-incubating/RPMS/noarch 下) + - It is generated by executing the command ```mvn -U clean install -Prpmbuild -Dmaven.test.skip=true -X``` in the project root directory (In the directory: dolphinscheduler-dist/target/rpm/apache-dolphinscheduler-incubating/RPMS/noarch ) -2. 创建DS的安装用户--安装目录(/opt/soft)有读写权限 +2. Create an installation for DS，who have read and write access to the installation directory (/opt/soft) -3. rpm安装 +3. Install with rpm package - - 手动安装（推荐）： - - copy准备的rpm包到集群的各个节点 - - 用DS的安装用户执行: ```rpm -ivh apache-dolphinscheduler-incubating-xxx.noarch.rpm``` - - ambar自动安装 - - 集群的各个节点需要配置本地yum源 - - copy准备的rpm包到各个节点本地yum源 + - Manual installation (recommended）： + - Copy the prepared RPM packages to each node of the cluster + - Execute with DS installation user: ```rpm -ivh apache-dolphinscheduler-incubating-xxx.noarch.rpm``` + - Automatic installation with ambari + - Each node of the cluster needs to configure the local yum source + - Copy the prepared RPM packages to each node local yum source -4. copy插件目录 +4. Copy plug-in directory - - copy目录ambari_plugin/common-services/DOLPHIN到ambari-server/resources/common-services/下 - - copy目录ambari_plugin/statcks/DOLPHIN到 ambari-server/resources/stacks/HDP/2.6/services/下--stack版本2.6根据实际情况选择 + - copy directory ambari_plugin/common-services/DOLPHIN to ambari-server/resources/common-services/ + - copy directory ambari_plugin/statcks/DOLPHIN to ambari-server/resources/stacks/HDP/2.6/services/--stack version is selected based on the actual situation -5. 初始化数据库信息 +5. Initializes the database information ``` - -- 创建Dolphin Scheduler的数据库：dolphinscheduler + -- Create the database for the Dolphin Scheduler：dolphinscheduler CREATE DATABASE dolphinscheduler DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci; - -- 初始化dolphinscheduler数据库的用户和密码，并分配权限 - -- 替换下面sql语句中的{user}为dolphinscheduler数据库的用户 + -- Initialize the user and password for the dolphinscheduler database and assign permissions + -- Replace the {user} in the SQL statement below with the user of the dolphinscheduler database GRANT ALL PRIVILEGES ON dolphinscheduler.* TO '{user}'@'%' IDENTIFIED BY '{password}'; GRANT ALL PRIVILEGES ON dolphinscheduler.* TO '{user}'@'localhost' IDENTIFIED BY '{password}'; @@ -44,39 +44,80 @@ -##### 二 Ambari安装Dolphin Scheduler +#### Ambari Install Dolphin Scheduler -1. Ambari界面安装Dolphin Scheduler +1. Install Dolphin Scheduler on ambari web interface ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_001.png) -2. 选择Dolphin Scheduler的Master安装的节点 +2. Select the nodes for the Dolphin Scheduler's Master installation ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_002.png) -3. 配置Dolphin Scheduler的Worker、Api、Logger、Alert安装的节点 +3. Configure the Dolphin Scheduler's nodes for Worker, Api, Logger, Alert installation ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_003.png) -4. 设置Dolphin Scheduler服务的安装用户（**步骤一中创建的**）及所属的用户组 +4. Set the installation users of the Dolphin Scheduler service (created in step 1) and the user groups they belong to ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_004.png) -5. 配置数据库的信息（和步骤一中初始化数据库中一致） +5. Configure the database information (same as in the initialization database in step 1) ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_005.png) -6. 配置其它的信息--如果需要的话 +6. Configure additional information if needed ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_006.png) ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_007.png) -7. 正常执行接下来的步骤 +7. Perform the next steps as normal ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_008.png) -8. 安装成功后的界面 +8. The interface after successful installation ![](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_009.png) + + + +------ + + + +#### Add components to the node through Ambari -- for example, add a DS Worker + +***NOTE***: DS Logger is the installation dependent component of DS Worker in Dolphin's Ambari installation (need to add installation first; Prevent the Job log on the corresponding Worker from being checked) + +1. Locate the component node to add -- for example, node ark3 + + ![DS2_AMBARI_011](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_011.png) + +2. Add components -- the drop-down list is all addable + + ![DS2_AMBARI_012](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_012.png) + +3. Confirm component addition + + ![DS2_AMBARI_013](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_013.png) + +4. After adding DS Worker and DS Logger components + + ![DS2_AMBARI_015](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_015.png) + +5. Start the component + + ![DS2_AMBARI_016](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_016.png) + + + +#### Remove the component from the node with Ambari + +1. Stop the component in the corresponding node + + ![DS2_AMBARI_018](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_018.png) + +2. Remove components + ![DS2_AMBARI_019](https://github.com/apache/incubator-dolphinscheduler-website/blob/master/img/ambari-plugin/DS2_AMBARI_019.png) \ No newline at end of file