Browse Source

[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)

* [doc] Use Rainbond deployment DolphinScheduler Cluster

Signed-off-by: Qi Zhang <smallqi1@163.com>

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/en/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* Update docs/docs/zh/guide/installation/rainbond.md

* [doc] modify rainbond doc and add image

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: img link

Signed-off-by: Qi Zhang <smallqi1@163.com>

* fix: modify proposal

Signed-off-by: Qi Zhang <smallqi1@163.com>

* docs: move rainbond docs to integration

Signed-off-by: Qi Zhang <smallqi1@163.com>

Signed-off-by: Qi Zhang <smallqi1@163.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3.1.0-release
Qi Zhang 2 years ago committed by GitHub
parent
commit
a4bdadbb84
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
  1. 18
      docs/configs/docsdev.js
  2. 64
      docs/docs/en/guide/integration/rainbond.md
  3. 65
      docs/docs/zh/guide/integration/rainbond.md
  4. BIN
      docs/img/rainbond/appstore-dolphinscheduler.png
  5. BIN
      docs/img/rainbond/dolpscheduler-worker.png
  6. BIN
      docs/img/rainbond/homepage-dolphinscheduler.png
  7. BIN
      docs/img/rainbond/install-dolphinscheduler.png
  8. BIN
      docs/img/rainbond/monitor-dolphinscheduler.png
  9. BIN
      docs/img/rainbond/plugin.png
  10. BIN
      docs/img/rainbond/topology-dolphinscheduler.png

18
docs/configs/docsdev.js

@ -386,6 +386,15 @@ export default {
title: 'Kubernetes Deployment', title: 'Kubernetes Deployment',
link: '/en-us/docs/dev/user_doc/guide/installation/kubernetes.html', link: '/en-us/docs/dev/user_doc/guide/installation/kubernetes.html',
}, },
{
title: 'integration',
children: [
{
title: 'Rainbond Deployment',
link: '/en-us/docs/dev/user_doc/guide/integration/rainbond.html',
},
],
},
], ],
}, },
{ {
@ -965,6 +974,15 @@ export default {
title: 'Kubernetes部署(Kubernetes)', title: 'Kubernetes部署(Kubernetes)',
link: '/zh-cn/docs/dev/user_doc/guide/installation/kubernetes.html', link: '/zh-cn/docs/dev/user_doc/guide/installation/kubernetes.html',
}, },
{
title: '集成',
children: [
{
title: '基于Rainbond部署(Cluster)',
link: '/zh-cn/docs/dev/user_doc/guide/integration/rainbond.html',
},
],
},
], ],
}, },
{ {

64
docs/docs/en/guide/integration/rainbond.md

@ -0,0 +1,64 @@
# Use Rainbond Deployment
This section describes the one-click deployment of high availability DolphinScheduler clusters through the [Rainbond](https://www.rainbond.com/) cloud native application management platform. This method is suitable for users who don't know much about complex technologies such as `Kubernetes`, lowering the threshold for deploying DolphinScheduler in `Kubernetes` mode.
## Prerequisites
* Available Rainbond cloud native application management platform is a prerequisite,please refer to the official `Rainbond` documentation [Rainbond Quick install](https://www.rainbond.com/docs/quick-start/quick-install)
## DolphinScheduler Cluster One-click Deployment
* Logging in and accessing the built-in open source app store, search the keyword `dolphinscheduler` to find the DolphinScheduler App.
![](../../../../img/rainbond/appstore-dolphinscheduler.png)
* Click `install` on the right side of DolphinScheduler to go to the installation page. Fill in the corresponding information and click `OK` to start the installation. You will get automatically redirected to the application view.
| Select item | Description |
| ------------ | ------------------------------------ |
| Team name | user workspace,Isolate by namespace |
| Cluster name | select kubernetes cluster |
| Select app | select application |
| app version | select DolphinScheduler version |
![](../../../../img/rainbond/install-dolphinscheduler.png)
* Wait a few minutes, the installation completes and `DolphinScheduler` will be running.
![](../../../../img/rainbond/topology-dolphinscheduler.png)
* Access DolphinScheduler-API components and the default user credentials are `admin` / `dolphinscheduler123`.
![](../../../../img/rainbond/homepage-dolphinscheduler.png)
## API Master Worker Node Telescopic
DolphinScheduler API、Master、Worker all support scaling multiple instances, ensuring the high availability of the entire service.
Take `worker` as an example: enter the `component -> Telescopic` page, and set the number of instances.
![](../../../../img/rainbond/dolpscheduler-worker.png)
To verify `worker` node, enter `DolphinScheduler UI -> Monitoring -> Worker` page to view detailed node information.
![](../../../../img/rainbond/monitor-dolphinscheduler.png)
## Configuration file
API and Worker Services share the configuration file `/opt/dolphinscheduler/conf/common.properties`. To modify the configurations, you only need to modify that of the API service.
## How to support Python 3?
Worker service is installed with default `Python3`,you can add environment variables `PYTHON_HOME=/usr/bin/python3`
## How to support Hadoop, Spark, DataX ?
Take `DataX` as an example:
1. Install the plugin。Rainbond Team View -> Plugin -> Install plugin from the App Store -> search `initialization plugin` Install.
2. Open plugin.enter Worker component -> plugin -> open `initialization plugin` and modify the configuration.
* FILE_URL:http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz
* FILE_PATH:/opt/soft
* LOCK_PATH:/opt/soft
3. Update component, the plug-in `Datax` will be downloaded automatically and decompress to `/opt/soft`
![](../../../../img/rainbond/plugin.png)
---

65
docs/docs/zh/guide/integration/rainbond.md

@ -0,0 +1,65 @@
# 基于 Rainbond 部署 DolphinScheduler 高可用集群
本文描述通过 [Rainbond](https://www.rainbond.com/) 云原生应用管理平台 一键部署高可用的 DolphinScheduler 集群,这种方式适合给不太了解 Kubernetes、容器化等复杂技术的用户使用,降低了在 Kubernetes 中部署 DolphinScheduler 的门槛。
## 前提条件
* 可用的 Rainbond 云原生应用管理平台,请参阅文档 [Rainbond 快速安装](https://www.rainbond.com/docs/quick-start/quick-install)
## DolphinScheduler 集群一键部署
* 对接并访问内置的开源应用商店,搜索关键词 `dolphinscheduler` 即可找到 DolphinScheduler 应用。
![](../../../../img/rainbond/appstore-dolphinscheduler.png)
* 点击 DolphinScheduler 右侧的 `安装` 进入安装页面,填写对应的信息,点击确定即可开始安装,自动跳转至应用视图。
| 选择项 | 说明 |
| -------- | ------------------------------------------------------------ |
| 团队名称 | 用户自建的工作空间,以命名空间隔离 |
| 集群名称 | 选择 DolphinScheduler 被部署到哪一个 K8s 集群 |
| 选择应用 | 选择 DolphinScheduler 被部署到哪一个应用,应用中包含有若干有关联的组件 |
| 应用版本 | 选择 DolphinScheduler 的版本,目前可选版本为 3.0.0-beta2 |
![](../../../../img/rainbond/install-dolphinscheduler.png)
* 等待几分钟后,DolphinScheduler 集群就会安装完成,并运行起来。
![](../../../../img/rainbond/topology-dolphinscheduler.png)
* 点击访问,将访问 DolphinScheduler-API 组件,默认的用户密码是`admin` / `dolphinscheduler123`
![](../../../../img/rainbond/homepage-dolphinscheduler.png)
## API Master Worker 节点伸缩
DolphinScheduler API、Master、Worker 都支持伸缩多个实例,多个实例可以保证整个集群的高可用性。
以 Worker 为例,进入组件内 -> 伸缩,设置实例数量。
![](../../../../img/rainbond/dolpscheduler-worker.png)
验证 Worker 节点,进入 DolphinScheduler UI -> 监控中心 -> Worker 查看节点信息。
![](../../../../img/rainbond/monitor-dolphinscheduler.png)
## 配置文件
API 和 Worker 服务共用 `/opt/dolphinscheduler/conf/common.properties` ,修改配置时只需修改 API 服务的配置文件。
## 如何支持 Python 3?
Worker 服务默认安装了 Python3,使用时可以添加环境变量 `PYTHON_HOME=/usr/bin/python3`
## 如何支持 Hadoop, Spark, DataX 等?
以 Datax 为例:
1. 安装插件。Rainbond 团队视图 -> 插件 -> 从应用商店安装插件 -> 搜索 `通用数据初始化插件` 并安装。
2. 开通插件。进入 Worker 组件内 -> 插件 -> 开通 `通用数据初始化插件` ,并修改配置
* FILE_URL:http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz
* FILE_PATH:/opt/soft
* LOCK_PATH:/opt/soft
3. 更新组件,初始化插件会自动下载 `Datax` 并解压到 `/opt/soft`目录下。
![](../../../../img/rainbond/plugin.png)
---

BIN
docs/img/rainbond/appstore-dolphinscheduler.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 90 KiB

BIN
docs/img/rainbond/dolpscheduler-worker.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 154 KiB

BIN
docs/img/rainbond/homepage-dolphinscheduler.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 642 KiB

BIN
docs/img/rainbond/install-dolphinscheduler.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 128 KiB

BIN
docs/img/rainbond/monitor-dolphinscheduler.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 718 KiB

BIN
docs/img/rainbond/plugin.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 120 KiB

BIN
docs/img/rainbond/topology-dolphinscheduler.png

Binary file not shown.

After

Width:  |  Height:  |  Size: 425 KiB

Loading…
Cancel
Save