BoYiZhang
5 years ago
committed by
GitHub
99 changed files with 4777 additions and 368 deletions
@ -0,0 +1,226 @@ |
|||||||
|
# Dolphin Scheduler |
||||||
|
|
||||||
|
[Dolphin Scheduler](https://dolphinscheduler.apache.org) is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. |
||||||
|
|
||||||
|
## Introduction |
||||||
|
This chart bootstraps a [Dolphin Scheduler](https://dolphinscheduler.apache.org) distributed deployment on a [Kubernetes](http://kubernetes.io) cluster using the [Helm](https://helm.sh) package manager. |
||||||
|
|
||||||
|
## Prerequisites |
||||||
|
|
||||||
|
- Kubernetes 1.10+ |
||||||
|
- PV provisioner support in the underlying infrastructure |
||||||
|
|
||||||
|
## Installing the Chart |
||||||
|
|
||||||
|
To install the chart with the release name `my-release`: |
||||||
|
|
||||||
|
```bash |
||||||
|
$ git clone https://github.com/apache/incubator-dolphinscheduler.git |
||||||
|
$ cd incubator-dolphinscheduler |
||||||
|
$ helm install --name dolphinscheduler . |
||||||
|
``` |
||||||
|
These commands deploy Dolphin Scheduler on the Kubernetes cluster in the default configuration. The [configuration](#configuration) section lists the parameters that can be configured during installation. |
||||||
|
|
||||||
|
> **Tip**: List all releases using `helm list` |
||||||
|
|
||||||
|
## Uninstalling the Chart |
||||||
|
|
||||||
|
To uninstall/delete the `dolphinscheduler` deployment: |
||||||
|
|
||||||
|
```bash |
||||||
|
$ helm delete --purge dolphinscheduler |
||||||
|
``` |
||||||
|
|
||||||
|
The command removes all the Kubernetes components associated with the chart and deletes the release. |
||||||
|
|
||||||
|
## Configuration |
||||||
|
|
||||||
|
The following tables lists the configurable parameters of the Dolphins Scheduler chart and their default values. |
||||||
|
|
||||||
|
| Parameter | Description | Default | |
||||||
|
| --------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ | ----------------------------------------------------- | |
||||||
|
| `timezone` | World time and date for cities in all time zones | `Asia/Shanghai` | |
||||||
|
| `image.registry` | Docker image registry for the Dolphins Scheduler | `docker.io` | |
||||||
|
| `image.repository` | Docker image repository for the Dolphins Scheduler | `dolphinscheduler` | |
||||||
|
| `image.tag` | Docker image version for the Dolphins Scheduler | `1.2.1` | |
||||||
|
| `image.imagePullPolicy` | Image pull policy. One of Always, Never, IfNotPresent | `IfNotPresent` | |
||||||
|
| `imagePullSecrets` | ImagePullSecrets is an optional list of references to secrets in the same namespace to use for pulling any of the images | `[]` | |
||||||
|
| | | | |
||||||
|
| `postgresql.enabled` | If not exists external PostgreSQL, by default, the Dolphins Scheduler will use a internal PostgreSQL | `true` | |
||||||
|
| `postgresql.postgresqlUsername` | The username for internal PostgreSQL | `root` | |
||||||
|
| `postgresql.postgresqlPassword` | The password for internal PostgreSQL | `root` | |
||||||
|
| `postgresql.postgresqlDatabase` | The database for internal PostgreSQL | `dolphinscheduler` | |
||||||
|
| `postgresql.persistence.enabled` | Set `postgresql.persistence.enabled` to `true` to mount a new volume for internal PostgreSQL | `false` | |
||||||
|
| `postgresql.persistence.size` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `postgresql.persistence.storageClass` | PostgreSQL data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `externalDatabase.host` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database host will use it. | `localhost` | |
||||||
|
| `externalDatabase.port` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database port will use it. | `5432` | |
||||||
|
| `externalDatabase.username` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database username will use it. | `root` | |
||||||
|
| `externalDatabase.password` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database password will use it. | `root` | |
||||||
|
| `externalDatabase.database` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database database will use it. | `dolphinscheduler` | |
||||||
|
| | | | |
||||||
|
| `zookeeper.enabled` | If not exists external Zookeeper, by default, the Dolphin Scheduler will use a internal Zookeeper | `true` | |
||||||
|
| `zookeeper.taskQueue` | Specify task queue for `master` and `worker` | `zookeeper` | |
||||||
|
| `zookeeper.persistence.enabled` | Set `zookeeper.persistence.enabled` to `true` to mount a new volume for internal Zookeeper | `false` | |
||||||
|
| `zookeeper.persistence.size` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `zookeeper.persistence.storageClass` | Zookeeper data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `externalZookeeper.taskQueue` | If exists external Zookeeper, and set `zookeeper.enable` value to false. Specify task queue for `master` and `worker` | `zookeeper` | |
||||||
|
| `externalZookeeper.zookeeperQuorum` | If exists external Zookeeper, and set `zookeeper.enable` value to false. Specify Zookeeper quorum | `127.0.0.1:2181` | |
||||||
|
| | | | |
||||||
|
| `master.podManagementPolicy` | PodManagementPolicy controls how pods are created during initial scale up, when replacing pods on nodes, or when scaling down | `Parallel` | |
||||||
|
| `master.replicas` | Replicas is the desired number of replicas of the given Template | `3` | |
||||||
|
| `master.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `master.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `master.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `master.configmap.MASTER_EXEC_THREADS` | Master execute thread num | `100` | |
||||||
|
| `master.configmap.MASTER_EXEC_TASK_NUM` | Master execute task number in parallel | `20` | |
||||||
|
| `master.configmap.MASTER_HEARTBEAT_INTERVAL` | Master heartbeat interval | `10` | |
||||||
|
| `master.configmap.MASTER_TASK_COMMIT_RETRYTIMES` | Master commit task retry times | `5` | |
||||||
|
| `master.configmap.MASTER_TASK_COMMIT_INTERVAL` | Master commit task interval | `1000` | |
||||||
|
| `master.configmap.MASTER_MAX_CPULOAD_AVG` | Only less than cpu avg load, master server can work. default value : the number of cpu cores * 2 | `100` | |
||||||
|
| `master.configmap.MASTER_RESERVED_MEMORY` | Only larger than reserved memory, master server can work. default value : physical memory * 1/10, unit is G | `0.1` | |
||||||
|
| `master.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `master.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `master.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `master.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `master.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `master.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `master.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `master.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `master.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `master.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `master.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `master.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `master.persistentVolumeClaim.enabled` | Set `master.persistentVolumeClaim.enabled` to `true` to mount a new volume for `master` | `false` | |
||||||
|
| `master.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `master.persistentVolumeClaim.storageClassName` | `Master` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `master.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `worker.podManagementPolicy` | PodManagementPolicy controls how pods are created during initial scale up, when replacing pods on nodes, or when scaling down | `Parallel` | |
||||||
|
| `worker.replicas` | Replicas is the desired number of replicas of the given Template | `3` | |
||||||
|
| `worker.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `worker.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `worker.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `worker.configmap.WORKER_EXEC_THREADS` | Worker execute thread num | `100` | |
||||||
|
| `worker.configmap.WORKER_HEARTBEAT_INTERVAL` | Worker heartbeat interval | `10` | |
||||||
|
| `worker.configmap.WORKER_FETCH_TASK_NUM` | Submit the number of tasks at a time | `3` | |
||||||
|
| `worker.configmap.WORKER_MAX_CPULOAD_AVG` | Only less than cpu avg load, worker server can work. default value : the number of cpu cores * 2 | `100` | |
||||||
|
| `worker.configmap.WORKER_RESERVED_MEMORY` | Only larger than reserved memory, worker server can work. default value : physical memory * 1/10, unit is G | `0.1` | |
||||||
|
| `worker.configmap.DOLPHINSCHEDULER_DATA_BASEDIR_PATH` | User data directory path, self configuration, please make sure the directory exists and have read write permissions | `/tmp/dolphinscheduler` | |
||||||
|
| `worker.configmap.DOLPHINSCHEDULER_ENV` | System env path, self configuration, please read `values.yaml` | `[]` | |
||||||
|
| `worker.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `worker.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `worker.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `worker.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `worker.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `worker.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `worker.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `worker.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `worker.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `worker.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `worker.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `worker.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `worker.persistentVolumeClaim.enabled` | Set `worker.persistentVolumeClaim.enabled` to `true` to enable `persistentVolumeClaim` for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.enabled` | Set `worker.persistentVolumeClaim.dataPersistentVolume.enabled` to `true` to mount a data volume for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.storageClassName` | `Worker` data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.enabled` | Set `worker.persistentVolumeClaim.logsPersistentVolume.enabled` to `true` to mount a logs volume for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.storageClassName` | `Worker` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `alert.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `alert.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `alert.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `alert.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `alert.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `alert.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `alert.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `alert.configmap.XLS_FILE_PATH` | XLS file path | `/tmp/xls` | |
||||||
|
| `alert.configmap.MAIL_SERVER_HOST` | Mail `SERVER HOST ` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SERVER_PORT` | Mail `SERVER PORT` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SENDER` | Mail `SENDER` | `nil` | |
||||||
|
| `alert.configmap.MAIL_USER` | Mail `USER` | `nil` | |
||||||
|
| `alert.configmap.MAIL_PASSWD` | Mail `PASSWORD` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SMTP_STARTTLS_ENABLE` | Mail `SMTP STARTTLS` enable | `false` | |
||||||
|
| `alert.configmap.MAIL_SMTP_SSL_ENABLE` | Mail `SMTP SSL` enable | `false` | |
||||||
|
| `alert.configmap.MAIL_SMTP_SSL_TRUST` | Mail `SMTP SSL TRUST` | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_ENABLE` | `Enterprise Wechat` enable | `false` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_CORP_ID` | `Enterprise Wechat` corp id | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_SECRET` | `Enterprise Wechat` secret | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_AGENT_ID` | `Enterprise Wechat` agent id | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_USERS` | `Enterprise Wechat` users | `nil` | |
||||||
|
| `alert.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `alert.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `alert.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `alert.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `alert.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `alert.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `alert.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `alert.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `alert.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `alert.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `alert.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `alert.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `alert.persistentVolumeClaim.enabled` | Set `alert.persistentVolumeClaim.enabled` to `true` to mount a new volume for `alert` | `false` | |
||||||
|
| `alert.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `alert.persistentVolumeClaim.storageClassName` | `Alert` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `alert.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `api.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `api.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `api.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `api.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `api.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `api.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `api.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `api.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `api.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `api.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `api.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `api.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `api.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `api.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `api.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `api.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `api.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `api.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `api.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `api.persistentVolumeClaim.enabled` | Set `api.persistentVolumeClaim.enabled` to `true` to mount a new volume for `api` | `false` | |
||||||
|
| `api.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `api.persistentVolumeClaim.storageClassName` | `api` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `api.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `frontend.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `frontend.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `frontend.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `frontend.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `frontend.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `frontend.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `frontend.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `frontend.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `frontend.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `frontend.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `frontend.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `frontend.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `frontend.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `frontend.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `frontend.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `frontend.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `frontend.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `frontend.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `frontend.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `frontend.persistentVolumeClaim.enabled` | Set `frontend.persistentVolumeClaim.enabled` to `true` to mount a new volume for `frontend` | `false` | |
||||||
|
| `frontend.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `frontend.persistentVolumeClaim.storageClassName` | `frontend` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `frontend.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `ingress.enabled` | Enable ingress | `false` | |
||||||
|
| `ingress.host` | Ingress host | `dolphinscheduler.org` | |
||||||
|
| `ingress.path` | Ingress path | `/` | |
||||||
|
| `ingress.tls.enabled` | Enable ingress tls | `false` | |
||||||
|
| `ingress.tls.hosts` | Ingress tls hosts | `dolphinscheduler.org` | |
||||||
|
| `ingress.tls.secretName` | Ingress tls secret name | `dolphinscheduler-tls` | |
||||||
|
|
||||||
|
For more information please refer to the [chart](https://github.com/apache/incubator-dolphinscheduler.git) documentation. |
||||||
@ -0,0 +1,52 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
|
||||||
|
apiVersion: v2 |
||||||
|
name: dolphinscheduler |
||||||
|
description: Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. |
||||||
|
home: https://dolphinscheduler.apache.org |
||||||
|
icon: https://dolphinscheduler.apache.org/img/hlogo_colorful.svg |
||||||
|
keywords: |
||||||
|
- dolphinscheduler |
||||||
|
- Scheduler |
||||||
|
# A chart can be either an 'application' or a 'library' chart. |
||||||
|
# |
||||||
|
# Application charts are a collection of templates that can be packaged into versioned archives |
||||||
|
# to be deployed. |
||||||
|
# |
||||||
|
# Library charts provide useful utilities or functions for the chart developer. They're included as |
||||||
|
# a dependency of application charts to inject those utilities and functions into the rendering |
||||||
|
# pipeline. Library charts do not define any templates and therefore cannot be deployed. |
||||||
|
type: application |
||||||
|
|
||||||
|
# This is the chart version. This version number should be incremented each time you make changes |
||||||
|
# to the chart and its templates, including the app version. |
||||||
|
version: 0.1.0 |
||||||
|
|
||||||
|
# This is the version number of the application being deployed. This version number should be |
||||||
|
# incremented each time you make changes to the application. |
||||||
|
appVersion: 1.2.1 |
||||||
|
|
||||||
|
dependencies: |
||||||
|
- name: postgresql |
||||||
|
version: 8.x.x |
||||||
|
repository: https://charts.bitnami.com/bitnami |
||||||
|
condition: postgresql.enabled |
||||||
|
- name: zookeeper |
||||||
|
version: 5.x.x |
||||||
|
repository: https://charts.bitnami.com/bitnami |
||||||
|
condition: redis.enabled |
||||||
@ -0,0 +1,226 @@ |
|||||||
|
# Dolphin Scheduler |
||||||
|
|
||||||
|
[Dolphin Scheduler](https://dolphinscheduler.apache.org) is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing. |
||||||
|
|
||||||
|
## Introduction |
||||||
|
This chart bootstraps a [Dolphin Scheduler](https://dolphinscheduler.apache.org) distributed deployment on a [Kubernetes](http://kubernetes.io) cluster using the [Helm](https://helm.sh) package manager. |
||||||
|
|
||||||
|
## Prerequisites |
||||||
|
|
||||||
|
- Kubernetes 1.10+ |
||||||
|
- PV provisioner support in the underlying infrastructure |
||||||
|
|
||||||
|
## Installing the Chart |
||||||
|
|
||||||
|
To install the chart with the release name `my-release`: |
||||||
|
|
||||||
|
```bash |
||||||
|
$ git clone https://github.com/apache/incubator-dolphinscheduler.git |
||||||
|
$ cd incubator-dolphinscheduler |
||||||
|
$ helm install --name dolphinscheduler . |
||||||
|
``` |
||||||
|
These commands deploy Dolphin Scheduler on the Kubernetes cluster in the default configuration. The [configuration](#configuration) section lists the parameters that can be configured during installation. |
||||||
|
|
||||||
|
> **Tip**: List all releases using `helm list` |
||||||
|
|
||||||
|
## Uninstalling the Chart |
||||||
|
|
||||||
|
To uninstall/delete the `dolphinscheduler` deployment: |
||||||
|
|
||||||
|
```bash |
||||||
|
$ helm delete --purge dolphinscheduler |
||||||
|
``` |
||||||
|
|
||||||
|
The command removes all the Kubernetes components associated with the chart and deletes the release. |
||||||
|
|
||||||
|
## Configuration |
||||||
|
|
||||||
|
The following tables lists the configurable parameters of the Dolphins Scheduler chart and their default values. |
||||||
|
|
||||||
|
| Parameter | Description | Default | |
||||||
|
| --------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ | ----------------------------------------------------- | |
||||||
|
| `timezone` | World time and date for cities in all time zones | `Asia/Shanghai` | |
||||||
|
| `image.registry` | Docker image registry for the Dolphins Scheduler | `docker.io` | |
||||||
|
| `image.repository` | Docker image repository for the Dolphins Scheduler | `dolphinscheduler` | |
||||||
|
| `image.tag` | Docker image version for the Dolphins Scheduler | `1.2.1` | |
||||||
|
| `image.imagePullPolicy` | Image pull policy. One of Always, Never, IfNotPresent | `IfNotPresent` | |
||||||
|
| `imagePullSecrets` | ImagePullSecrets is an optional list of references to secrets in the same namespace to use for pulling any of the images | `[]` | |
||||||
|
| | | | |
||||||
|
| `postgresql.enabled` | If not exists external PostgreSQL, by default, the Dolphins Scheduler will use a internal PostgreSQL | `true` | |
||||||
|
| `postgresql.postgresqlUsername` | The username for internal PostgreSQL | `root` | |
||||||
|
| `postgresql.postgresqlPassword` | The password for internal PostgreSQL | `root` | |
||||||
|
| `postgresql.postgresqlDatabase` | The database for internal PostgreSQL | `dolphinscheduler` | |
||||||
|
| `postgresql.persistence.enabled` | Set `postgresql.persistence.enabled` to `true` to mount a new volume for internal PostgreSQL | `false` | |
||||||
|
| `postgresql.persistence.size` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `postgresql.persistence.storageClass` | PostgreSQL data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `externalDatabase.host` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database host will use it. | `localhost` | |
||||||
|
| `externalDatabase.port` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database port will use it. | `5432` | |
||||||
|
| `externalDatabase.username` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database username will use it. | `root` | |
||||||
|
| `externalDatabase.password` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database password will use it. | `root` | |
||||||
|
| `externalDatabase.database` | If exists external PostgreSQL, and set `postgresql.enable` value to false. Dolphins Scheduler's database database will use it. | `dolphinscheduler` | |
||||||
|
| | | | |
||||||
|
| `zookeeper.enabled` | If not exists external Zookeeper, by default, the Dolphin Scheduler will use a internal Zookeeper | `true` | |
||||||
|
| `zookeeper.taskQueue` | Specify task queue for `master` and `worker` | `zookeeper` | |
||||||
|
| `zookeeper.persistence.enabled` | Set `zookeeper.persistence.enabled` to `true` to mount a new volume for internal Zookeeper | `false` | |
||||||
|
| `zookeeper.persistence.size` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `zookeeper.persistence.storageClass` | Zookeeper data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `externalZookeeper.taskQueue` | If exists external Zookeeper, and set `zookeeper.enable` value to false. Specify task queue for `master` and `worker` | `zookeeper` | |
||||||
|
| `externalZookeeper.zookeeperQuorum` | If exists external Zookeeper, and set `zookeeper.enable` value to false. Specify Zookeeper quorum | `127.0.0.1:2181` | |
||||||
|
| | | | |
||||||
|
| `master.podManagementPolicy` | PodManagementPolicy controls how pods are created during initial scale up, when replacing pods on nodes, or when scaling down | `Parallel` | |
||||||
|
| `master.replicas` | Replicas is the desired number of replicas of the given Template | `3` | |
||||||
|
| `master.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `master.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `master.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `master.configmap.MASTER_EXEC_THREADS` | Master execute thread num | `100` | |
||||||
|
| `master.configmap.MASTER_EXEC_TASK_NUM` | Master execute task number in parallel | `20` | |
||||||
|
| `master.configmap.MASTER_HEARTBEAT_INTERVAL` | Master heartbeat interval | `10` | |
||||||
|
| `master.configmap.MASTER_TASK_COMMIT_RETRYTIMES` | Master commit task retry times | `5` | |
||||||
|
| `master.configmap.MASTER_TASK_COMMIT_INTERVAL` | Master commit task interval | `1000` | |
||||||
|
| `master.configmap.MASTER_MAX_CPULOAD_AVG` | Only less than cpu avg load, master server can work. default value : the number of cpu cores * 2 | `100` | |
||||||
|
| `master.configmap.MASTER_RESERVED_MEMORY` | Only larger than reserved memory, master server can work. default value : physical memory * 1/10, unit is G | `0.1` | |
||||||
|
| `master.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `master.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `master.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `master.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `master.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `master.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `master.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `master.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `master.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `master.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `master.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `master.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `master.persistentVolumeClaim.enabled` | Set `master.persistentVolumeClaim.enabled` to `true` to mount a new volume for `master` | `false` | |
||||||
|
| `master.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `master.persistentVolumeClaim.storageClassName` | `Master` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `master.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `worker.podManagementPolicy` | PodManagementPolicy controls how pods are created during initial scale up, when replacing pods on nodes, or when scaling down | `Parallel` | |
||||||
|
| `worker.replicas` | Replicas is the desired number of replicas of the given Template | `3` | |
||||||
|
| `worker.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `worker.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `worker.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `worker.configmap.WORKER_EXEC_THREADS` | Worker execute thread num | `100` | |
||||||
|
| `worker.configmap.WORKER_HEARTBEAT_INTERVAL` | Worker heartbeat interval | `10` | |
||||||
|
| `worker.configmap.WORKER_FETCH_TASK_NUM` | Submit the number of tasks at a time | `3` | |
||||||
|
| `worker.configmap.WORKER_MAX_CPULOAD_AVG` | Only less than cpu avg load, worker server can work. default value : the number of cpu cores * 2 | `100` | |
||||||
|
| `worker.configmap.WORKER_RESERVED_MEMORY` | Only larger than reserved memory, worker server can work. default value : physical memory * 1/10, unit is G | `0.1` | |
||||||
|
| `worker.configmap.DOLPHINSCHEDULER_DATA_BASEDIR_PATH` | User data directory path, self configuration, please make sure the directory exists and have read write permissions | `/tmp/dolphinscheduler` | |
||||||
|
| `worker.configmap.DOLPHINSCHEDULER_ENV` | System env path, self configuration, please read `values.yaml` | `[]` | |
||||||
|
| `worker.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `worker.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `worker.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `worker.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `worker.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `worker.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `worker.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `worker.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `worker.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `worker.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `worker.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `worker.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `worker.persistentVolumeClaim.enabled` | Set `worker.persistentVolumeClaim.enabled` to `true` to enable `persistentVolumeClaim` for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.enabled` | Set `worker.persistentVolumeClaim.dataPersistentVolume.enabled` to `true` to mount a data volume for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.storageClassName` | `Worker` data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `worker.persistentVolumeClaim.dataPersistentVolume.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.enabled` | Set `worker.persistentVolumeClaim.logsPersistentVolume.enabled` to `true` to mount a logs volume for `worker` | `false` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.storageClassName` | `Worker` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `worker.persistentVolumeClaim.logsPersistentVolume.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `alert.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `alert.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `alert.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `alert.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `alert.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `alert.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `alert.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `alert.configmap.XLS_FILE_PATH` | XLS file path | `/tmp/xls` | |
||||||
|
| `alert.configmap.MAIL_SERVER_HOST` | Mail `SERVER HOST ` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SERVER_PORT` | Mail `SERVER PORT` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SENDER` | Mail `SENDER` | `nil` | |
||||||
|
| `alert.configmap.MAIL_USER` | Mail `USER` | `nil` | |
||||||
|
| `alert.configmap.MAIL_PASSWD` | Mail `PASSWORD` | `nil` | |
||||||
|
| `alert.configmap.MAIL_SMTP_STARTTLS_ENABLE` | Mail `SMTP STARTTLS` enable | `false` | |
||||||
|
| `alert.configmap.MAIL_SMTP_SSL_ENABLE` | Mail `SMTP SSL` enable | `false` | |
||||||
|
| `alert.configmap.MAIL_SMTP_SSL_TRUST` | Mail `SMTP SSL TRUST` | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_ENABLE` | `Enterprise Wechat` enable | `false` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_CORP_ID` | `Enterprise Wechat` corp id | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_SECRET` | `Enterprise Wechat` secret | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_AGENT_ID` | `Enterprise Wechat` agent id | `nil` | |
||||||
|
| `alert.configmap.ENTERPRISE_WECHAT_USERS` | `Enterprise Wechat` users | `nil` | |
||||||
|
| `alert.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `alert.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `alert.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `alert.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `alert.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `alert.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `alert.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `alert.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `alert.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `alert.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `alert.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `alert.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `alert.persistentVolumeClaim.enabled` | Set `alert.persistentVolumeClaim.enabled` to `true` to mount a new volume for `alert` | `false` | |
||||||
|
| `alert.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `alert.persistentVolumeClaim.storageClassName` | `Alert` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `alert.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `api.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `api.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `api.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `api.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `api.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `api.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `api.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `api.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `api.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `api.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `api.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `api.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `api.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `api.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `api.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `api.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `api.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `api.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `api.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `api.persistentVolumeClaim.enabled` | Set `api.persistentVolumeClaim.enabled` to `true` to mount a new volume for `api` | `false` | |
||||||
|
| `api.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `api.persistentVolumeClaim.storageClassName` | `api` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `api.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `frontend.strategy.type` | Type of deployment. Can be "Recreate" or "RollingUpdate" | `RollingUpdate` | |
||||||
|
| `frontend.strategy.rollingUpdate.maxSurge` | The maximum number of pods that can be scheduled above the desired number of pods | `25%` | |
||||||
|
| `frontend.strategy.rollingUpdate.maxUnavailable` | The maximum number of pods that can be unavailable during the update | `25%` | |
||||||
|
| `frontend.replicas` | Replicas is the desired number of replicas of the given Template | `1` | |
||||||
|
| `frontend.nodeSelector` | NodeSelector is a selector which must be true for the pod to fit on a node | `{}` | |
||||||
|
| `frontend.tolerations` | If specified, the pod's tolerations | `{}` | |
||||||
|
| `frontend.affinity` | If specified, the pod's scheduling constraints | `{}` | |
||||||
|
| `frontend.livenessProbe.enabled` | Turn on and off liveness probe | `true` | |
||||||
|
| `frontend.livenessProbe.initialDelaySeconds` | Delay before liveness probe is initiated | `30` | |
||||||
|
| `frontend.livenessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `frontend.livenessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `frontend.livenessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `frontend.livenessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `frontend.readinessProbe.enabled` | Turn on and off readiness probe | `true` | |
||||||
|
| `frontend.readinessProbe.initialDelaySeconds` | Delay before readiness probe is initiated | `30` | |
||||||
|
| `frontend.readinessProbe.periodSeconds` | How often to perform the probe | `30` | |
||||||
|
| `frontend.readinessProbe.timeoutSeconds` | When the probe times out | `5` | |
||||||
|
| `frontend.readinessProbe.failureThreshold` | Minimum consecutive successes for the probe | `3` | |
||||||
|
| `frontend.readinessProbe.successThreshold` | Minimum consecutive failures for the probe | `1` | |
||||||
|
| `frontend.persistentVolumeClaim.enabled` | Set `frontend.persistentVolumeClaim.enabled` to `true` to mount a new volume for `frontend` | `false` | |
||||||
|
| `frontend.persistentVolumeClaim.accessModes` | `PersistentVolumeClaim` Access Modes | `[ReadWriteOnce]` | |
||||||
|
| `frontend.persistentVolumeClaim.storageClassName` | `frontend` logs data Persistent Volume Storage Class. If set to "-", storageClassName: "", which disables dynamic provisioning | `-` | |
||||||
|
| `frontend.persistentVolumeClaim.storage` | `PersistentVolumeClaim` Size | `20Gi` | |
||||||
|
| | | | |
||||||
|
| `ingress.enabled` | Enable ingress | `false` | |
||||||
|
| `ingress.host` | Ingress host | `dolphinscheduler.org` | |
||||||
|
| `ingress.path` | Ingress path | `/` | |
||||||
|
| `ingress.tls.enabled` | Enable ingress tls | `false` | |
||||||
|
| `ingress.tls.hosts` | Ingress tls hosts | `dolphinscheduler.org` | |
||||||
|
| `ingress.tls.secretName` | Ingress tls secret name | `dolphinscheduler-tls` | |
||||||
|
|
||||||
|
For more information please refer to the [chart](https://github.com/apache/incubator-dolphinscheduler.git) documentation. |
||||||
@ -0,0 +1,44 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
|
||||||
|
** Please be patient while the chart is being deployed ** |
||||||
|
|
||||||
|
1. Get the Dolphinscheduler URL by running: |
||||||
|
|
||||||
|
{{- if .Values.ingress.enabled }} |
||||||
|
|
||||||
|
export HOSTNAME=$(kubectl get ingress --namespace {{ .Release.Namespace }} {{ template "dolphinscheduler.fullname" . }} -o jsonpath='{.spec.rules[0].host}') |
||||||
|
echo "Dolphinscheduler URL: http://$HOSTNAME/" |
||||||
|
|
||||||
|
{{- else }} |
||||||
|
|
||||||
|
kubectl port-forward --namespace {{ .Release.Namespace }} svc/{{ template "dolphinscheduler.fullname" . }}-frontend 8888:8888 |
||||||
|
|
||||||
|
{{- end }} |
||||||
|
|
||||||
|
2. Get the Dolphinscheduler URL by running: |
||||||
|
|
||||||
|
{{- if .Values.ingress.enabled }} |
||||||
|
|
||||||
|
export HOSTNAME=$(kubectl get ingress --namespace {{ .Release.Namespace }} {{ template "dolphinscheduler.fullname" . }} -o jsonpath='{.spec.rules[0].host}') |
||||||
|
echo "Dolphinscheduler URL: http://$HOSTNAME/" |
||||||
|
|
||||||
|
{{- else }} |
||||||
|
|
||||||
|
kubectl port-forward --namespace {{ .Release.Namespace }} svc/{{ template "dolphinscheduler.fullname" . }}-frontend 8888:8888 |
||||||
|
|
||||||
|
{{- end }} |
||||||
@ -0,0 +1,149 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
|
||||||
|
{{/* vim: set filetype=mustache: */}} |
||||||
|
{{/* |
||||||
|
Expand the name of the chart. |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.name" -}} |
||||||
|
{{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default fully qualified app name. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
If release name contains chart name it will be used as a full name. |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.fullname" -}} |
||||||
|
{{- if .Values.fullnameOverride -}} |
||||||
|
{{- .Values.fullnameOverride | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- else -}} |
||||||
|
{{- $name := default .Chart.Name .Values.nameOverride -}} |
||||||
|
{{- if contains $name .Release.Name -}} |
||||||
|
{{- .Release.Name | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- else -}} |
||||||
|
{{- printf "%s-%s" .Release.Name $name | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
{{- end -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create chart name and version as used by the chart label. |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.chart" -}} |
||||||
|
{{- printf "%s-%s" .Chart.Name .Chart.Version | replace "+" "_" | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Common labels |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.labels" -}} |
||||||
|
helm.sh/chart: {{ include "dolphinscheduler.chart" . }} |
||||||
|
{{ include "dolphinscheduler.selectorLabels" . }} |
||||||
|
{{- if .Chart.AppVersion }} |
||||||
|
app.kubernetes.io/version: {{ .Chart.AppVersion | quote }} |
||||||
|
{{- end }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Selector labels |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.selectorLabels" -}} |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.name" . }} |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create the name of the service account to use |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.serviceAccountName" -}} |
||||||
|
{{- if .Values.serviceAccount.create -}} |
||||||
|
{{ default (include "dolphinscheduler.fullname" .) .Values.serviceAccount.name }} |
||||||
|
{{- else -}} |
||||||
|
{{ default "default" .Values.serviceAccount.name }} |
||||||
|
{{- end -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default docker image registry. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.image.registry" -}} |
||||||
|
{{- $registry := default "docker.io" .Values.image.registry -}} |
||||||
|
{{- printf "%s" $registry | trunc 63 | trimSuffix "/" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default docker image repository. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.image.repository" -}} |
||||||
|
{{- printf "%s/%s:%s" (include "dolphinscheduler.image.registry" .) .Values.image.repository .Values.image.tag -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default fully qualified postgresql name. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.postgresql.fullname" -}} |
||||||
|
{{- $name := default "postgresql" .Values.postgresql.nameOverride -}} |
||||||
|
{{- printf "%s-%s" .Release.Name $name | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default fully qualified zookkeeper name. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.zookeeper.fullname" -}} |
||||||
|
{{- $name := default "zookeeper" .Values.zookeeper.nameOverride -}} |
||||||
|
{{- printf "%s-%s" .Release.Name $name | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default fully qualified zookkeeper quorum. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.zookeeper.quorum" -}} |
||||||
|
{{- $port := default "2181" (.Values.zookeeper.service.port | toString) -}} |
||||||
|
{{- printf "%s:%s" (include "dolphinscheduler.zookeeper.fullname" .) $port | trunc 63 | trimSuffix "-" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default dolphinscheduler worker base dir. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.worker.base.dir" -}} |
||||||
|
{{- $name := default "/tmp/dolphinscheduler" .Values.worker.configmap.DOLPHINSCHEDULER_DATA_BASEDIR_PATH -}} |
||||||
|
{{- printf "%s" $name | trunc 63 | trimSuffix "/" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default dolphinscheduler worker data download dir. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.worker.data.download.dir" -}} |
||||||
|
{{- printf "%s%s" (include "dolphinscheduler.worker.base.dir" .) "/download" -}} |
||||||
|
{{- end -}} |
||||||
|
|
||||||
|
{{/* |
||||||
|
Create a default dolphinscheduler worker process exec dir. |
||||||
|
We truncate at 63 chars because some Kubernetes name fields are limited to this (by the DNS naming spec). |
||||||
|
*/}} |
||||||
|
{{- define "dolphinscheduler.worker.process.exec.dir" -}} |
||||||
|
{{- printf "%s%s" (include "dolphinscheduler.worker.base.dir" .) "/exec" -}} |
||||||
|
{{- end -}} |
||||||
@ -0,0 +1,41 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.alert.configmap }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: ConfigMap |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
data: |
||||||
|
XLS_FILE_PATH: {{ .Values.alert.configmap.XLS_FILE_PATH | quote }} |
||||||
|
MAIL_SERVER_HOST: {{ .Values.alert.configmap.MAIL_SERVER_HOST | quote }} |
||||||
|
MAIL_SERVER_PORT: {{ .Values.alert.configmap.MAIL_SERVER_PORT | quote }} |
||||||
|
MAIL_SENDER: {{ .Values.alert.configmap.MAIL_SENDER | quote }} |
||||||
|
MAIL_USER: {{ .Values.alert.configmap.MAIL_USER | quote }} |
||||||
|
MAIL_PASSWD: {{ .Values.alert.configmap.MAIL_PASSWD | quote }} |
||||||
|
MAIL_SMTP_STARTTLS_ENABLE: {{ .Values.alert.configmap.MAIL_SMTP_STARTTLS_ENABLE | quote }} |
||||||
|
MAIL_SMTP_SSL_ENABLE: {{ .Values.alert.configmap.MAIL_SMTP_SSL_ENABLE | quote }} |
||||||
|
MAIL_SMTP_SSL_TRUST: {{ .Values.alert.configmap.MAIL_SMTP_SSL_TRUST | quote }} |
||||||
|
ENTERPRISE_WECHAT_ENABLE: {{ .Values.alert.configmap.ENTERPRISE_WECHAT_ENABLE | quote }} |
||||||
|
ENTERPRISE_WECHAT_CORP_ID: {{ .Values.alert.configmap.ENTERPRISE_WECHAT_CORP_ID | quote }} |
||||||
|
ENTERPRISE_WECHAT_SECRET: {{ .Values.alert.configmap.ENTERPRISE_WECHAT_SECRET | quote }} |
||||||
|
ENTERPRISE_WECHAT_AGENT_ID: {{ .Values.alert.configmap.ENTERPRISE_WECHAT_AGENT_ID | quote }} |
||||||
|
ENTERPRISE_WECHAT_USERS: {{ .Values.alert.configmap.ENTERPRISE_WECHAT_USERS | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,34 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.master.configmap }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: ConfigMap |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
data: |
||||||
|
MASTER_EXEC_THREADS: {{ .Values.master.configmap.MASTER_EXEC_THREADS | quote }} |
||||||
|
MASTER_EXEC_TASK_NUM: {{ .Values.master.configmap.MASTER_EXEC_TASK_NUM | quote }} |
||||||
|
MASTER_HEARTBEAT_INTERVAL: {{ .Values.master.configmap.MASTER_HEARTBEAT_INTERVAL | quote }} |
||||||
|
MASTER_TASK_COMMIT_RETRYTIMES: {{ .Values.master.configmap.MASTER_TASK_COMMIT_RETRYTIMES | quote }} |
||||||
|
MASTER_TASK_COMMIT_INTERVAL: {{ .Values.master.configmap.MASTER_TASK_COMMIT_INTERVAL | quote }} |
||||||
|
MASTER_MAX_CPULOAD_AVG: {{ .Values.master.configmap.MASTER_MAX_CPULOAD_AVG | quote }} |
||||||
|
MASTER_RESERVED_MEMORY: {{ .Values.master.configmap.MASTER_RESERVED_MEMORY | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,39 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.worker.configmap }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: ConfigMap |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
data: |
||||||
|
WORKER_EXEC_THREADS: {{ .Values.worker.configmap.WORKER_EXEC_THREADS | quote }} |
||||||
|
WORKER_HEARTBEAT_INTERVAL: {{ .Values.worker.configmap.WORKER_HEARTBEAT_INTERVAL | quote }} |
||||||
|
WORKER_FETCH_TASK_NUM: {{ .Values.worker.configmap.WORKER_FETCH_TASK_NUM | quote }} |
||||||
|
WORKER_MAX_CPULOAD_AVG: {{ .Values.worker.configmap.WORKER_MAX_CPULOAD_AVG | quote }} |
||||||
|
WORKER_RESERVED_MEMORY: {{ .Values.worker.configmap.WORKER_RESERVED_MEMORY | quote }} |
||||||
|
DOLPHINSCHEDULER_DATA_BASEDIR_PATH: {{ include "dolphinscheduler.worker.base.dir" . | quote }} |
||||||
|
DOLPHINSCHEDULER_DATA_DOWNLOAD_BASEDIR_PATH: {{ include "dolphinscheduler.worker.data.download.dir" . | quote }} |
||||||
|
DOLPHINSCHEDULER_PROCESS_EXEC_BASEPATH: {{ include "dolphinscheduler.worker.process.exec.dir" . | quote }} |
||||||
|
dolphinscheduler_env.sh: |- |
||||||
|
{{- range .Values.worker.configmap.DOLPHINSCHEDULER_ENV }} |
||||||
|
{{ . }} |
||||||
|
{{- end }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,228 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: apps/v1 |
||||||
|
kind: Deployment |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: alert |
||||||
|
spec: |
||||||
|
replicas: {{ .Values.alert.replicas }} |
||||||
|
selector: |
||||||
|
matchLabels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: alert |
||||||
|
strategy: |
||||||
|
type: {{ .Values.alert.strategy.type | quote }} |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: {{ .Values.alert.strategy.rollingUpdate.maxSurge | quote }} |
||||||
|
maxUnavailable: {{ .Values.alert.strategy.rollingUpdate.maxUnavailable | quote }} |
||||||
|
template: |
||||||
|
metadata: |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: alert |
||||||
|
spec: |
||||||
|
{{- if .Values.alert.affinity }} |
||||||
|
affinity: {{- toYaml .Values.alert.affinity | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.alert.nodeSelector }} |
||||||
|
nodeSelector: {{- toYaml .Values.alert.nodeSelector | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.alert.tolerations }} |
||||||
|
tolerations: {{- toYaml . | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
initContainers: |
||||||
|
- name: init-postgresql |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
while ! nc -z ${POSTGRESQL_HOST} ${POSTGRESQL_PORT}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to postgresql." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to postgresql at ${POSTGRESQL_HOST}:${POSTGRESQL_PORT}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
containers: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
image: {{ include "dolphinscheduler.image.repository" . | quote }} |
||||||
|
args: |
||||||
|
- "alert-server" |
||||||
|
imagePullPolicy: {{ .Values.image.pullPolicy }} |
||||||
|
env: |
||||||
|
- name: TZ |
||||||
|
value: {{ .Values.timezone }} |
||||||
|
- name: XLS_FILE_PATH |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: XLS_FILE_PATH |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SERVER_HOST |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SERVER_HOST |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SERVER_PORT |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SERVER_PORT |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SENDER |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SENDER |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_USER |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_USER |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_PASSWD |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_PASSWD |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SMTP_STARTTLS_ENABLE |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SMTP_STARTTLS_ENABLE |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SMTP_SSL_ENABLE |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SMTP_SSL_ENABLE |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: MAIL_SMTP_SSL_TRUST |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: MAIL_SMTP_SSL_TRUST |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: ENTERPRISE_WECHAT_ENABLE |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: ENTERPRISE_WECHAT_ENABLE |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: ENTERPRISE_WECHAT_CORP_ID |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: ENTERPRISE_WECHAT_CORP_ID |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: ENTERPRISE_WECHAT_SECRET |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: ENTERPRISE_WECHAT_SECRET |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: ENTERPRISE_WECHAT_AGENT_ID |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: ENTERPRISE_WECHAT_AGENT_ID |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: ENTERPRISE_WECHAT_USERS |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
key: ENTERPRISE_WECHAT_USERS |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_USERNAME |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ .Values.postgresql.postgresqlUsername }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.username | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PASSWORD |
||||||
|
valueFrom: |
||||||
|
secretKeyRef: |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
name: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
key: postgresql-password |
||||||
|
{{- else }} |
||||||
|
name: {{ printf "%s-%s" .Release.Name "externaldb" }} |
||||||
|
key: db-password |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.alert.livenessProbe.enabled }} |
||||||
|
livenessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- worker-server |
||||||
|
initialDelaySeconds: {{ .Values.alert.livenessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.alert.livenessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.alert.livenessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.alert.livenessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.alert.livenessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.alert.readinessProbe.enabled }} |
||||||
|
readinessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- worker-server |
||||||
|
initialDelaySeconds: {{ .Values.alert.readinessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.alert.readinessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.alert.readinessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.alert.readinessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.alert.readinessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
volumeMounts: |
||||||
|
- mountPath: "/opt/dolphinscheduler/logs" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
volumes: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
{{- if .Values.alert.persistentVolumeClaim.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,161 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: apps/v1 |
||||||
|
kind: Deployment |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: api |
||||||
|
spec: |
||||||
|
replicas: {{ .Values.api.replicas }} |
||||||
|
selector: |
||||||
|
matchLabels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: api |
||||||
|
strategy: |
||||||
|
type: {{ .Values.api.strategy.type | quote }} |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: {{ .Values.api.strategy.rollingUpdate.maxSurge | quote }} |
||||||
|
maxUnavailable: {{ .Values.api.strategy.rollingUpdate.maxUnavailable | quote }} |
||||||
|
template: |
||||||
|
metadata: |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: api |
||||||
|
spec: |
||||||
|
{{- if .Values.api.affinity }} |
||||||
|
affinity: {{- toYaml .Values.api.affinity | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.api.nodeSelector }} |
||||||
|
nodeSelector: {{- toYaml .Values.api.nodeSelector | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.api.tolerations }} |
||||||
|
tolerations: {{- toYaml . | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
initContainers: |
||||||
|
- name: init-postgresql |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
while ! nc -z ${POSTGRESQL_HOST} ${POSTGRESQL_PORT}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to postgresql." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to postgresql at ${POSTGRESQL_HOST}:${POSTGRESQL_PORT}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
containers: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
image: {{ include "dolphinscheduler.image.repository" . | quote }} |
||||||
|
args: |
||||||
|
- "api-server" |
||||||
|
ports: |
||||||
|
- containerPort: 12345 |
||||||
|
name: tcp-port |
||||||
|
imagePullPolicy: {{ .Values.image.pullPolicy }} |
||||||
|
env: |
||||||
|
- name: TZ |
||||||
|
value: {{ .Values.timezone }} |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_USERNAME |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ .Values.postgresql.postgresqlUsername }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.username | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PASSWORD |
||||||
|
valueFrom: |
||||||
|
secretKeyRef: |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
name: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
key: postgresql-password |
||||||
|
{{- else }} |
||||||
|
name: {{ printf "%s-%s" .Release.Name "externaldb" }} |
||||||
|
key: db-password |
||||||
|
{{- end }} |
||||||
|
- name: ZOOKEEPER_QUORUM |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: "{{ template "dolphinscheduler.zookeeper.quorum" . }}" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.zookeeperQuorum }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.api.livenessProbe.enabled }} |
||||||
|
livenessProbe: |
||||||
|
tcpSocket: |
||||||
|
port: 12345 |
||||||
|
initialDelaySeconds: {{ .Values.api.livenessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.api.livenessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.api.livenessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.api.livenessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.api.livenessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.api.readinessProbe.enabled }} |
||||||
|
readinessProbe: |
||||||
|
tcpSocket: |
||||||
|
port: 12345 |
||||||
|
initialDelaySeconds: {{ .Values.api.readinessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.api.readinessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.api.readinessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.api.readinessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.api.readinessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
volumeMounts: |
||||||
|
- mountPath: "/opt/dolphinscheduler/logs" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
volumes: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
{{- if .Values.api.persistentVolumeClaim.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,102 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: apps/v1 |
||||||
|
kind: Deployment |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: frontend |
||||||
|
spec: |
||||||
|
replicas: {{ .Values.frontend.replicas }} |
||||||
|
selector: |
||||||
|
matchLabels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: frontend |
||||||
|
strategy: |
||||||
|
type: {{ .Values.frontend.strategy.type | quote }} |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: {{ .Values.frontend.strategy.rollingUpdate.maxSurge | quote }} |
||||||
|
maxUnavailable: {{ .Values.frontend.strategy.rollingUpdate.maxUnavailable | quote }} |
||||||
|
template: |
||||||
|
metadata: |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: frontend |
||||||
|
spec: |
||||||
|
{{- if .Values.frontend.affinity }} |
||||||
|
affinity: {{- toYaml .Values.frontend.affinity | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.frontend.nodeSelector }} |
||||||
|
nodeSelector: {{- toYaml .Values.frontend.nodeSelector | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.frontend.tolerations }} |
||||||
|
tolerations: {{- toYaml . | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
containers: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
image: {{ include "dolphinscheduler.image.repository" . | quote }} |
||||||
|
args: |
||||||
|
- "frontend" |
||||||
|
ports: |
||||||
|
- containerPort: 8888 |
||||||
|
name: tcp-port |
||||||
|
imagePullPolicy: {{ .Values.image.pullPolicy }} |
||||||
|
env: |
||||||
|
- name: TZ |
||||||
|
value: {{ .Values.timezone }} |
||||||
|
- name: FRONTEND_API_SERVER_HOST |
||||||
|
value: '{{ include "dolphinscheduler.fullname" . }}-api' |
||||||
|
- name: FRONTEND_API_SERVER_PORT |
||||||
|
value: "12345" |
||||||
|
{{- if .Values.frontend.livenessProbe.enabled }} |
||||||
|
livenessProbe: |
||||||
|
tcpSocket: |
||||||
|
port: 8888 |
||||||
|
initialDelaySeconds: {{ .Values.frontend.livenessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.frontend.livenessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.frontend.livenessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.frontend.livenessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.frontend.livenessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.frontend.readinessProbe.enabled }} |
||||||
|
readinessProbe: |
||||||
|
tcpSocket: |
||||||
|
port: 8888 |
||||||
|
initialDelaySeconds: {{ .Values.frontend.readinessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.frontend.readinessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.frontend.readinessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.frontend.readinessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.frontend.readinessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
volumeMounts: |
||||||
|
- mountPath: "/var/log/nginx" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
volumes: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
{{- if .Values.frontend.persistentVolumeClaim.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,43 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.ingress.enabled }} |
||||||
|
apiVersion: networking.k8s.io/v1beta1 |
||||||
|
kind: Ingress |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }} |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.name" . }} |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
rules: |
||||||
|
- host: {{ .Values.ingress.host }} |
||||||
|
http: |
||||||
|
paths: |
||||||
|
- path: {{ .Values.ingress.path }} |
||||||
|
backend: |
||||||
|
serviceName: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
servicePort: tcp-port |
||||||
|
{{- if .Values.ingress.tls.enabled }} |
||||||
|
tls: |
||||||
|
hosts: |
||||||
|
{{- range .Values.ingress.tls.hosts }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
secretName: {{ .Values.ingress.tls.secretName }} |
||||||
|
{{- end }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,35 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.alert.persistentVolumeClaim.enabled }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: PersistentVolumeClaim |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-alert |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.alert.persistentVolumeClaim.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.alert.persistentVolumeClaim.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.alert.persistentVolumeClaim.storage | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,35 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.api.persistentVolumeClaim.enabled }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: PersistentVolumeClaim |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.api.persistentVolumeClaim.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.api.persistentVolumeClaim.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.api.persistentVolumeClaim.storage | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,35 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if .Values.frontend.persistentVolumeClaim.enabled }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: PersistentVolumeClaim |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.frontend.persistentVolumeClaim.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.frontend.persistentVolumeClaim.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.frontend.persistentVolumeClaim.storage | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,29 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
{{- if not .Values.postgresql.enabled }} |
||||||
|
apiVersion: v1 |
||||||
|
kind: Secret |
||||||
|
metadata: |
||||||
|
name: {{ printf "%s-%s" .Release.Name "externaldb" }} |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-postgresql |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
type: Opaque |
||||||
|
data: |
||||||
|
db-password: {{ .Values.externalDatabase.password | b64enc | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,247 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: apps/v1 |
||||||
|
kind: StatefulSet |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: master |
||||||
|
spec: |
||||||
|
podManagementPolicy: {{ .Values.master.podManagementPolicy }} |
||||||
|
replicas: {{ .Values.master.replicas }} |
||||||
|
selector: |
||||||
|
matchLabels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: master |
||||||
|
serviceName: {{ template "dolphinscheduler.fullname" . }}-master-headless |
||||||
|
template: |
||||||
|
metadata: |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: master |
||||||
|
spec: |
||||||
|
{{- if .Values.master.affinity }} |
||||||
|
affinity: {{- toYaml .Values.master.affinity | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.master.nodeSelector }} |
||||||
|
nodeSelector: {{- toYaml .Values.master.nodeSelector | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.master.tolerations }} |
||||||
|
tolerations: {{- toYaml . | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
initContainers: |
||||||
|
- name: init-zookeeper |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
echo "${ZOOKEEPER_QUORUM}" | awk -F ',' 'BEGIN{ i=1 }{ while( i <= NF ){ print $i; i++ } }' | while read line; do |
||||||
|
while ! nc -z ${line%:*} ${line#*:}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to zookeeper." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to zookeeper at ${line}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: ZOOKEEPER_QUORUM |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: "{{ template "dolphinscheduler.zookeeper.quorum" . }}" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.zookeeperQuorum }} |
||||||
|
{{- end }} |
||||||
|
- name: init-postgresql |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
while ! nc -z ${POSTGRESQL_HOST} ${POSTGRESQL_PORT}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to postgresql." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to postgresql at ${POSTGRESQL_HOST}:${POSTGRESQL_PORT}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
containers: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
image: {{ include "dolphinscheduler.image.repository" . | quote }} |
||||||
|
args: |
||||||
|
- "master-server" |
||||||
|
ports: |
||||||
|
- containerPort: 8888 |
||||||
|
name: unused-tcp-port |
||||||
|
imagePullPolicy: {{ .Values.image.pullPolicy }} |
||||||
|
env: |
||||||
|
- name: TZ |
||||||
|
value: {{ .Values.timezone }} |
||||||
|
- name: MASTER_EXEC_THREADS |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_EXEC_THREADS |
||||||
|
- name: MASTER_EXEC_TASK_NUM |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_EXEC_TASK_NUM |
||||||
|
- name: MASTER_HEARTBEAT_INTERVAL |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_HEARTBEAT_INTERVAL |
||||||
|
- name: MASTER_TASK_COMMIT_RETRYTIMES |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_TASK_COMMIT_RETRYTIMES |
||||||
|
- name: MASTER_TASK_COMMIT_INTERVAL |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_TASK_COMMIT_INTERVAL |
||||||
|
- name: MASTER_MAX_CPULOAD_AVG |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_MAX_CPULOAD_AVG |
||||||
|
- name: MASTER_RESERVED_MEMORY |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
key: MASTER_RESERVED_MEMORY |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_USERNAME |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ .Values.postgresql.postgresqlUsername }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.username | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PASSWORD |
||||||
|
valueFrom: |
||||||
|
secretKeyRef: |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
name: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
key: postgresql-password |
||||||
|
{{- else }} |
||||||
|
name: {{ printf "%s-%s" .Release.Name "externaldb" }} |
||||||
|
key: db-password |
||||||
|
{{- end }} |
||||||
|
- name: TASK_QUEUE |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: {{ .Values.zookeeper.taskQueue }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.taskQueue }} |
||||||
|
{{- end }} |
||||||
|
- name: ZOOKEEPER_QUORUM |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.zookeeper.quorum" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.zookeeperQuorum }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.master.livenessProbe.enabled }} |
||||||
|
livenessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- master-server |
||||||
|
initialDelaySeconds: {{ .Values.master.livenessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.master.livenessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.master.livenessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.master.livenessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.master.livenessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.master.readinessProbe.enabled }} |
||||||
|
readinessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- master-server |
||||||
|
initialDelaySeconds: {{ .Values.master.readinessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.master.readinessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.master.readinessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.master.readinessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.master.readinessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
volumeMounts: |
||||||
|
- mountPath: "/opt/dolphinscheduler/logs" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
volumes: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
{{- if .Values.master.persistentVolumeClaim.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.master.persistentVolumeClaim.enabled }} |
||||||
|
volumeClaimTemplates: |
||||||
|
- metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.master.persistentVolumeClaim.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.master.persistentVolumeClaim.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.master.persistentVolumeClaim.storage | quote }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,275 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: apps/v1 |
||||||
|
kind: StatefulSet |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: worker |
||||||
|
spec: |
||||||
|
podManagementPolicy: {{ .Values.worker.podManagementPolicy }} |
||||||
|
replicas: {{ .Values.worker.replicas }} |
||||||
|
selector: |
||||||
|
matchLabels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: worker |
||||||
|
serviceName: {{ template "dolphinscheduler.fullname" . }}-worker-headless |
||||||
|
template: |
||||||
|
metadata: |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: worker |
||||||
|
spec: |
||||||
|
{{- if .Values.worker.affinity }} |
||||||
|
affinity: {{- toYaml .Values.worker.affinity | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.worker.nodeSelector }} |
||||||
|
nodeSelector: {{- toYaml .Values.worker.nodeSelector | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.worker.tolerations }} |
||||||
|
tolerations: {{- toYaml . | nindent 8 }} |
||||||
|
{{- end }} |
||||||
|
initContainers: |
||||||
|
- name: init-zookeeper |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
echo "${ZOOKEEPER_QUORUM}" | awk -F ',' 'BEGIN{ i=1 }{ while( i <= NF ){ print $i; i++ } }' | while read line; do |
||||||
|
while ! nc -z ${line%:*} ${line#*:}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to zookeeper." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to zookeeper at ${line}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: ZOOKEEPER_QUORUM |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: "{{ template "dolphinscheduler.zookeeper.quorum" . }}" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.zookeeperQuorum }} |
||||||
|
{{- end }} |
||||||
|
- name: init-postgresql |
||||||
|
image: busybox:1.31.0 |
||||||
|
command: |
||||||
|
- /bin/sh |
||||||
|
- -ec |
||||||
|
- | |
||||||
|
while ! nc -z ${POSTGRESQL_HOST} ${POSTGRESQL_PORT}; do |
||||||
|
counter=$((counter+1)) |
||||||
|
if [ $counter == 5 ]; then |
||||||
|
echo "Error: Couldn't connect to postgresql." |
||||||
|
exit 1 |
||||||
|
fi |
||||||
|
echo "Trying to connect to postgresql at ${POSTGRESQL_HOST}:${POSTGRESQL_PORT}. Attempt $counter." |
||||||
|
sleep 60 |
||||||
|
done |
||||||
|
env: |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
containers: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
image: {{ include "dolphinscheduler.image.repository" . | quote }} |
||||||
|
args: |
||||||
|
- "worker-server" |
||||||
|
ports: |
||||||
|
- containerPort: 50051 |
||||||
|
name: "logs-port" |
||||||
|
imagePullPolicy: {{ .Values.image.pullPolicy }} |
||||||
|
env: |
||||||
|
- name: TZ |
||||||
|
value: {{ .Values.timezone }} |
||||||
|
- name: WORKER_EXEC_THREADS |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
key: WORKER_EXEC_THREADS |
||||||
|
- name: WORKER_FETCH_TASK_NUM |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
key: WORKER_FETCH_TASK_NUM |
||||||
|
- name: WORKER_HEARTBEAT_INTERVAL |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
key: WORKER_HEARTBEAT_INTERVAL |
||||||
|
- name: WORKER_MAX_CPULOAD_AVG |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
key: WORKER_MAX_CPULOAD_AVG |
||||||
|
- name: WORKER_RESERVED_MEMORY |
||||||
|
valueFrom: |
||||||
|
configMapKeyRef: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
key: WORKER_RESERVED_MEMORY |
||||||
|
- name: POSTGRESQL_HOST |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.host | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PORT |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: "5432" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.port }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_USERNAME |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
value: {{ .Values.postgresql.postgresqlUsername }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalDatabase.username | quote }} |
||||||
|
{{- end }} |
||||||
|
- name: POSTGRESQL_PASSWORD |
||||||
|
valueFrom: |
||||||
|
secretKeyRef: |
||||||
|
{{- if .Values.postgresql.enabled }} |
||||||
|
name: {{ template "dolphinscheduler.postgresql.fullname" . }} |
||||||
|
key: postgresql-password |
||||||
|
{{- else }} |
||||||
|
name: {{ printf "%s-%s" .Release.Name "externaldb" }} |
||||||
|
key: db-password |
||||||
|
{{- end }} |
||||||
|
- name: TASK_QUEUE |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: {{ .Values.zookeeper.taskQueue }} |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.taskQueue }} |
||||||
|
{{- end }} |
||||||
|
- name: ZOOKEEPER_QUORUM |
||||||
|
{{- if .Values.zookeeper.enabled }} |
||||||
|
value: "{{ template "dolphinscheduler.zookeeper.quorum" . }}" |
||||||
|
{{- else }} |
||||||
|
value: {{ .Values.externalZookeeper.zookeeperQuorum }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.worker.livenessProbe.enabled }} |
||||||
|
livenessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- worker-server |
||||||
|
initialDelaySeconds: {{ .Values.worker.livenessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.worker.livenessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.worker.livenessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.worker.livenessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.worker.livenessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.worker.readinessProbe.enabled }} |
||||||
|
readinessProbe: |
||||||
|
exec: |
||||||
|
command: |
||||||
|
- sh |
||||||
|
- /root/checkpoint.sh |
||||||
|
- worker-server |
||||||
|
initialDelaySeconds: {{ .Values.worker.readinessProbe.initialDelaySeconds }} |
||||||
|
periodSeconds: {{ .Values.worker.readinessProbe.periodSeconds }} |
||||||
|
timeoutSeconds: {{ .Values.worker.readinessProbe.timeoutSeconds }} |
||||||
|
successThreshold: {{ .Values.worker.readinessProbe.successThreshold }} |
||||||
|
failureThreshold: {{ .Values.worker.readinessProbe.failureThreshold }} |
||||||
|
{{- end }} |
||||||
|
volumeMounts: |
||||||
|
- mountPath: {{ include "dolphinscheduler.worker.base.dir" . | quote }} |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-data |
||||||
|
- mountPath: "/opt/dolphinscheduler/logs" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-logs |
||||||
|
- mountPath: "/opt/dolphinscheduler/conf/env/dolphinscheduler_env.sh" |
||||||
|
subPath: "dolphinscheduler_env.sh" |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-configmap |
||||||
|
volumes: |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-worker-data |
||||||
|
{{- if .Values.worker.persistentVolumeClaim.dataPersistentVolume.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-worker-data |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-worker-logs |
||||||
|
{{- if .Values.worker.persistentVolumeClaim.logsPersistentVolume.enabled }} |
||||||
|
persistentVolumeClaim: |
||||||
|
claimName: {{ include "dolphinscheduler.fullname" . }}-worker-logs |
||||||
|
{{- else }} |
||||||
|
emptyDir: {} |
||||||
|
{{- end }} |
||||||
|
- name: {{ include "dolphinscheduler.fullname" . }}-worker-configmap |
||||||
|
configMap: |
||||||
|
defaultMode: 0777 |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
items: |
||||||
|
- key: dolphinscheduler_env.sh |
||||||
|
path: dolphinscheduler_env.sh |
||||||
|
{{- if .Values.worker.persistentVolumeClaim.enabled }} |
||||||
|
volumeClaimTemplates: |
||||||
|
{{- if .Values.worker.persistentVolumeClaim.dataPersistentVolume.enabled }} |
||||||
|
- metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-data |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker-data |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.worker.persistentVolumeClaim.dataPersistentVolume.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.worker.persistentVolumeClaim.dataPersistentVolume.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.worker.persistentVolumeClaim.dataPersistentVolume.storage | quote }} |
||||||
|
{{- end }} |
||||||
|
{{- if .Values.worker.persistentVolumeClaim.logsPersistentVolume.enabled }} |
||||||
|
- metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-logs |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker-logs |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
accessModes: |
||||||
|
{{- range .Values.worker.persistentVolumeClaim.logsPersistentVolume.accessModes }} |
||||||
|
- {{ . | quote }} |
||||||
|
{{- end }} |
||||||
|
storageClassName: {{ .Values.worker.persistentVolumeClaim.logsPersistentVolume.storageClassName | quote }} |
||||||
|
resources: |
||||||
|
requests: |
||||||
|
storage: {{ .Values.worker.persistentVolumeClaim.logsPersistentVolume.storage | quote }} |
||||||
|
{{- end }} |
||||||
|
{{- end }} |
||||||
@ -0,0 +1,35 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: v1 |
||||||
|
kind: Service |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
ports: |
||||||
|
- port: 12345 |
||||||
|
targetPort: tcp-port |
||||||
|
protocol: TCP |
||||||
|
name: tcp-port |
||||||
|
selector: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-api |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: api |
||||||
@ -0,0 +1,35 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: v1 |
||||||
|
kind: Service |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
ports: |
||||||
|
- port: 8888 |
||||||
|
targetPort: tcp-port |
||||||
|
protocol: TCP |
||||||
|
name: tcp-port |
||||||
|
selector: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-frontend |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: frontend |
||||||
@ -0,0 +1,36 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: v1 |
||||||
|
kind: Service |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-master-headless |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master-headless |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }}-master-headless |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
clusterIP: "None" |
||||||
|
ports: |
||||||
|
- port: 8888 |
||||||
|
targetPort: tcp-port |
||||||
|
protocol: TCP |
||||||
|
name: unused-tcp-port |
||||||
|
selector: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-master |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: master |
||||||
@ -0,0 +1,36 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
apiVersion: v1 |
||||||
|
kind: Service |
||||||
|
metadata: |
||||||
|
name: {{ include "dolphinscheduler.fullname" . }}-worker-headless |
||||||
|
labels: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker-headless |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }}-worker-headless |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
spec: |
||||||
|
clusterIP: "None" |
||||||
|
ports: |
||||||
|
- port: 50051 |
||||||
|
targetPort: logs-port |
||||||
|
protocol: TCP |
||||||
|
name: logs-port |
||||||
|
selector: |
||||||
|
app.kubernetes.io/name: {{ include "dolphinscheduler.fullname" . }}-worker |
||||||
|
app.kubernetes.io/instance: {{ .Release.Name }} |
||||||
|
app.kubernetes.io/managed-by: {{ .Release.Service }} |
||||||
|
app.kubernetes.io/component: worker |
||||||
@ -0,0 +1,355 @@ |
|||||||
|
# |
||||||
|
# Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
# contributor license agreements. See the NOTICE file distributed with |
||||||
|
# this work for additional information regarding copyright ownership. |
||||||
|
# The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
# (the "License"); you may not use this file except in compliance with |
||||||
|
# the License. You may obtain a copy of the License at |
||||||
|
# |
||||||
|
# http://www.apache.org/licenses/LICENSE-2.0 |
||||||
|
# |
||||||
|
# Unless required by applicable law or agreed to in writing, software |
||||||
|
# distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
# See the License for the specific language governing permissions and |
||||||
|
# limitations under the License. |
||||||
|
# |
||||||
|
|
||||||
|
# Default values for dolphinscheduler-chart. |
||||||
|
# This is a YAML-formatted file. |
||||||
|
# Declare variables to be passed into your templates. |
||||||
|
|
||||||
|
nameOverride: "" |
||||||
|
fullnameOverride: "" |
||||||
|
|
||||||
|
timezone: "Asia/Shanghai" |
||||||
|
|
||||||
|
image: |
||||||
|
registry: "docker.io" |
||||||
|
repository: "dolphinscheduler" |
||||||
|
tag: "1.2.1" |
||||||
|
pullPolicy: "IfNotPresent" |
||||||
|
|
||||||
|
imagePullSecrets: [] |
||||||
|
|
||||||
|
# If not exists external postgresql, by default, Dolphinscheduler's database will use it. |
||||||
|
postgresql: |
||||||
|
enabled: true |
||||||
|
postgresqlUsername: "root" |
||||||
|
postgresqlPassword: "root" |
||||||
|
postgresqlDatabase: "dolphinscheduler" |
||||||
|
persistence: |
||||||
|
enabled: false |
||||||
|
size: "20Gi" |
||||||
|
storageClass: "-" |
||||||
|
|
||||||
|
# If exists external postgresql, and set postgresql.enable value to false. |
||||||
|
# If postgresql.enable is false, Dolphinscheduler's database will use it. |
||||||
|
externalDatabase: |
||||||
|
host: "localhost" |
||||||
|
port: "5432" |
||||||
|
username: "root" |
||||||
|
password: "root" |
||||||
|
database: "dolphinscheduler" |
||||||
|
|
||||||
|
# If not exists external zookeeper, by default, Dolphinscheduler's zookeeper will use it. |
||||||
|
zookeeper: |
||||||
|
enabled: true |
||||||
|
taskQueue: "zookeeper" |
||||||
|
persistence: |
||||||
|
enabled: false |
||||||
|
size: "20Gi" |
||||||
|
storageClass: "-" |
||||||
|
|
||||||
|
# If exists external zookeeper, and set zookeeper.enable value to false. |
||||||
|
# If zookeeper.enable is false, Dolphinscheduler's zookeeper will use it. |
||||||
|
externalZookeeper: |
||||||
|
taskQueue: "zookeeper" |
||||||
|
zookeeperQuorum: "127.0.0.1:2181" |
||||||
|
|
||||||
|
master: |
||||||
|
podManagementPolicy: "Parallel" |
||||||
|
replicas: "3" |
||||||
|
# NodeSelector is a selector which must be true for the pod to fit on a node. |
||||||
|
# Selector which must match a node's labels for the pod to be scheduled on that node. |
||||||
|
# More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/ |
||||||
|
nodeSelector: {} |
||||||
|
# Tolerations are appended (excluding duplicates) to pods running with this RuntimeClass during admission, |
||||||
|
# effectively unioning the set of nodes tolerated by the pod and the RuntimeClass. |
||||||
|
tolerations: [] |
||||||
|
# Affinity is a group of affinity scheduling rules. |
||||||
|
# If specified, the pod's scheduling constraints. |
||||||
|
# More info: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#affinity-v1-core |
||||||
|
affinity: {} |
||||||
|
## Periodic probe of container liveness. Container will be restarted if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
configmap: |
||||||
|
MASTER_EXEC_THREADS: "100" |
||||||
|
MASTER_EXEC_TASK_NUM: "20" |
||||||
|
MASTER_HEARTBEAT_INTERVAL: "10" |
||||||
|
MASTER_TASK_COMMIT_RETRYTIMES: "5" |
||||||
|
MASTER_TASK_COMMIT_INTERVAL: "1000" |
||||||
|
MASTER_MAX_CPULOAD_AVG: "100" |
||||||
|
MASTER_RESERVED_MEMORY: "0.1" |
||||||
|
livenessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## Periodic probe of container service readiness. Container will be removed from service endpoints if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
readinessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## volumeClaimTemplates is a list of claims that pods are allowed to reference. |
||||||
|
## The StatefulSet controller is responsible for mapping network identities to claims in a way that maintains the identity of a pod. |
||||||
|
## Every claim in this list must have at least one matching (by name) volumeMount in one container in the template. |
||||||
|
## A claim in this list takes precedence over any volumes in the template, with the same name. |
||||||
|
persistentVolumeClaim: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
|
||||||
|
worker: |
||||||
|
podManagementPolicy: "Parallel" |
||||||
|
replicas: "3" |
||||||
|
# NodeSelector is a selector which must be true for the pod to fit on a node. |
||||||
|
# Selector which must match a node's labels for the pod to be scheduled on that node. |
||||||
|
# More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/ |
||||||
|
nodeSelector: {} |
||||||
|
# Tolerations are appended (excluding duplicates) to pods running with this RuntimeClass during admission, |
||||||
|
# effectively unioning the set of nodes tolerated by the pod and the RuntimeClass. |
||||||
|
tolerations: [] |
||||||
|
# Affinity is a group of affinity scheduling rules. |
||||||
|
# If specified, the pod's scheduling constraints. |
||||||
|
# More info: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#affinity-v1-core |
||||||
|
affinity: {} |
||||||
|
## Periodic probe of container liveness. Container will be restarted if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
livenessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## Periodic probe of container service readiness. Container will be removed from service endpoints if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
readinessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
configmap: |
||||||
|
WORKER_EXEC_THREADS: "100" |
||||||
|
WORKER_HEARTBEAT_INTERVAL: "10" |
||||||
|
WORKER_FETCH_TASK_NUM: "3" |
||||||
|
WORKER_MAX_CPULOAD_AVG: "100" |
||||||
|
WORKER_RESERVED_MEMORY: "0.1" |
||||||
|
DOLPHINSCHEDULER_DATA_BASEDIR_PATH: "/tmp/dolphinscheduler" |
||||||
|
DOLPHINSCHEDULER_ENV: |
||||||
|
- "export HADOOP_HOME=/opt/soft/hadoop" |
||||||
|
- "export HADOOP_CONF_DIR=/opt/soft/hadoop/etc/hadoop" |
||||||
|
- "export SPARK_HOME1=/opt/soft/spark1" |
||||||
|
- "export SPARK_HOME2=/opt/soft/spark2" |
||||||
|
- "export PYTHON_HOME=/opt/soft/python" |
||||||
|
- "export JAVA_HOME=/opt/soft/java" |
||||||
|
- "export HIVE_HOME=/opt/soft/hive" |
||||||
|
- "export FLINK_HOME=/opt/soft/flink" |
||||||
|
- "export PATH=$HADOOP_HOME/bin:$SPARK_HOME1/bin:$SPARK_HOME2/bin:$PYTHON_HOME:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$PATH" |
||||||
|
## volumeClaimTemplates is a list of claims that pods are allowed to reference. |
||||||
|
## The StatefulSet controller is responsible for mapping network identities to claims in a way that maintains the identity of a pod. |
||||||
|
## Every claim in this list must have at least one matching (by name) volumeMount in one container in the template. |
||||||
|
## A claim in this list takes precedence over any volumes in the template, with the same name. |
||||||
|
persistentVolumeClaim: |
||||||
|
enabled: false |
||||||
|
## dolphinscheduler data volume |
||||||
|
dataPersistentVolume: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
## dolphinscheduler logs volume |
||||||
|
logsPersistentVolume: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
|
||||||
|
alert: |
||||||
|
strategy: |
||||||
|
type: "RollingUpdate" |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: "25%" |
||||||
|
maxUnavailable: "25%" |
||||||
|
replicas: "1" |
||||||
|
# NodeSelector is a selector which must be true for the pod to fit on a node. |
||||||
|
# Selector which must match a node's labels for the pod to be scheduled on that node. |
||||||
|
# More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/ |
||||||
|
nodeSelector: {} |
||||||
|
# Tolerations are appended (excluding duplicates) to pods running with this RuntimeClass during admission, |
||||||
|
# effectively unioning the set of nodes tolerated by the pod and the RuntimeClass. |
||||||
|
tolerations: [] |
||||||
|
# Affinity is a group of affinity scheduling rules. |
||||||
|
# If specified, the pod's scheduling constraints. |
||||||
|
# More info: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#affinity-v1-core |
||||||
|
affinity: {} |
||||||
|
## Periodic probe of container liveness. Container will be restarted if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
configmap: |
||||||
|
XLS_FILE_PATH: "/tmp/xls" |
||||||
|
MAIL_SERVER_HOST: "" |
||||||
|
MAIL_SERVER_PORT: "" |
||||||
|
MAIL_SENDER: "" |
||||||
|
MAIL_USER: "" |
||||||
|
MAIL_PASSWD: "" |
||||||
|
MAIL_SMTP_STARTTLS_ENABLE: false |
||||||
|
MAIL_SMTP_SSL_ENABLE: false |
||||||
|
MAIL_SMTP_SSL_TRUST: "" |
||||||
|
ENTERPRISE_WECHAT_ENABLE: false |
||||||
|
ENTERPRISE_WECHAT_CORP_ID: "" |
||||||
|
ENTERPRISE_WECHAT_SECRET: "" |
||||||
|
ENTERPRISE_WECHAT_AGENT_ID: "" |
||||||
|
ENTERPRISE_WECHAT_USERS: "" |
||||||
|
livenessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## Periodic probe of container service readiness. Container will be removed from service endpoints if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
readinessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## volumeClaimTemplates is a list of claims that pods are allowed to reference. |
||||||
|
## The StatefulSet controller is responsible for mapping network identities to claims in a way that maintains the identity of a pod. |
||||||
|
## Every claim in this list must have at least one matching (by name) volumeMount in one container in the template. |
||||||
|
## A claim in this list takes precedence over any volumes in the template, with the same name. |
||||||
|
persistentVolumeClaim: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
|
||||||
|
api: |
||||||
|
strategy: |
||||||
|
type: "RollingUpdate" |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: "25%" |
||||||
|
maxUnavailable: "25%" |
||||||
|
replicas: "1" |
||||||
|
# NodeSelector is a selector which must be true for the pod to fit on a node. |
||||||
|
# Selector which must match a node's labels for the pod to be scheduled on that node. |
||||||
|
# More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/ |
||||||
|
nodeSelector: {} |
||||||
|
# Tolerations are appended (excluding duplicates) to pods running with this RuntimeClass during admission, |
||||||
|
# effectively unioning the set of nodes tolerated by the pod and the RuntimeClass. |
||||||
|
tolerations: [] |
||||||
|
# Affinity is a group of affinity scheduling rules. |
||||||
|
# If specified, the pod's scheduling constraints. |
||||||
|
# More info: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#affinity-v1-core |
||||||
|
affinity: {} |
||||||
|
## Periodic probe of container liveness. Container will be restarted if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
livenessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## Periodic probe of container service readiness. Container will be removed from service endpoints if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
readinessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## volumeClaimTemplates is a list of claims that pods are allowed to reference. |
||||||
|
## The StatefulSet controller is responsible for mapping network identities to claims in a way that maintains the identity of a pod. |
||||||
|
## Every claim in this list must have at least one matching (by name) volumeMount in one container in the template. |
||||||
|
## A claim in this list takes precedence over any volumes in the template, with the same name. |
||||||
|
persistentVolumeClaim: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
|
||||||
|
frontend: |
||||||
|
strategy: |
||||||
|
type: "RollingUpdate" |
||||||
|
rollingUpdate: |
||||||
|
maxSurge: "25%" |
||||||
|
maxUnavailable: "25%" |
||||||
|
replicas: "1" |
||||||
|
# NodeSelector is a selector which must be true for the pod to fit on a node. |
||||||
|
# Selector which must match a node's labels for the pod to be scheduled on that node. |
||||||
|
# More info: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/ |
||||||
|
nodeSelector: {} |
||||||
|
# Tolerations are appended (excluding duplicates) to pods running with this RuntimeClass during admission, |
||||||
|
# effectively unioning the set of nodes tolerated by the pod and the RuntimeClass. |
||||||
|
tolerations: [] |
||||||
|
# Affinity is a group of affinity scheduling rules. |
||||||
|
# If specified, the pod's scheduling constraints. |
||||||
|
# More info: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#affinity-v1-core |
||||||
|
affinity: {} |
||||||
|
## Periodic probe of container liveness. Container will be restarted if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
livenessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## Periodic probe of container service readiness. Container will be removed from service endpoints if the probe fails. Cannot be updated. |
||||||
|
## More info: https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle#container-probes |
||||||
|
readinessProbe: |
||||||
|
enabled: true |
||||||
|
initialDelaySeconds: "30" |
||||||
|
periodSeconds: "30" |
||||||
|
timeoutSeconds: "5" |
||||||
|
failureThreshold: "3" |
||||||
|
successThreshold: "1" |
||||||
|
## volumeClaimTemplates is a list of claims that pods are allowed to reference. |
||||||
|
## The StatefulSet controller is responsible for mapping network identities to claims in a way that maintains the identity of a pod. |
||||||
|
## Every claim in this list must have at least one matching (by name) volumeMount in one container in the template. |
||||||
|
## A claim in this list takes precedence over any volumes in the template, with the same name. |
||||||
|
persistentVolumeClaim: |
||||||
|
enabled: false |
||||||
|
accessModes: |
||||||
|
- "ReadWriteOnce" |
||||||
|
storageClassName: "-" |
||||||
|
storage: "20Gi" |
||||||
|
|
||||||
|
ingress: |
||||||
|
enabled: false |
||||||
|
host: "dolphinscheduler.org" |
||||||
|
path: "/" |
||||||
|
tls: |
||||||
|
enabled: false |
||||||
|
hosts: |
||||||
|
- "dolphinscheduler.org" |
||||||
|
secretName: "dolphinscheduler-tls" |
||||||
@ -0,0 +1,29 @@ |
|||||||
|
package org.apache.dolphinscheduler.api.dto.resources; |
||||||
|
|
||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
/** |
||||||
|
* directory |
||||||
|
*/ |
||||||
|
public class Directory extends ResourceComponent{ |
||||||
|
|
||||||
|
@Override |
||||||
|
public boolean isDirctory() { |
||||||
|
return true; |
||||||
|
} |
||||||
|
|
||||||
|
} |
||||||
@ -0,0 +1,24 @@ |
|||||||
|
package org.apache.dolphinscheduler.api.dto.resources; |
||||||
|
|
||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
/** |
||||||
|
* file leaf |
||||||
|
*/ |
||||||
|
public class FileLeaf extends ResourceComponent{ |
||||||
|
|
||||||
|
} |
||||||
@ -0,0 +1,193 @@ |
|||||||
|
package org.apache.dolphinscheduler.api.dto.resources; |
||||||
|
|
||||||
|
import com.alibaba.fastjson.annotation.JSONField; |
||||||
|
import com.alibaba.fastjson.annotation.JSONType; |
||||||
|
import org.apache.dolphinscheduler.common.enums.ResourceType; |
||||||
|
|
||||||
|
import java.util.ArrayList; |
||||||
|
import java.util.List; |
||||||
|
|
||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
/** |
||||||
|
* resource component |
||||||
|
*/ |
||||||
|
@JSONType(orders={"id","pid","name","fullName","description","isDirctory","children","type"}) |
||||||
|
public abstract class ResourceComponent { |
||||||
|
public ResourceComponent() { |
||||||
|
} |
||||||
|
|
||||||
|
public ResourceComponent(int id, int pid, String name, String fullName, String description, boolean isDirctory) { |
||||||
|
this.id = id; |
||||||
|
this.pid = pid; |
||||||
|
this.name = name; |
||||||
|
this.fullName = fullName; |
||||||
|
this.description = description; |
||||||
|
this.isDirctory = isDirctory; |
||||||
|
int directoryFlag = isDirctory ? 1:0; |
||||||
|
this.idValue = String.format("%s_%s",id,directoryFlag); |
||||||
|
} |
||||||
|
|
||||||
|
|
||||||
|
/** |
||||||
|
* id |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 1) |
||||||
|
protected int id; |
||||||
|
/** |
||||||
|
* parent id |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 2) |
||||||
|
protected int pid; |
||||||
|
/** |
||||||
|
* name |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 3) |
||||||
|
protected String name; |
||||||
|
/** |
||||||
|
* current directory |
||||||
|
*/ |
||||||
|
protected String currentDir; |
||||||
|
/** |
||||||
|
* full name |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 4) |
||||||
|
protected String fullName; |
||||||
|
/** |
||||||
|
* description |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 5) |
||||||
|
protected String description; |
||||||
|
/** |
||||||
|
* is directory |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 6) |
||||||
|
protected boolean isDirctory; |
||||||
|
/** |
||||||
|
* id value |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 7) |
||||||
|
protected String idValue; |
||||||
|
/** |
||||||
|
* resoruce type |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 8) |
||||||
|
protected ResourceType type; |
||||||
|
/** |
||||||
|
* children |
||||||
|
*/ |
||||||
|
@JSONField(ordinal = 8) |
||||||
|
protected List<ResourceComponent> children = new ArrayList<>(); |
||||||
|
|
||||||
|
/** |
||||||
|
* add resource component |
||||||
|
* @param resourceComponent resource component |
||||||
|
*/ |
||||||
|
public void add(ResourceComponent resourceComponent){ |
||||||
|
children.add(resourceComponent); |
||||||
|
} |
||||||
|
|
||||||
|
public String getName(){ |
||||||
|
return this.name; |
||||||
|
} |
||||||
|
|
||||||
|
public String getDescription(){ |
||||||
|
return this.description; |
||||||
|
} |
||||||
|
|
||||||
|
public int getId() { |
||||||
|
return id; |
||||||
|
} |
||||||
|
|
||||||
|
public void setId(int id) { |
||||||
|
this.id = id; |
||||||
|
} |
||||||
|
|
||||||
|
public int getPid() { |
||||||
|
return pid; |
||||||
|
} |
||||||
|
|
||||||
|
public void setPid(int pid) { |
||||||
|
this.pid = pid; |
||||||
|
} |
||||||
|
|
||||||
|
public void setName(String name) { |
||||||
|
this.name = name; |
||||||
|
} |
||||||
|
|
||||||
|
public String getFullName() { |
||||||
|
return fullName; |
||||||
|
} |
||||||
|
|
||||||
|
public void setFullName(String fullName) { |
||||||
|
this.fullName = fullName; |
||||||
|
} |
||||||
|
|
||||||
|
public void setDescription(String description) { |
||||||
|
this.description = description; |
||||||
|
} |
||||||
|
|
||||||
|
public boolean isDirctory() { |
||||||
|
return isDirctory; |
||||||
|
} |
||||||
|
|
||||||
|
public void setDirctory(boolean dirctory) { |
||||||
|
isDirctory = dirctory; |
||||||
|
} |
||||||
|
|
||||||
|
public String getIdValue() { |
||||||
|
return idValue; |
||||||
|
} |
||||||
|
|
||||||
|
public void setIdValue(int id,boolean isDirctory) { |
||||||
|
int directoryFlag = isDirctory ? 1:0; |
||||||
|
this.idValue = String.format("%s_%s",id,directoryFlag); |
||||||
|
} |
||||||
|
|
||||||
|
public ResourceType getType() { |
||||||
|
return type; |
||||||
|
} |
||||||
|
|
||||||
|
public void setType(ResourceType type) { |
||||||
|
this.type = type; |
||||||
|
} |
||||||
|
|
||||||
|
public List<ResourceComponent> getChildren() { |
||||||
|
return children; |
||||||
|
} |
||||||
|
|
||||||
|
public void setChildren(List<ResourceComponent> children) { |
||||||
|
this.children = children; |
||||||
|
} |
||||||
|
|
||||||
|
@Override |
||||||
|
public String toString() { |
||||||
|
return "ResourceComponent{" + |
||||||
|
"id=" + id + |
||||||
|
", pid=" + pid + |
||||||
|
", name='" + name + '\'' + |
||||||
|
", currentDir='" + currentDir + '\'' + |
||||||
|
", fullName='" + fullName + '\'' + |
||||||
|
", description='" + description + '\'' + |
||||||
|
", isDirctory=" + isDirctory + |
||||||
|
", idValue='" + idValue + '\'' + |
||||||
|
", type=" + type + |
||||||
|
", children=" + children + |
||||||
|
'}'; |
||||||
|
} |
||||||
|
|
||||||
|
} |
||||||
@ -0,0 +1,28 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.api.dto.resources.filter; |
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.dao.entity.Resource; |
||||||
|
|
||||||
|
import java.util.List; |
||||||
|
|
||||||
|
/** |
||||||
|
* interface filter |
||||||
|
*/ |
||||||
|
public interface IFilter { |
||||||
|
List<Resource> filter(); |
||||||
|
} |
||||||
@ -0,0 +1,100 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.api.dto.resources.filter; |
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.dao.entity.Resource; |
||||||
|
|
||||||
|
import java.util.ArrayList; |
||||||
|
import java.util.HashSet; |
||||||
|
import java.util.List; |
||||||
|
import java.util.Set; |
||||||
|
import java.util.stream.Collectors; |
||||||
|
|
||||||
|
/** |
||||||
|
* resource filter |
||||||
|
*/ |
||||||
|
public class ResourceFilter implements IFilter { |
||||||
|
/** |
||||||
|
* resource suffix |
||||||
|
*/ |
||||||
|
private String suffix; |
||||||
|
/** |
||||||
|
* resource list |
||||||
|
*/ |
||||||
|
private List<Resource> resourceList; |
||||||
|
|
||||||
|
/** |
||||||
|
* parent list |
||||||
|
*/ |
||||||
|
//Set<Resource> parentList = new HashSet<>();
|
||||||
|
|
||||||
|
/** |
||||||
|
* constructor |
||||||
|
* @param suffix resource suffix |
||||||
|
* @param resourceList resource list |
||||||
|
*/ |
||||||
|
public ResourceFilter(String suffix, List<Resource> resourceList) { |
||||||
|
this.suffix = suffix; |
||||||
|
this.resourceList = resourceList; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* file filter |
||||||
|
* @return file filtered by suffix |
||||||
|
*/ |
||||||
|
public Set<Resource> fileFilter(){ |
||||||
|
Set<Resource> resources = resourceList.stream().filter(t -> { |
||||||
|
String alias = t.getAlias(); |
||||||
|
return alias.endsWith(suffix); |
||||||
|
}).collect(Collectors.toSet()); |
||||||
|
return resources; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* list all parent dir |
||||||
|
* @return parent resource dir set |
||||||
|
*/ |
||||||
|
Set<Resource> listAllParent(){ |
||||||
|
Set<Resource> parentList = new HashSet<>(); |
||||||
|
Set<Resource> filterFileList = fileFilter(); |
||||||
|
for(Resource file:filterFileList){ |
||||||
|
parentList.add(file); |
||||||
|
setAllParent(file,parentList); |
||||||
|
} |
||||||
|
return parentList; |
||||||
|
|
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* list all parent dir |
||||||
|
* @param resource resource |
||||||
|
* @return parent resource dir set |
||||||
|
*/ |
||||||
|
private void setAllParent(Resource resource,Set<Resource> parentList){ |
||||||
|
for (Resource resourceTemp : resourceList) { |
||||||
|
if (resourceTemp.getId() == resource.getPid()) { |
||||||
|
parentList.add(resourceTemp); |
||||||
|
setAllParent(resourceTemp,parentList); |
||||||
|
} |
||||||
|
} |
||||||
|
} |
||||||
|
|
||||||
|
@Override |
||||||
|
public List<Resource> filter() { |
||||||
|
return new ArrayList<>(listAllParent()); |
||||||
|
} |
||||||
|
} |
||||||
@ -0,0 +1,130 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.api.dto.resources.visitor; |
||||||
|
|
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.api.dto.resources.Directory; |
||||||
|
import org.apache.dolphinscheduler.api.dto.resources.FileLeaf; |
||||||
|
import org.apache.dolphinscheduler.api.dto.resources.ResourceComponent; |
||||||
|
import org.apache.dolphinscheduler.dao.entity.Resource; |
||||||
|
|
||||||
|
import java.util.ArrayList; |
||||||
|
import java.util.List; |
||||||
|
|
||||||
|
/** |
||||||
|
* resource tree visitor |
||||||
|
*/ |
||||||
|
public class ResourceTreeVisitor implements Visitor{ |
||||||
|
|
||||||
|
/** |
||||||
|
* resource list |
||||||
|
*/ |
||||||
|
private List<Resource> resourceList; |
||||||
|
|
||||||
|
public ResourceTreeVisitor() { |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* constructor |
||||||
|
* @param resourceList resource list |
||||||
|
*/ |
||||||
|
public ResourceTreeVisitor(List<Resource> resourceList) { |
||||||
|
this.resourceList = resourceList; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* visit |
||||||
|
* @return resoruce component |
||||||
|
*/ |
||||||
|
public ResourceComponent visit() { |
||||||
|
ResourceComponent rootDirectory = new Directory(); |
||||||
|
for (Resource resource : resourceList) { |
||||||
|
// judge whether is root node
|
||||||
|
if (rootNode(resource)){ |
||||||
|
ResourceComponent tempResourceComponent = getResourceComponent(resource); |
||||||
|
rootDirectory.add(tempResourceComponent); |
||||||
|
tempResourceComponent.setChildren(setChildren(tempResourceComponent.getId(),resourceList)); |
||||||
|
} |
||||||
|
} |
||||||
|
return rootDirectory; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* set children |
||||||
|
* @param id id |
||||||
|
* @param list resource list |
||||||
|
* @return resource component list |
||||||
|
*/ |
||||||
|
public static List<ResourceComponent> setChildren(int id, List<Resource> list ){ |
||||||
|
List<ResourceComponent> childList = new ArrayList<>(); |
||||||
|
for (Resource resource : list) { |
||||||
|
if (id == resource.getPid()){ |
||||||
|
ResourceComponent tempResourceComponent = getResourceComponent(resource); |
||||||
|
childList.add(tempResourceComponent); |
||||||
|
} |
||||||
|
} |
||||||
|
for (ResourceComponent resourceComponent : childList) { |
||||||
|
resourceComponent.setChildren(setChildren(resourceComponent.getId(),list)); |
||||||
|
} |
||||||
|
if (childList.size()==0){ |
||||||
|
return new ArrayList<>(); |
||||||
|
} |
||||||
|
return childList; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* Determine whether it is the root node |
||||||
|
* @param resource resource |
||||||
|
* @return true if it is the root node |
||||||
|
*/ |
||||||
|
public boolean rootNode(Resource resource) { |
||||||
|
|
||||||
|
boolean isRootNode = true; |
||||||
|
if(resource.getPid() != -1 ){ |
||||||
|
for (Resource parent : resourceList) { |
||||||
|
if (resource.getPid() == parent.getId()) { |
||||||
|
isRootNode = false; |
||||||
|
break; |
||||||
|
} |
||||||
|
} |
||||||
|
} |
||||||
|
return isRootNode; |
||||||
|
} |
||||||
|
|
||||||
|
/** |
||||||
|
* get resource component by resource |
||||||
|
* @param resource resource |
||||||
|
* @return resource component |
||||||
|
*/ |
||||||
|
private static ResourceComponent getResourceComponent(Resource resource) { |
||||||
|
ResourceComponent tempResourceComponent; |
||||||
|
if(resource.isDirectory()){ |
||||||
|
tempResourceComponent = new Directory(); |
||||||
|
}else{ |
||||||
|
tempResourceComponent = new FileLeaf(); |
||||||
|
} |
||||||
|
tempResourceComponent.setName(resource.getAlias()); |
||||||
|
tempResourceComponent.setFullName(resource.getFullName().replaceFirst("/","")); |
||||||
|
tempResourceComponent.setId(resource.getId()); |
||||||
|
tempResourceComponent.setPid(resource.getPid()); |
||||||
|
tempResourceComponent.setIdValue(resource.getId(),resource.isDirectory()); |
||||||
|
tempResourceComponent.setDescription(resource.getDescription()); |
||||||
|
tempResourceComponent.setType(resource.getType()); |
||||||
|
return tempResourceComponent; |
||||||
|
} |
||||||
|
|
||||||
|
} |
||||||
@ -0,0 +1,31 @@ |
|||||||
|
package org.apache.dolphinscheduler.api.dto.resources.visitor; |
||||||
|
|
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.api.dto.resources.ResourceComponent; |
||||||
|
|
||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
/** |
||||||
|
* Visitor |
||||||
|
*/ |
||||||
|
public interface Visitor { |
||||||
|
/** |
||||||
|
* visit |
||||||
|
* @return resource component |
||||||
|
*/ |
||||||
|
ResourceComponent visit(); |
||||||
|
} |
||||||
@ -0,0 +1,58 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.api.dto.resources.filter; |
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.dao.entity.Resource; |
||||||
|
import org.junit.Assert; |
||||||
|
import org.junit.Test; |
||||||
|
import org.slf4j.Logger; |
||||||
|
import org.slf4j.LoggerFactory; |
||||||
|
|
||||||
|
import java.util.ArrayList; |
||||||
|
import java.util.List; |
||||||
|
|
||||||
|
/** |
||||||
|
* resource filter test |
||||||
|
*/ |
||||||
|
public class ResourceFilterTest { |
||||||
|
private static Logger logger = LoggerFactory.getLogger(ResourceFilterTest.class); |
||||||
|
@Test |
||||||
|
public void filterTest(){ |
||||||
|
List<Resource> allList = new ArrayList<>(); |
||||||
|
|
||||||
|
Resource resource1 = new Resource(3,-1,"b","/b",true); |
||||||
|
Resource resource2 = new Resource(4,2,"a1.txt","/a/a1.txt",false); |
||||||
|
Resource resource3 = new Resource(5,3,"b1.txt","/b/b1.txt",false); |
||||||
|
Resource resource4 = new Resource(6,3,"b2.jar","/b/b2.jar",false); |
||||||
|
Resource resource5 = new Resource(7,-1,"b2","/b2",true); |
||||||
|
Resource resource6 = new Resource(8,-1,"b2","/b/b2",true); |
||||||
|
Resource resource7 = new Resource(9,8,"c2.jar","/b/b2/c2.jar",false); |
||||||
|
allList.add(resource1); |
||||||
|
allList.add(resource2); |
||||||
|
allList.add(resource3); |
||||||
|
allList.add(resource4); |
||||||
|
allList.add(resource5); |
||||||
|
allList.add(resource6); |
||||||
|
allList.add(resource7); |
||||||
|
|
||||||
|
|
||||||
|
ResourceFilter resourceFilter = new ResourceFilter(".jar",allList); |
||||||
|
List<Resource> resourceList = resourceFilter.filter(); |
||||||
|
Assert.assertNotNull(resourceList); |
||||||
|
resourceList.stream().forEach(t-> logger.info(t.toString())); |
||||||
|
} |
||||||
|
} |
||||||
@ -0,0 +1,82 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.api.dto.resources.visitor; |
||||||
|
|
||||||
|
import org.apache.dolphinscheduler.api.dto.resources.ResourceComponent; |
||||||
|
import org.apache.dolphinscheduler.dao.entity.Resource; |
||||||
|
import org.junit.Assert; |
||||||
|
import org.junit.Test; |
||||||
|
|
||||||
|
import java.util.ArrayList; |
||||||
|
import java.util.List; |
||||||
|
|
||||||
|
/** |
||||||
|
* resource tree visitor test |
||||||
|
*/ |
||||||
|
public class ResourceTreeVisitorTest { |
||||||
|
|
||||||
|
@Test |
||||||
|
public void visit() throws Exception { |
||||||
|
List<Resource> resourceList = new ArrayList<>(); |
||||||
|
|
||||||
|
Resource resource1 = new Resource(3,-1,"b","/b",true); |
||||||
|
Resource resource2 = new Resource(4,2,"a1.txt","/a/a1.txt",false); |
||||||
|
Resource resource3 = new Resource(5,3,"b1.txt","/b/b1.txt",false); |
||||||
|
Resource resource4 = new Resource(6,3,"b2.jar","/b/b2.jar",false); |
||||||
|
Resource resource5 = new Resource(7,-1,"b2","/b2",true); |
||||||
|
Resource resource6 = new Resource(8,-1,"b2","/b/b2",true); |
||||||
|
Resource resource7 = new Resource(9,8,"c2.jar","/b/b2/c2.jar",false); |
||||||
|
resourceList.add(resource1); |
||||||
|
resourceList.add(resource2); |
||||||
|
resourceList.add(resource3); |
||||||
|
resourceList.add(resource4); |
||||||
|
resourceList.add(resource5); |
||||||
|
resourceList.add(resource6); |
||||||
|
resourceList.add(resource7); |
||||||
|
|
||||||
|
ResourceTreeVisitor resourceTreeVisitor = new ResourceTreeVisitor(resourceList); |
||||||
|
ResourceComponent resourceComponent = resourceTreeVisitor.visit(); |
||||||
|
Assert.assertNotNull(resourceComponent.getChildren()); |
||||||
|
} |
||||||
|
|
||||||
|
@Test |
||||||
|
public void rootNode() throws Exception { |
||||||
|
List<Resource> resourceList = new ArrayList<>(); |
||||||
|
|
||||||
|
Resource resource1 = new Resource(3,-1,"b","/b",true); |
||||||
|
Resource resource2 = new Resource(4,2,"a1.txt","/a/a1.txt",false); |
||||||
|
Resource resource3 = new Resource(5,3,"b1.txt","/b/b1.txt",false); |
||||||
|
Resource resource4 = new Resource(6,3,"b2.jar","/b/b2.jar",false); |
||||||
|
Resource resource5 = new Resource(7,-1,"b2","/b2",true); |
||||||
|
Resource resource6 = new Resource(8,-1,"b2","/b/b2",true); |
||||||
|
Resource resource7 = new Resource(9,8,"c2.jar","/b/b2/c2.jar",false); |
||||||
|
resourceList.add(resource1); |
||||||
|
resourceList.add(resource2); |
||||||
|
resourceList.add(resource3); |
||||||
|
resourceList.add(resource4); |
||||||
|
resourceList.add(resource5); |
||||||
|
resourceList.add(resource6); |
||||||
|
resourceList.add(resource7); |
||||||
|
|
||||||
|
ResourceTreeVisitor resourceTreeVisitor = new ResourceTreeVisitor(resourceList); |
||||||
|
Assert.assertTrue(resourceTreeVisitor.rootNode(resource1)); |
||||||
|
Assert.assertTrue(resourceTreeVisitor.rootNode(resource2)); |
||||||
|
Assert.assertFalse(resourceTreeVisitor.rootNode(resource3)); |
||||||
|
|
||||||
|
} |
||||||
|
|
||||||
|
} |
||||||
@ -0,0 +1,44 @@ |
|||||||
|
/* |
||||||
|
* Licensed to the Apache Software Foundation (ASF) under one or more |
||||||
|
* contributor license agreements. See the NOTICE file distributed with |
||||||
|
* this work for additional information regarding copyright ownership. |
||||||
|
* The ASF licenses this file to You under the Apache License, Version 2.0 |
||||||
|
* (the "License"); you may not use this file except in compliance with |
||||||
|
* the License. You may obtain a copy of the License at |
||||||
|
* |
||||||
|
* http://www.apache.org/licenses/LICENSE-2.0
|
||||||
|
* |
||||||
|
* Unless required by applicable law or agreed to in writing, software |
||||||
|
* distributed under the License is distributed on an "AS IS" BASIS, |
||||||
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
||||||
|
* See the License for the specific language governing permissions and |
||||||
|
* limitations under the License. |
||||||
|
*/ |
||||||
|
package org.apache.dolphinscheduler.common.enums; |
||||||
|
|
||||||
|
import com.baomidou.mybatisplus.annotation.EnumValue; |
||||||
|
|
||||||
|
public enum DbConnectType { |
||||||
|
|
||||||
|
ORACLE_SERVICE_NAME(0, "Oracle Service Name"), |
||||||
|
ORACLE_SID(1, "Oracle SID"); |
||||||
|
|
||||||
|
DbConnectType(int code, String descp) { |
||||||
|
this.code = code; |
||||||
|
this.descp = descp; |
||||||
|
} |
||||||
|
|
||||||
|
@EnumValue |
||||||
|
private final int code; |
||||||
|
|
||||||
|
private final String descp; |
||||||
|
|
||||||
|
public int getCode() { |
||||||
|
return code; |
||||||
|
} |
||||||
|
|
||||||
|
public String getDescp() { |
||||||
|
return descp; |
||||||
|
} |
||||||
|
|
||||||
|
} |
||||||
Loading…
Reference in new issue