eye-gu
0a5b32e8b6
[Improvement-13785][docker] upgrade zk and pg image version to support arm architecture ( #13789 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
2 years ago
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
kezhenxu94
664d2e4ed3
Add init schema job to Helm hooks so that schema can be updated when upgrading deployment ( #13898 )
2 years ago
Wenjun Ruan
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2 years ago
Aaron Wang
34d49e0d28
remove WORKER_GROUP conf in values.yaml ( #13718 )
2 years ago
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
qindongliang
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml ( #13354 ) ( #13560 )
2 years ago
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` ( #13547 )
2 years ago
kezhenxu94
a843e0b96d
Add documentation to release Helm Chart ( #13385 )
2 years ago
Eric Gao
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster ( #13367 )
...
* Add keda autoscaler support for worker deployment when deployed in K8S cluster
* Add mysql scaler for worker autoscaling
* Add docs for worker autoscaler
* Add support for external postgresql db
2 years ago
Eric Gao
dd0d73036e
Fix minio version in helm chart ( #13368 )
2 years ago
陈家名
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file ( #13271 )
...
* tz in docker
* update default tz and update doc
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2 years ago
Amy0104
1f7f900e78
[Fix][Doc] Replace the links. ( #13276 )
...
* [Fix][Doc] Replace the links.
* [Fix][Doc] Revised `.dlc.json`
* [Fix] Fix the dead link.
2 years ago
kezhenxu94
de6bc56aee
Add Terraform deploy manifests for quick setup in AWS ( #13252 )
2 years ago
Amy0104
dcf02eab45
[Fix] Replaced dead links in the docs. ( #13170 )
...
* [Fix] Replaced dead links.
* [Improvement] Format markdowns.
2 years ago
旺阳
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart ( #12987 )
2 years ago
kezhenxu94
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2 years ago
旺阳
23e9d2698c
fix and enhance helm db config ( #12707 )
2 years ago
旺阳
6766ec04df
Add pythonNodePort in config file ( #12685 )
2 years ago
Aaron Wang
08335b1032
[Improvement][Task] Improved way to collect yarn job's appIds ( #12197 )
...
* Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code.
* Add user property `appId.collect` for user to decide how to collect applicationId.
* Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh`
* Update docs to declare how to use aop way.
* Update `LogUtils` to support fetch applicationId in different ways based on the user property.
Co-authored-by: gabrywu <gabrywu@apache.com>
2 years ago
kezhenxu94
d4e7ae96a9
Add configmap resource permissions so config hot reload can work ( #12572 )
2 years ago
kezhenxu94
fdac751379
Add mysql support to helm chart ( #12517 )
2 years ago
司马琦昂
1e792186d0
[Fix][Worker] fix wrong env var name for alert in K8S ( #12369 )
2 years ago
rickchengx
6332fee2b5
[Improvement-12289][k8s] update the common.properties in values.yaml ( #12290 )
2 years ago
rickchengx
08a4c7981f
[improve] Remove the spark version of spark task ( #11860 )
2 years ago
Eric Gao
a44817fc46
[Doc][Style] Fix doc format once for all ( #12006 )
2 years ago
shiyu li
cc5f710147
[helm] fix worker template persistentVolumeClaim link ( #11248 )
2 years ago
陈家名
28469fc9b2
[bug][k8s] Change the config file keys in K8s to be the same as those in common.properties ( #11812 )
2 years ago
陈家名
6f3b0b2432
[k8s] Delete unnecessary configurations. ( #11808 )
2 years ago
爱穿格子裤
1c15a7d605
[fix-11404]: make the common.properties to configurable on values.yaml ( #11441 )
...
and set the resource.storage.type default to hdfs
2 years ago
caishunfeng
b03f2e22cd
fix k8s master and worker start error ( #11156 )
2 years ago
Lyle Shaw
5855274b26
[Fix-10652] fix docker-compose.yml ( #10653 )
...
* [Fix-10652] fix docker-compose.yml
* [Fix-10652] fix docker-stack.yml
* [Fix-10652] fix python api port in k8s config
* Update deploy/kubernetes/dolphinscheduler/templates/deployment-dolphinscheduler-api.yaml
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
* [Fix-10652] fix { { to {{
* [Fix-10652] del space between {{ and -
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
2 years ago
旺阳
0b377f72b1
[Fix-10400]Fix K8s deployment bitnami version error ( #10567 )
...
* Fix k8s bitnami bug
* add comments
2 years ago
旺阳
388b214aca
[fix] Change K8s postgresql password key name ( #10545 )
2 years ago
Mr.An
a7e20798cb
Update chart.yaml dependencies version ( #10420 )
2 years ago
Hwting
5803d5c07c
[fix][deploy]fix run on kubernetes bug ( #10379 )
...
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
* [fix][kubernetes]fix run on kubernetes bug
Fix the problem that the "REGISTRY_ZOOKEEPER_CONNECT_STRING" variable zookeeper port number is "nil"
2 years ago
caishunfeng
4351148f36
[Bug] init docker compose DATABASE env ( #10244 )
...
skip source env if in docker
2 years ago
caishunfeng
b1885c7a26
[Bug] fix run on docker and k8s ( #10026 )
...
* fix docker-compose init schema
* recovery depend on zk
* update doc and dockerfile
* fix run on k8s
* udpate doc
* add DOCKER flag & update doc
* remove repeat DOCKER env
2 years ago
Jiajie Zhong
8d17fd20f9
[ci] Dead link check all markdown file ( #10004 )
...
there are 162 markdown files in dir `docs`
and all file in project is 175 files, so I
think check all file will not add too much
load for our ci, but it could discovered
the dead link in time to avoid some thing
like #9998
3 years ago
jiachuan.zhu
24e455304c
Add ingress annotations ( #9492 )
3 years ago
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
3 years ago
Jiajie Zhong
3457cee960
[python] Migrate pythonGatewayServer into api server ( #9372 )
...
Currently the size of our distribute package is up to
800MB, this patch is migrate python gateway server into
api server
The distribute package size before and after this patch is:
```sh
# before
796M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
# after
647M apache-dolphinscheduler-2.0.4-SNAPSHOT-bin.tar.gz
```
3 years ago
Jiajie Zhong
9f84dbbda0
[doc] Migrate dev doc from website repository ( #9291 )
...
* [doc] Migrate dev doc from website repository
* Correct release language
* Fix license issue
* Add all images from website
* Delete unused images
* Add CI
* Fix ci
* fix ci
* Remove no need file
* Add latest commit from website
* correct img_utils.py script
* Remove unused imgs
3 years ago
simsicon
a38adcb579
Fix https://github.com/apache/dolphinscheduler/issues/8602 ( #8604 )
3 years ago
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT ( #8188 )
3 years ago
kezhenxu94
df26be89ed
Fix wrong Python gateway docker image name ( #8143 )
3 years ago
wind
c16f65e0d1
[conf] Update master config on k8s ( #8045 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
da4a85943c
[python] Add independent deployment for python gateway server ( #7549 )
...
* [python] Add independent deployment to python gateway server
* Correct some error
* Add missing deployment change
* Add missing expose port
* Add missing standalone config
* Keyword change from rpc to socket
* try to fix
* Add python gateway server to scp-hosts.sh
3 years ago
Aaron Lin
7fd94ffa40
[Improvement][Logger]Remove the logger server from the deployment ( #7837 )
3 years ago