c5bc535b85
[Improvement][Common] Obtain resource information in the k8s environm… ( #14968 )
...
* [Improvement][Common] Obtain resource information in the k8s environment.
* [Improvement][Common] Change the comment
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
1 year ago
020092ed1e
Set charset in upgrading tools to solve read upgrade sql mojibake ( #14955 )
1 year ago
73e846d03e
[Improvement-14884][Master] Add overload state in master heartbeat to trigger slot change ( #14887 )
1 year ago
e7c579d8f1
Fix java.sql.Date serialize error by convert it to java.util.Date ( #13050 )
1 year ago
76bbcbeb30
[Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent ( #14824 )
...
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- delete useless output
* [Improvement][Master] Split the task dependency mode of the dependent node into workflow dependent and task dependent. (#11970 )
- add log
- run spotless check
---------
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
1 year ago
b12df72a0c
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default ( #14661 )
1 year ago
55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
70731a1617
[Feature][Authentication] support oauth2 login ( #14743 )
...
* support oauth2 login
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS ( #14643 )
...
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center
* add license and add doc
* add 3-party dependency license
* Update LICENSE
* fix
* Update pom.xml
* fix
* fix
---------
Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
1 year ago
93b0283dfe
Set tenant as the the resource file owner ( #13832 )
1 year ago
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
1 year ago
2b99451ccd
Support filter restrict network interface ( #14638 )
1 year ago
cbd354d134
Add host/port in heartbeat ( #14591 )
1 year ago
1d0d85b988
[Feature] doris add datasource ( #14391 )
...
* Added doris data source plug-in
* Update DbType.java
* XML configuration
* doc and ui
* Missing catch of NumberFormatException
* code format
---------
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
c30cca9d9a
Support execute shell in different interceptor ( #14582 )
1 year ago
399d0d0ce9
Add log for NetUtils ( #14578 )
1 year ago
9d10de6efa
[Improvement][Task] Mask configYaml in task log ( #14571 )
...
* [Improvement][Task] Mask configYaml in task log
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
1 year ago
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
1 year ago
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database ( #14406 )
...
* add dataquality database api
* change ui
* api change
* update
* fix spotless
* fix h2
* fix pg
* fix-dead-line
* update
* fix-spotless
* update pg sql
* add ut
* fix ut
1 year ago
76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date ( #14450 )
2 years ago
6f90156577
oss avoid listBuckets permission in bucket check ( #14414 )
...
---------
Co-authored-by: kuantian.zhang <kuantian.zhang@inceptio.ai>
2 years ago
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource ( #14404 )
...
---------
Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
2 years ago
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
2 years ago
66e09dc66e
[Improvement-14295][common] Remove the duplicate FileUtils ( #14301 )
2 years ago
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2 years ago
2c057d6a8f
[Improvement-14292][Common] Remove the duplicate OSUtils ( #14293 )
2 years ago
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2 years ago
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() ( #14188 )
...
* optimize checkBucketNameExists
* fix code style
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2 years ago
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default ( #14145 )
2 years ago
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2 years ago
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2 years ago
cf91544b99
Refactor logic task ( #13948 )
2 years ago
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
ec29220977
[improve-#13966] mask datax log ( #13969 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2 years ago
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2 years ago
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
69fc217ab2
Fix trim might cause NPE in PropertyUtils ( #13853 )
2 years ago
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2 years ago
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2 years ago
1ac76e1cbb
[Improvement]update spelling mistake for Constants ( #13738 )
...
* [Improvement][Document]Update architecture and process-start-flow pic
* [Improvement]update spelling mistake for Constants
---------
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2 years ago
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
7bf3e3cdd6
[improve-#13201] update pid during running ( #13206 )
2 years ago
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop ( #13051 )
...
* [improve-#13045] add max submit number of workflow
* [fix-13405] remove max times
* Update dolphinscheduler-master/src/main/resources/application.yaml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
e368bde7ee
Publish Helm Chart snapshot to ghcr.io ( #13546 )
2 years ago
winghv
Wenjun Ruan
Aaron Wang
JueLance
sgw
yangyang zhong
Edison Catto
Xinxing
Gallardot
旺阳
calvin
zhangkuantian
IT-Kwj
Rick Cheng
JieguangZhou
Zinway
Zzih
He Zhao
Bingchang Chen
Jeremy
fuchanghai
Rick Cheng
xuhhui
He Wang
kezhenxu94