55cc77226f
[RPC] Refactor the remote module. ( #14776 )
...
* Add dolphinscheduler-extract-base
* Add dolphinscheduler-extract-master
* Add dolphinscheduler-extract-worker
* Add dolphinscheduler-extract-alert
1 year ago
70731a1617
[Feature][Authentication] support oauth2 login ( #14743 )
...
* support oauth2 login
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
25480ae9e7
[Feature][Resource Center] Add support for Huawei Cloud OBS ( #14643 )
...
* [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center
* add license and add doc
* add 3-party dependency license
* Update LICENSE
* fix
* Update pom.xml
* fix
* fix
---------
Co-authored-by: sunkang <sunkang@hjfruit.com>
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
1 year ago
93b0283dfe
Set tenant as the the resource file owner ( #13832 )
1 year ago
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
1 year ago
2b99451ccd
Support filter restrict network interface ( #14638 )
1 year ago
cbd354d134
Add host/port in heartbeat ( #14591 )
1 year ago
1d0d85b988
[Feature] doris add datasource ( #14391 )
...
* Added doris data source plug-in
* Update DbType.java
* XML configuration
* doc and ui
* Missing catch of NumberFormatException
* code format
---------
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
c30cca9d9a
Support execute shell in different interceptor ( #14582 )
1 year ago
399d0d0ce9
Add log for NetUtils ( #14578 )
1 year ago
9d10de6efa
[Improvement][Task] Mask configYaml in task log ( #14571 )
...
* [Improvement][Task] Mask configYaml in task log
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
1 year ago
e6d94632b9
Add WorkflowExecuteContext ( #14544 )
1 year ago
175d976cd2
[Feature][Data Quality] Data Quality Support Choose Database ( #14406 )
...
* add dataquality database api
* change ui
* api change
* update
* fix spotless
* fix h2
* fix pg
* fix-dead-line
* update
* fix-spotless
* update pg sql
* add ut
* fix ut
1 year ago
76b1eefb68
[Feature-14321][API] Support to complement data in descending or ascending order of date ( #14450 )
2 years ago
6f90156577
oss avoid listBuckets permission in bucket check ( #14414 )
...
---------
Co-authored-by: kuantian.zhang <kuantian.zhang@inceptio.ai>
2 years ago
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource ( #14404 )
...
---------
Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
2 years ago
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
2 years ago
66e09dc66e
[Improvement-14295][common] Remove the duplicate FileUtils ( #14301 )
2 years ago
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
2 years ago
2c057d6a8f
[Improvement-14292][Common] Remove the duplicate OSUtils ( #14293 )
2 years ago
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
2 years ago
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() ( #14188 )
...
* optimize checkBucketNameExists
* fix code style
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
2 years ago
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default ( #14145 )
2 years ago
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2 years ago
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2 years ago
cf91544b99
Refactor logic task ( #13948 )
2 years ago
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
ec29220977
[improve-#13966] mask datax log ( #13969 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2 years ago
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2 years ago
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
69fc217ab2
Fix trim might cause NPE in PropertyUtils ( #13853 )
2 years ago
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2 years ago
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2 years ago
1ac76e1cbb
[Improvement]update spelling mistake for Constants ( #13738 )
...
* [Improvement][Document]Update architecture and process-start-flow pic
* [Improvement]update spelling mistake for Constants
---------
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2 years ago
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
7bf3e3cdd6
[improve-#13201] update pid during running ( #13206 )
2 years ago
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop ( #13051 )
...
* [improve-#13045] add max submit number of workflow
* [fix-13405] remove max times
* Update dolphinscheduler-master/src/main/resources/application.yaml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
e368bde7ee
Publish Helm Chart snapshot to ghcr.io ( #13546 )
2 years ago
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
b11431db95
Use single thread to refresh kerberos ( #13456 )
2 years ago
12dd60fa46
Fix task wake up failed will block the event ( #13466 )
2 years ago
78e5569afd
[feat] Add type local turn on resource center by default ( #13303 )
2 years ago
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
713fdbc444
Split the upgrade code ( #13436 )
...
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2 years ago
Wenjun Ruan
yangyang zhong
Edison Catto
Xinxing
Gallardot
旺阳
calvin
zhangkuantian
IT-Kwj
Rick Cheng
JieguangZhou
Zinway
Zzih
Aaron Wang
He Zhao
Bingchang Chen
Jeremy
fuchanghai
Rick Cheng
xuhhui
He Wang
kezhenxu94
seedscoder
Jay Chung
Tq