zhangkuantian
6f90156577
oss avoid listBuckets permission in bucket check ( #14414 )
...
---------
Co-authored-by: kuantian.zhang <kuantian.zhang@inceptio.ai>
1 year ago
IT-Kwj
7a24be0672
[Feature-14404][datasource-plugin] add HANA datasource ( #14404 )
...
---------
Co-authored-by: WeiJian Kong <>
Co-authored-by: xujiaqiang <Xjq634828243>
1 year ago
Rick Cheng
4fa0ab4d7e
[feature][Resource] Add support for Azure Blob Storage in the resource center ( #14082 )
1 year ago
Rick Cheng
66e09dc66e
[Improvement-14295][common] Remove the duplicate FileUtils ( #14301 )
1 year ago
JieguangZhou
e7cdc7c136
[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters ( #14127 )
...
* add dynamic task plugin
* fix ui
* update code
* add DOC
* ADD UT
* fix doc
* fix sanity check
* add upgrade ddl
* fix sql
1 year ago
Rick Cheng
2c057d6a8f
[Improvement-14292][Common] Remove the duplicate OSUtils ( #14293 )
1 year ago
Zinway
18d176c5f4
feat: Introduce new datasource vertica ( #14232 )
...
Co-authored-by: Zinway Liu <zinway.liu@ucloud.cn>
1 year ago
Zzih
43d7b35977
[fix-14119] The checkBucketNameExists method should not use s3Client. listBuckets() ( #14188 )
...
* optimize checkBucketNameExists
* fix code style
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
1 year ago
Aaron Wang
5e87b2d58a
[Bug][Worker] generate kill command with unknown user: default ( #14145 )
1 year ago
He Zhao
f1e78627fc
[feature][plugin] Add snowflake datasource in datasource plugin ( #13729 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
2 years ago
Bingchang Chen
77e58ce245
[Feature] Add SSO login by Casdoor ( #8706 )
2 years ago
Wenjun Ruan
cf91544b99
Refactor logic task ( #13948 )
2 years ago
Jeremy
db6c061c8b
[Feature][plugin] Add databend datasource in datasource plugin ( #13866 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
fuchanghai
ec29220977
[improve-#13966] mask datax log ( #13969 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
He Zhao
c0126b7f30
[Feature][plugin] Support Kyuubi datasource ( #13642 )
...
---------
Co-authored-by: weitong <weitong@cisco.com>
Co-authored-by: Rick Cheng <38122586+rickchengx@users.noreply.github.com>
2 years ago
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2 years ago
Wenjun Ruan
41a8ba9aab
Support alert server HA ( #13865 )
...
* Support alert server cluster
* Remove WORKER_ALERT_LISTEN_HOST in statefulset-dolphinscheduler-worker.yaml
2 years ago
Wenjun Ruan
69fc217ab2
Fix trim might cause NPE in PropertyUtils ( #13853 )
2 years ago
Wenjun Ruan
9df89cf0cf
Use bootstrap user as the default tenant ( #13825 )
2 years ago
Rick Cheng
85605bbef9
[Improvement-13653][Remote Logging] Support api-server to get task log from remote target ( #13654 )
2 years ago
xuhhui
1ac76e1cbb
[Improvement]update spelling mistake for Constants ( #13738 )
...
* [Improvement][Document]Update architecture and process-start-flow pic
* [Improvement]update spelling mistake for Constants
---------
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
Rick Cheng
2dceb6b8ca
[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center ( #13562 )
2 years ago
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
fuchanghai
7bf3e3cdd6
[improve-#13201] update pid during running ( #13206 )
2 years ago
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
fuchanghai
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop ( #13051 )
...
* [improve-#13045] add max submit number of workflow
* [fix-13405] remove max times
* Update dolphinscheduler-master/src/main/resources/application.yaml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
kezhenxu94
e368bde7ee
Publish Helm Chart snapshot to ghcr.io ( #13546 )
2 years ago
seedscoder
8d12dc0702
[Improvement-13491] Use lombok @Slf4j annotation to generate logger ( #13509 )
2 years ago
Wenjun Ruan
b11431db95
Use single thread to refresh kerberos ( #13456 )
2 years ago
Wenjun Ruan
12dd60fa46
Fix task wake up failed will block the event ( #13466 )
2 years ago
Jay Chung
78e5569afd
[feat] Add type local turn on resource center by default ( #13303 )
2 years ago
Tq
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
Wenjun Ruan
713fdbc444
Split the upgrade code ( #13436 )
...
1. Split the upgrade code into different version
2. Log the dml/ddl sql in origin friendly format
3. Fix ddl of 3.0.0 and 3.1.0
4. Fix search resource regular expression injection
2 years ago
qianli2022
8be32d4145
[Feature][Api] When use api to run a process we want get processInstanceId ( #13184 )
...
* add sql
* add mapper
* add dao
* add excutor
Co-authored-by: qianl4 <qianl4@cicso.com>
2 years ago
Tq
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key ( #13379 )
...
* submit redshift auth mode
* add front end
* add doc and fix frontend
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
Wenjun Ruan
6634ff98af
Add source env list in common.properties ( #13317 )
2 years ago
lenian
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG (达梦) data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2 years ago
Aaron Wang
ccad56e88e
[Improvement][Master] Validate same content of input file when using task cache ( #13298 )
...
* support file content checksum
* fix inject null storageOperate bug
2 years ago
Wenjun Ruan
fd3afd84ad
Remove alert when delete workflow instance ( #13281 )
2 years ago
Wenjun Ruan
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
Tq
f0dd4f081f
[Feature][task-plugins-12820] azure azure-sql datasource plugins ( #13209 )
...
* submit azure sql code
* change mssql-jdbc version
* merge changes to delete other
* merge changes to delete other
* add dependencies
2 years ago
JieguangZhou
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
JieguangZhou
e4b9b67255
Allow execute task in workflow instance ( #13103 )
2 years ago
Wenjun Ruan
70ccffeee2
Format task parameter as pretty json ( #13173 )
2 years ago
Yann Ann
6ef74073cc
[Improve-13001]migrate commons-collections -> commons-collections4 ( #13002 )
2 years ago
insist777
1064680ded
[feat][API] New restful API for workflow state ( #13031 )
2 years ago
rickchengx
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2 years ago