Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Aaron Wang
ceea147e2d
[doc] update kubernetes doc ( #13716 )
2 years ago
Wenjun Ruan
1f365819a6
Ignore unknown VM options in start.sh ( #13719 )
2 years ago
Aaron Wang
34d49e0d28
remove WORKER_GROUP conf in values.yaml ( #13718 )
2 years ago
Wenjun Ruan
aef5524ee7
Clearer task runnable. ( #13689 )
...
* Clean unused method in AbstractTask
* Kill task by process.destroy
* wait 5/s after destroy process
2 years ago
He Wang
f06af0d972
[Document] Add OceanBase to supported list ( #13700 )
2 years ago
Eric Gao
394805b2c7
[Feature][Metrics] Tag workflow related metrics with process definition code (workflow id) ( #13640 )
...
* Tag workflow related metrics with process definition code (workflow id)
* Clean up related metrics when deleting workflow definition
* Add license headers
* Update related UT cases
* Add an example in grafana-demo
* Add related docs
2 years ago
朱通通
76f3076481
[Bug] Fix ResourcesServiceImpl.java pageInfo ( #13709 )
2 years ago
Jay Chung
30fd43e32b
feat: Python add online_schedule for workflow control schedule state ( #13551 )
...
related: apache/dolphinscheduler-sdk-python#73
2 years ago
Jay Chung
512899ed14
feat: Python return datasource object and allow filter by type ( #13616 )
...
related: https://github.com/apache/dolphinscheduler-sdk-python/pull/75
2 years ago
fuchanghai
6218f818c0
[improve-#13665] improve datax parser if sql contain * ( #13680 )
...
* [improve-#13665] improve datax parser if sql contain *
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-datax/src/main/java/org/apache/dolphinscheduler/plugin/task/datax/DataxTask.java
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
2 years ago
He Wang
35d8e8ac17
[Feature][DataSource] add oceanbase datasource ( #13675 )
...
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
Wenjun Ruan
c9066e8de9
Use MDC to filter task instance log ( #13673 )
...
* Use MDC to collect task instance log
* Use MDCAutoClosableContext to remove the MDC key
2 years ago
陈家名
a8e3deca8b
[Improvement][api] Remove unless code in ResourcesServiceImpl ( #13676 )
...
* remove unless code in ResourcesServiceImpl
---------
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2 years ago
陈家名
c2d5774790
[Improvement] SQL optimization queryTheHighestPriorityTasks ( #13671 )
...
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2 years ago
Aaron Wang
fd720880c7
[Improvement] Add missing placeholder ( #13663 )
...
* Add missing placeholder
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/KubernetesApplicationManager.java
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
---------
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2 years ago
iuhoay
b48eae8ce7
docs(file-manage): The file in File manage is a relative path, not an absolute path ( #13641 )
2 years ago
Wenjun Ruan
ca9df868f1
Fix task instance log order might be wrong due to async print ( #13660 )
2 years ago
Aaron Wang
08ca57e4e8
[BUG][UI] Flink task display right version and deploy mode ( #13628 )
2 years ago
Rick Cheng
7c97febefb
[Improvement-12697][UT] Improve the ProjectServiceTest ( #12698 )
2 years ago
Rick Cheng
eb4cba8884
[Improvement-12782][UT] Add UT for the 13 implementations of ResourceAcquisitionAndPermissionCheck ( #12784 )
2 years ago
旺阳
43d79e45b4
Fix data quality pwd error ( #13643 )
2 years ago
QuantumXiecao
7586710d49
[fix-13625] Modify systemd-run from MemoryMax to MemoryLimit for more generality ( #13627 )
...
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2 years ago
Jay Chung
c1fd1cba1b
[Document]: Add new quick start doc with more details and gifs ( #13607 )
...
* doc: new quick start doc with more detail and gif
copy paste from https://github.com/bitsondatadev/trino-getting-started/pull/22
and the chinese translate by Google Translate
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
kezhenxu94
9668c84d30
Fix typo ( #13632 )
2 years ago
kezhenxu94
f937c511b1
Publish Docker images to docker hub when released ( #13631 )
2 years ago
Kerwin
9b4605cbdd
[Release][3.1.4] add 3.1.4 release doc ( #13621 )
2 years ago
Qi Zhang
6516240e0c
[Docs] Update rainbond docs ( #13608 )
...
Signed-off-by: Qi Zhang <smallqi1@163.com>
2 years ago
Wenjun Ruan
4351a25f2a
Add execute function to handle the workflow instance operation ( #13610 )
2 years ago
Aaron Wang
938f13b568
[Doc] Spark on K8S ( #13605 )
2 years ago
Rick Cheng
0db916473e
[Improvement-13437][UT] Add UT for S3StorageOperator ( #13530 )
2 years ago
fuchanghai
79d3ed0744
Update DataxUtils.java ( #13604 )
2 years ago
fuchanghai
7bf3e3cdd6
[improve-#13201] update pid during running ( #13206 )
2 years ago
fuchanghai
c406f81e9c
[improve-#13597] fix the method name ( #13599 )
2 years ago
Aaron Wang
047fa2f65e
[Feature-13511] Submit Spark task directly on Kubernetes ( #13550 )
2 years ago
旺阳
aea84055fe
Fix webex teams alert plugin null exception error ( #13591 )
2 years ago
Devosend
eaf2541018
support modal close for datasources ( #13586 )
2 years ago
fuchanghai
701d67c831
[improve-#13045] after a submit failure, stop the processInstance to avoid an endless loop ( #13051 )
...
* [improve-#13045] add max submit number of workflow
* [fix-13405] remove max times
* Update dolphinscheduler-master/src/main/resources/application.yaml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
Wenjun Ruan
e8b20def54
Fix task instance will generate multiple times when retry interval is 0/s ( #13571 )
2 years ago
QuantumXiecao
dd4804ee4c
[fix-13504] Display the current project name on the left corner of the page ( #13572 )
...
Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>
2 years ago
qindongliang
6a0f48e533
[Feature-13354][deploy] Add configurable busybox image in values.yaml ( #13354 ) ( #13560 )
2 years ago
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
kezhenxu94
a6550bc4a2
Set init job as a helm hook so that DS can be upgraded using `helm upgrade`, also remove legacy `registryPluginDir˚` ( #13547 )
2 years ago
Aaron Wang
966201af86
[BUG][Resource Center] NPE caused by uninitialized hdfsProperties ( #13540 )
...
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
* [BUG][Resource Center] NPE caused by uninitialized hdfsProperties
2 years ago
kezhenxu94
e368bde7ee
Publish Helm Chart snapshot to ghcr.io ( #13546 )
2 years ago
fuchanghai
37939add0c
[fix-13492]add single quotes ( #13534 )
...
* [fix-13492]add single quotes
* [improve-#13201] fix test error
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
caishunfeng
df963f8393
[Improvement] Add call cost time for api ( #13518 )
2 years ago
Sheldon
75c5915b78
[Feature-11195][UI] Add re-upload feature for resource files and udf files ( #11203 )
...
* add re-upload feature for resource files
* add re-upload feature for udf files
Co-authored-by: sheldonliu <sheldonliu>
2 years ago
Bingchang Chen
75544025df
[Improvement] Fix typos in tools for demo ( #13538 )
2 years ago
Wenjun Ruan
133d1733eb
Alter title in t_ds_alert to 512 ( #13535 )
2 years ago