3446fd8ab1
EMR task support replace params placeholder ( #15975 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
8 months ago
60b019b729
[Improvement] Fix the git url command injection in pytorch task( #15873 ) ( #15950 )
...
* fix the git url command injection danger(#15873 )
* [Improvement] Fix the git url command injection in pytorch,format code style task(#15873 )
---------
Co-authored-by: cntigers <Xiaohu4321@>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
8 months ago
5c569b705c
[fix-15907] Fix get remote shell exit code is incorrect ( #15911 )
...
* ./mvnw spotless:apply
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-remoteshell/src/main/java/org/apache/dolphinscheduler/plugin/task/remoteshell/RemoteExecutor.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
8 months ago
0a11cd21bd
Fix jar path is not correct in java task ( #15906 )
8 months ago
6c78c8ec9a
[Improvement][Spark] Support Local Spark Cluster ( #15589 )
...
* [Improvement][Spark] Support Local Spark Cluster
* remote default local from deploy mode
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
8 months ago
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
8 months ago
3fe9fd45b1
[Fix-15706] Seatunnel improvement ( #15852 )
...
* fix_seatunnel_15706
* CodeFormat
* Change to use JSONUtils
* Constants moved to constant code
* Delete empty lines
* Delete empty lines
9 months ago
9437d276e7
Change ssh heartbeat type to IGNORE ( #15858 )
9 months ago
f93b27e121
[Worker] Fix will not kill the subprocess in remote when stop a remote-shell task #15570 ( #15629 )
...
* fix cannot kill the subprocess when stop a remote-shell task
* move parse pid logic into ProcessUtils
* extract common logic
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
9 months ago
3b1de41acb
Remove dolphinscheduler-data-quality from dolphinscheduler-task-dataquality ( #15791 )
9 months ago
cd63069317
[Improvement-15692][task-datasync] rewrite the mockito test file for DatasyncTaskTest. ( #15693 )
...
* 15692 rewrite the mockito test file for DatasyncTaskTest.
* fix format
10 months ago
e3fdb1a3ff
[Fix-15639] parameterPassing is null case NPE ( #15678 )
...
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
10 months ago
3fda980006
[Task][Remoteshell] fix maven dependency warn ( #15635 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
10 months ago
00008515c0
Update SeatunnelTask.java ( #15621 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
10 months ago
24ff70dc88
Fix out parameter may loss ( #15617 )
10 months ago
91d56f4860
fix: data quality may fail in docker mode ( #15563 )
11 months ago
4d6af516b9
[Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest ( #15480 ) ( #15529 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
11 months ago
8efaa9fa1f
fix: data quality can not use ( #15551 )
...
* fix: data quality can not use
fix : #15468 , #15249 , #14858
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
11 months ago
4d15932ede
Fix createFile with permission will not work ( #15556 )
11 months ago
3640a28348
[Improvement][HTTP] support custom rendering of http body ( #15531 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
11 months ago
d80a29c48c
[BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils ( #15014 )
...
* Update RetryUtils.java
assigned
* UT
* Update RetryUtilsTest.java
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
11 months ago
5a7deb28f7
Throw IllegalArgumentException if parse time placeholder error ( #15514 )
...
(cherry picked from commit 5fa31e036d77698f3732a42664bfac3e7edcb8e4)
11 months ago
64e1e67581
Use DefaultUncaughtExceptionHandler to log the uncached exception ( #15496 )
...
Co-authored-by: fuchanghai <changhaifu@apache.org>
12 months ago
c7a11ce6ed
[Improvement][K8S]Optimize MDC for K8S tasks ( #15390 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
12 months ago
ace0860d3d
[Feature-15475][DinkyTask] DinkyTask supports Dinky-1.0.0 and common sql ( #15479 )
12 months ago
bd48c99178
[BUG][Task] fix java task classpath ( #15470 )
...
* fix javatask bug
* cover
---------
Co-authored-by: 80597928 <673421862@qq.com>
Co-authored-by: fuchanghai <changhaifu@apache.org>
12 months ago
bf2cdc5300
Use Druid to split sql ( #15367 )
1 year ago
93ea5f64c3
[Improvement][K8S] Custom label of a K8S task can be passed to the pod ( #15369 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
1 year ago
d6dea4633c
Optimize server startup log ( #15362 )
1 year ago
5523a62825
Remove taskQueue and looper in worker ( #15292 )
1 year ago
921253109a
[Bug] Close SSH session after remote shell finish ( #15348 )
...
* Close SSH session after remote shell finish
---------
Co-authored-by: David Zollo <davidzollo365@gmail.com>
1 year ago
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
1 year ago
f921457a55
Set maxRows in SqlTask ( #15342 )
...
(cherry picked from commit b6b88e3e62d8245e08408fb60c48d23c0bd0bb46)
1 year ago
ce11674668
Fix k8sTaskExecutionContext setting configYaml ( #15116 )
...
* fixed the issue of obtaining kubeConfig of k8s tasks
* removed excess files
* removed excess files
* formatted the code
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
1 year ago
159179ac95
[Feature-15146][dolphinscheduler-task-sqoop] add sqoop source/target type ( #15146 )
...
* task list: sgoop node params optimize
* security.ts add alarm_instance params
* 1 add SqoopTask params
2 add alert plugin aliyun-voice
* add license header
* commit sqhoop optimize
* pnpm-locl.yaml supplement annotation
* remove irrelevent commit.
* Code specification optimization
* optimize sqoop task ui
* Merge Code
* add the license header to pnpm-locl.yaml
* format the code
* format the code
* Fix sqoop task echo error
---------
Co-authored-by: xujiaqiang <xujiaqiang@aimatech.com>
Co-authored-by: xujiaqiang <“xujiaqiangwz@163.com”>
Co-authored-by: David Zollo <dailidong66@gmail.com>
1 year ago
0bb48f3429
fail-fast for dependent check ( #15197 )
...
Co-authored-by: Leoric Yue <leoric.yue@zoom.us>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
1 year ago
2119e41800
[Improvement] Move delay calculation to Master ( #15278 )
1 year ago
db3d84b73d
[HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression ( #15264 )
1 year ago
ef2e9c9b67
Set the tenant as the owner in final stage ( #15256 )
1 year ago
71ee1f0c3d
Support parse task output params under multiple log ( #15244 )
1 year ago
df656a7671
Fix home page workflow instance miss status ( #15193 )
1 year ago
5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue ( #14992 )
...
* change data quality field name
* fix-dao
* fix-dao
* fix-dao
* fix-dao
* update
* test
* update
* update
1 year ago
c532fea00e
[Improvement] Refactoring K8S task plugin with connections managed in connection center ( #14977 )
1 year ago
5a3827eef4
[DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks ( #14976 )
...
* Refactoring `Sagemaker` task plugin with connections managed in connection center.
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
e99c5950b9
[DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks ( #14434 )
...
* Refactoring zeppelin task plugin with connections managed in connection center
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
99214d0fc3
Fix SqlTask cannot split the given sql when browser in windows ( #15062 )
1 year ago
688f84452d
[Feature-14678][Master][UI]Dependent task parameter passing ( #14702 )
...
* feat: dependent task parameter passing
* style: code format
* refactor: remove inappropriate log
* refactor: Modify unreasonable code structure
* refactor: Modify unreasonable code structure
* refactor: Solve conflicts caused by merge
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
1 year ago
049c1511fa
[Improvement][K8S] K8S task support passing context parameters to downstream task ( #14934 )
...
* [Improvement][K8S] K8S task support passing context parameters to downstream task
Signed-off-by: Gallardot <gallardot@apache.org>
* [Improvement][K8S] K8S task support passing context parameters to downstream task
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: update doc img
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: update doc
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: add UT
Signed-off-by: Gallardot <gallardot@apache.org>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
f90eadd40f
[feature-#14449] add secret in k8s Task ( #14930 )
...
* [feature-#14449] add secret
* [feature-#14449] upgrade UT and rename parameter ```secret```
* [feature-#14449] fix UT
* [feature-#14449] fix UT
* [feature-#14449] improvement
* [feature-#14449] format
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
1 year ago
6de1e2c1b3
Fix the error of using shell task to obtain Home variable in Ubuntu system. ( #14964 )
1 year ago
Wenjun Ruan
cntiger
Zzih96
John Huang
XinXing
sleo
Tq
lch
Gallardot
王渔
Jay Chung
dada Sun
zhihuasu
aiwenmo
lizhenglei
chenrj
xujiaqiang
Dyqer
旺阳
Orange Summer
fuchanghai
Kerwin