9448806af0
[DSIP-61][Master] Refactor thread pool and state event orchestration in master ( #16327 )
3 months ago
70d6d01ce3
fix(16424): K8sUtils#jobExists may cause huge memory usage ( #16432 )
3 months ago
a6504412cf
[DSIP-60][Http task plugin] Refactor http task plugin ( #16413 )
4 months ago
f7da8f39db
[Feature-16127] Support emr serverless spark ( #16126 )
...
* support emr serverless spark task
Signed-off-by: EricGao888 <ericgao.apache@gmail.com>
---------
Signed-off-by: EricGao888 <ericgao.apache@gmail.com>
4 months ago
38d599c745
[Fix-15828] fix expandListParameter ( #15878 )
...
* [Fix-15828] Replace the original question mark before regex replacement
4 months ago
1199a916b3
[Feature-16132][Task Plugin] support for oceanbase datax task ( #16281 )
...
* Add support for oceanbase's datax task --feat
* fix code style
---------
Co-authored-by: xiangzihao <460888207@qq.com>
4 months ago
8d1680d2f0
[Fix-16279] Support Java 8 date/time type `java.time.OffsetDateTime` ( #16304 )
...
* [Fix-16279] Support Java 8 date/time type `java.time.OffsetDateTime`
4 months ago
af83c14298
Fix sonar cannot work ( #16307 )
4 months ago
761323f3e1
[DSIP-53] Suggest add process lineage parsing for dependent task ( #16288 )
...
* add dsip 53
4 months ago
82ff24ae99
[Fix-16295][Task] Remote Shell Task plugin run error ( #16296 )
4 months ago
82b501aa8e
[Feature-16269][dinky-task]Supports dinky tasks to accept Prepare Params passed within a task or from a previous task ( #15947 )
...
* fix dinky unresolve params
* Supplement the Dinky documentation
5 months ago
d42ac96c55
[Fix-16211] Remove ExecutePath in buildJarCommand to fix Java Task in Jar Mode ( #16238 )
5 months ago
225e969d2d
[DSIP-51][Task] Remove unused pigeon task plugin ( #16219 )
5 months ago
e8566818b0
[DSIP-50][UDF Manage] Remove unused udf manage function ( #16212 )
...
* Remove unused udf manage function
5 months ago
ec6a3e0727
[DSIP-46] Unify the logic task params data structure between front-end and back-end ( #16193 )
5 months ago
5df4b1cbc3
Fix condition task will cause workflow instance failed ( #16152 )
5 months ago
5e4afe6f64
Fix task nodes under switch task will not be skipped ( #16108 )
6 months ago
a7245189a8
[Improvement][Flink] Change Flink command into FLINK_HOME ( #16004 )
6 months ago
e93ed78c0f
[Fix] Fix audit log parma typo ( #16077 )
6 months ago
e6c57430e3
[DSIP-44] Set a delay time to TaskExecuteRunnable if it dispatched failed ( #16069 )
6 months ago
f754611509
[DSIP-42] Add dolphinscheduler-aws-authentication module ( #16043 )
6 months ago
baa252a0ed
[DS-16046][fix] Set PreparedStatement parameter type ( #16050 )
...
Fix the PreparedStatement parameter is TIME, set it to java.sql.Time
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
6 months ago
0fc2fe971a
[DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type ( #15967 )
...
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* improvement project code
* remove useless imports
* remove method onClearSearchTaskType
* add parameter doc
* optimisation logic
* code conflict resolution
* code conflict resolution
* [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978 )
* update
* test
* add monitor enhance ui
* update
* update
* update doc
* fix spotless
* update
* update
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/CommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* update
* fix spotless
* update
---------
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* [Improvement][Monitor] Add UT for montor (#15998 )
* formatting Code
6 months ago
61915a2d5d
Fix workflow instance restart failed due to duplicate key in varpool ( #16001 )
6 months ago
dc306bfa1d
[Improvement] Use safe constructor with snake yaml ( #15758 )
6 months ago
3446fd8ab1
EMR task support replace params placeholder ( #15975 )
...
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
7 months ago
60b019b729
[Improvement] Fix the git url command injection in pytorch task( #15873 ) ( #15950 )
...
* fix the git url command injection danger(#15873 )
* [Improvement] Fix the git url command injection in pytorch,format code style task(#15873 )
---------
Co-authored-by: cntigers <Xiaohu4321@>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
7 months ago
5c569b705c
[fix-15907] Fix get remote shell exit code is incorrect ( #15911 )
...
* ./mvnw spotless:apply
* Update dolphinscheduler-task-plugin/dolphinscheduler-task-remoteshell/src/main/java/org/apache/dolphinscheduler/plugin/task/remoteshell/RemoteExecutor.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
---------
Co-authored-by: 詹子恒 <ziheng.zhan@longbridge.sg>
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
7 months ago
0a11cd21bd
Fix jar path is not correct in java task ( #15906 )
7 months ago
6c78c8ec9a
[Improvement][Spark] Support Local Spark Cluster ( #15589 )
...
* [Improvement][Spark] Support Local Spark Cluster
* remote default local from deploy mode
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
7 months ago
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
7 months ago
3fe9fd45b1
[Fix-15706] Seatunnel improvement ( #15852 )
...
* fix_seatunnel_15706
* CodeFormat
* Change to use JSONUtils
* Constants moved to constant code
* Delete empty lines
* Delete empty lines
7 months ago
9437d276e7
Change ssh heartbeat type to IGNORE ( #15858 )
7 months ago
f93b27e121
[Worker] Fix will not kill the subprocess in remote when stop a remote-shell task #15570 ( #15629 )
...
* fix cannot kill the subprocess when stop a remote-shell task
* move parse pid logic into ProcessUtils
* extract common logic
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
8 months ago
3b1de41acb
Remove dolphinscheduler-data-quality from dolphinscheduler-task-dataquality ( #15791 )
8 months ago
cd63069317
[Improvement-15692][task-datasync] rewrite the mockito test file for DatasyncTaskTest. ( #15693 )
...
* 15692 rewrite the mockito test file for DatasyncTaskTest.
* fix format
9 months ago
e3fdb1a3ff
[Fix-15639] parameterPassing is null case NPE ( #15678 )
...
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
9 months ago
3fda980006
[Task][Remoteshell] fix maven dependency warn ( #15635 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
9 months ago
00008515c0
Update SeatunnelTask.java ( #15621 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: xiangzihao <460888207@qq.com>
9 months ago
24ff70dc88
Fix out parameter may loss ( #15617 )
9 months ago
91d56f4860
fix: data quality may fail in docker mode ( #15563 )
10 months ago
4d6af516b9
[Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest ( #15480 ) ( #15529 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
10 months ago
8efaa9fa1f
fix: data quality can not use ( #15551 )
...
* fix: data quality can not use
fix : #15468 , #15249 , #14858
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
10 months ago
4d15932ede
Fix createFile with permission will not work ( #15556 )
10 months ago
3640a28348
[Improvement][HTTP] support custom rendering of http body ( #15531 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
10 months ago
d80a29c48c
[BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils ( #15014 )
...
* Update RetryUtils.java
assigned
* UT
* Update RetryUtilsTest.java
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
10 months ago
5a7deb28f7
Throw IllegalArgumentException if parse time placeholder error ( #15514 )
...
(cherry picked from commit 5fa31e036d77698f3732a42664bfac3e7edcb8e4)
10 months ago
64e1e67581
Use DefaultUncaughtExceptionHandler to log the uncached exception ( #15496 )
...
Co-authored-by: fuchanghai <changhaifu@apache.org>
10 months ago
c7a11ce6ed
[Improvement][K8S]Optimize MDC for K8S tasks ( #15390 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
10 months ago
ace0860d3d
[Feature-15475][DinkyTask] DinkyTask supports Dinky-1.0.0 and common sql ( #15479 )
10 months ago
Wenjun Ruan
Terry Tao
xiangzihao
Eric Gao
zuo
xxsc0529
wangbowen
gaoyan
blink
JohnHuang
旺阳
yinxiaolog
小可耐
cntiger
Zzih96
XinXing
sleo
Tq
lch
Gallardot
王渔
Jay Chung
dada Sun
zhihuasu
aiwenmo