xiangzihao
d67ea805f9
[DSIP-38] Add plugin directory in binary package ( #16613 )
2 months ago
Wenjun Ruan
62d33a799a
[DSIP-75] Support auto add license header by spotless ( #16643 )
2 months ago
xiangzihao
fee4955724
[DSIP-68] Unify the table structure and table fields in backend and frontend ui sections ( #16544 )
3 months ago
Wenjun Ruan
9448806af0
[DSIP-61][Master] Refactor thread pool and state event orchestration in master ( #16327 )
3 months ago
Terry Tao
70d6d01ce3
fix(16424): K8sUtils#jobExists may cause huge memory usage ( #16432 )
3 months ago
xiangzihao
a6504412cf
[DSIP-60][Http task plugin] Refactor http task plugin ( #16413 )
4 months ago
zuo
38d599c745
[Fix-15828] fix expandListParameter ( #15878 )
...
* [Fix-15828] Replace the original question mark before regex replacement
4 months ago
zuo
8d1680d2f0
[Fix-16279] Support Java 8 date/time type `java.time.OffsetDateTime` ( #16304 )
...
* [Fix-16279] Support Java 8 date/time type `java.time.OffsetDateTime`
4 months ago
Wenjun Ruan
af83c14298
Fix sonar cannot work ( #16307 )
4 months ago
xiangzihao
761323f3e1
[DSIP-53] Suggest add process lineage parsing for dependent task ( #16288 )
...
* add dsip 53
4 months ago
xiangzihao
e8566818b0
[DSIP-50][UDF Manage] Remove unused udf manage function ( #16212 )
...
* Remove unused udf manage function
5 months ago
Wenjun Ruan
ec6a3e0727
[DSIP-46] Unify the logic task params data structure between front-end and back-end ( #16193 )
5 months ago
Wenjun Ruan
5df4b1cbc3
Fix condition task will cause workflow instance failed ( #16152 )
5 months ago
Wenjun Ruan
5e4afe6f64
Fix task nodes under switch task will not be skipped ( #16108 )
6 months ago
Wenjun Ruan
e6c57430e3
[DSIP-44] Set a delay time to TaskExecuteRunnable if it dispatched failed ( #16069 )
6 months ago
Wenjun Ruan
f754611509
[DSIP-42] Add dolphinscheduler-aws-authentication module ( #16043 )
6 months ago
yinxiaolog
baa252a0ed
[DS-16046][fix] Set PreparedStatement parameter type ( #16050 )
...
Fix the PreparedStatement parameter is TIME, set it to java.sql.Time
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
6 months ago
小可耐
0fc2fe971a
[DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type ( #15967 )
...
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* [Improvement][parameter] New data types and type filtering
* [Improvement][parameter] Improvement startup parameters/global parameters data type
* fix api interfaces compatible
* add project parameter data type default value
* improvement project code
* remove useless imports
* remove method onClearSearchTaskType
* add parameter doc
* optimisation logic
* code conflict resolution
* code conflict resolution
* [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978 )
* update
* test
* add monitor enhance ui
* update
* update
* update doc
* fix spotless
* update
* update
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/CommandMapper.java
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* update
* fix spotless
* update
---------
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
* [Improvement][Monitor] Add UT for montor (#15998 )
* formatting Code
6 months ago
Wenjun Ruan
61915a2d5d
Fix workflow instance restart failed due to duplicate key in varpool ( #16001 )
6 months ago
Eric Gao
dc306bfa1d
[Improvement] Use safe constructor with snake yaml ( #15758 )
6 months ago
Wenjun Ruan
0a11cd21bd
Fix jar path is not correct in java task ( #15906 )
7 months ago
Wenjun Ruan
285c5a8eb5
[DSIP-28] Donnot scan whole bean under classpath ( #15874 )
7 months ago
sleo
f93b27e121
[Worker] Fix will not kill the subprocess in remote when stop a remote-shell task #15570 ( #15629 )
...
* fix cannot kill the subprocess when stop a remote-shell task
* move parse pid logic into ProcessUtils
* extract common logic
---------
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
8 months ago
lch
e3fdb1a3ff
[Fix-15639] parameterPassing is null case NPE ( #15678 )
...
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
9 months ago
Wenjun Ruan
24ff70dc88
Fix out parameter may loss ( #15617 )
9 months ago
Jay Chung
91d56f4860
fix: data quality may fail in docker mode ( #15563 )
10 months ago
dada Sun
4d6af516b9
[Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest ( #15480 ) ( #15529 )
...
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
10 months ago
Jay Chung
8efaa9fa1f
fix: data quality can not use ( #15551 )
...
* fix: data quality can not use
fix : #15468 , #15249 , #14858
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
10 months ago
Wenjun Ruan
4d15932ede
Fix createFile with permission will not work ( #15556 )
10 months ago
zhihuasu
d80a29c48c
[BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils ( #15014 )
...
* Update RetryUtils.java
assigned
* UT
* Update RetryUtilsTest.java
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
10 months ago
Wenjun Ruan
5a7deb28f7
Throw IllegalArgumentException if parse time placeholder error ( #15514 )
...
(cherry picked from commit 5fa31e036d77698f3732a42664bfac3e7edcb8e4)
10 months ago
Wenjun Ruan
64e1e67581
Use DefaultUncaughtExceptionHandler to log the uncached exception ( #15496 )
...
Co-authored-by: fuchanghai <changhaifu@apache.org>
10 months ago
Gallardot
c7a11ce6ed
[Improvement][K8S]Optimize MDC for K8S tasks ( #15390 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: fuchanghai <changhaifu@apache.org>
10 months ago
Gallardot
93ea5f64c3
[Improvement][K8S] Custom label of a K8S task can be passed to the pod ( #15369 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
11 months ago
Wenjun Ruan
d6dea4633c
Optimize server startup log ( #15362 )
11 months ago
Wenjun Ruan
5523a62825
Remove taskQueue and looper in worker ( #15292 )
11 months ago
Wenjun Ruan
5b6b0ceb31
Fix resource file usage(Delete Resource/ResourceUser which is deprecated) ( #15355 )
11 months ago
chenrj
ce11674668
Fix k8sTaskExecutionContext setting configYaml ( #15116 )
...
* fixed the issue of obtaining kubeConfig of k8s tasks
* removed excess files
* removed excess files
* formatted the code
---------
Co-authored-by: xiangzihao <460888207@qq.com>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
11 months ago
Dyqer
0bb48f3429
fail-fast for dependent check ( #15197 )
...
Co-authored-by: Leoric Yue <leoric.yue@zoom.us>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
12 months ago
Wenjun Ruan
2119e41800
[Improvement] Move delay calculation to Master ( #15278 )
12 months ago
Wenjun Ruan
db3d84b73d
[HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression ( #15264 )
12 months ago
Wenjun Ruan
ef2e9c9b67
Set the tenant as the owner in final stage ( #15256 )
12 months ago
Wenjun Ruan
71ee1f0c3d
Support parse task output params under multiple log ( #15244 )
12 months ago
Wenjun Ruan
df656a7671
Fix home page workflow instance miss status ( #15193 )
1 year ago
旺阳
5afd94136c
[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue ( #14992 )
...
* change data quality field name
* fix-dao
* fix-dao
* fix-dao
* fix-dao
* update
* test
* update
* update
1 year ago
chenrj
c532fea00e
[Improvement] Refactoring K8S task plugin with connections managed in connection center ( #14977 )
1 year ago
chenrj
5a3827eef4
[DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks ( #14976 )
...
* Refactoring `Sagemaker` task plugin with connections managed in connection center.
---------
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
1 year ago
Orange Summer
688f84452d
[Feature-14678][Master][UI]Dependent task parameter passing ( #14702 )
...
* feat: dependent task parameter passing
* style: code format
* refactor: remove inappropriate log
* refactor: Modify unreasonable code structure
* refactor: Modify unreasonable code structure
* refactor: Solve conflicts caused by merge
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
1 year ago
Gallardot
049c1511fa
[Improvement][K8S] K8S task support passing context parameters to downstream task ( #14934 )
...
* [Improvement][K8S] K8S task support passing context parameters to downstream task
Signed-off-by: Gallardot <gallardot@apache.org>
* [Improvement][K8S] K8S task support passing context parameters to downstream task
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: update doc img
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: update doc
Signed-off-by: Gallardot <gallardot@apache.org>
* chore: add UT
Signed-off-by: Gallardot <gallardot@apache.org>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
* merge suggestion
Co-authored-by: 旺阳 <wang@lqwang.net>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: David Zollo <dailidong66@gmail.com>
Co-authored-by: 旺阳 <qingwli@cisco.com>
Co-authored-by: 旺阳 <wang@lqwang.net>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
fuchanghai
f90eadd40f
[feature-#14449] add secret in k8s Task ( #14930 )
...
* [feature-#14449] add secret
* [feature-#14449] upgrade UT and rename parameter ```secret```
* [feature-#14449] fix UT
* [feature-#14449] fix UT
* [feature-#14449] improvement
* [feature-#14449] format
---------
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
1 year ago