DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
xiangzihao	e8566818b0	[DSIP-50][UDF Manage] Remove unused udf manage function (#16212 ) * Remove unused udf manage function	4 months ago
Wenjun Ruan	ec6a3e0727	[DSIP-46] Unify the logic task params data structure between front-end and back-end (#16193 )	4 months ago
Wenjun Ruan	5df4b1cbc3	Fix condition task will cause workflow instance failed (#16152 )	5 months ago
Wenjun Ruan	5e4afe6f64	Fix task nodes under switch task will not be skipped (#16108 )	5 months ago
Wenjun Ruan	e6c57430e3	[DSIP-44] Set a delay time to TaskExecuteRunnable if it dispatched failed (#16069 )	5 months ago
Wenjun Ruan	f754611509	[DSIP-42] Add dolphinscheduler-aws-authentication module (#16043 )	5 months ago
yinxiaolog	baa252a0ed	[DS-16046][fix] Set PreparedStatement parameter type (#16050 ) Fix the PreparedStatement parameter is TIME, set it to java.sql.Time Co-authored-by: Aaron Wang <wangweirao16@gmail.com> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	5 months ago
小可耐	0fc2fe971a	[DSIP-39][parameter] Improvement startup parameters/global parameters/project parameters data type (#15967 ) * [Improvement][parameter] New data types and type filtering * [Improvement][parameter] Improvement startup parameters/global parameters data type * fix api interfaces compatible * add project parameter data type default value * [Improvement][parameter] New data types and type filtering * [Improvement][parameter] Improvement startup parameters/global parameters data type * fix api interfaces compatible * add project parameter data type default value * improvement project code * remove useless imports * remove method onClearSearchTaskType * add parameter doc * optimisation logic * code conflict resolution * code conflict resolution * [Improvement][Monitor] Show master && worker Busy Or Normal Status and Show Commands table list (#15978) * update * test * add monitor enhance ui * update * update * update doc * fix spotless * update * update * Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/DataAnalysisController.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/CommandMapper.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ErrorCommandMapper.xml Co-authored-by: Wenjun Ruan <wenjun@apache.org> * update * fix spotless * update --------- Co-authored-by: Wenjun Ruan <wenjun@apache.org> * [Improvement][Monitor] Add UT for montor (#15998) * formatting Code	5 months ago
Wenjun Ruan	61915a2d5d	Fix workflow instance restart failed due to duplicate key in varpool (#16001 )	6 months ago
Eric Gao	dc306bfa1d	[Improvement] Use safe constructor with snake yaml (#15758 )	6 months ago
Wenjun Ruan	0a11cd21bd	Fix jar path is not correct in java task (#15906 )	6 months ago
Wenjun Ruan	285c5a8eb5	[DSIP-28] Donnot scan whole bean under classpath (#15874 )	7 months ago
sleo	f93b27e121	[Worker] Fix will not kill the subprocess in remote when stop a remote-shell task #15570 (#15629 ) * fix cannot kill the subprocess when stop a remote-shell task * move parse pid logic into ProcessUtils * extract common logic --------- Co-authored-by: 旺阳 <wang@lqwang.net> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	7 months ago
lch	e3fdb1a3ff	[Fix-15639] parameterPassing is null case NPE (#15678 ) Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	8 months ago
Wenjun Ruan	24ff70dc88	Fix out parameter may loss (#15617 )	8 months ago
Jay Chung	91d56f4860	fix: data quality may fail in docker mode (#15563 )	9 months ago
dada Sun	4d6af516b9	[Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest (#15480 ) (#15529 ) Co-authored-by: Rick Cheng <rickchengx@gmail.com>	9 months ago
Jay Chung	8efaa9fa1f	fix: data quality can not use (#15551 ) * fix: data quality can not use fix: #15468, #15249, #14858 --------- Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	9 months ago
Wenjun Ruan	4d15932ede	Fix createFile with permission will not work (#15556 )	9 months ago
zhihuasu	d80a29c48c	[BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils (#15014 ) * Update RetryUtils.java assigned * UT * Update RetryUtilsTest.java --------- Co-authored-by: xiangzihao <460888207@qq.com> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	9 months ago
Wenjun Ruan	5a7deb28f7	Throw IllegalArgumentException if parse time placeholder error (#15514 ) (cherry picked from commit 5fa31e036d77698f3732a42664bfac3e7edcb8e4)	9 months ago
Wenjun Ruan	64e1e67581	Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496 ) Co-authored-by: fuchanghai <changhaifu@apache.org>	10 months ago
Gallardot	c7a11ce6ed	[Improvement][K8S]Optimize MDC for K8S tasks (#15390 ) Signed-off-by: Gallardot <gallardot@apache.org> Co-authored-by: fuchanghai <changhaifu@apache.org>	10 months ago
Gallardot	93ea5f64c3	[Improvement][K8S] Custom label of a K8S task can be passed to the pod (#15369 ) Signed-off-by: Gallardot <gallardot@apache.org>	10 months ago
Wenjun Ruan	d6dea4633c	Optimize server startup log (#15362 )	10 months ago
Wenjun Ruan	5523a62825	Remove taskQueue and looper in worker (#15292 )	10 months ago
Wenjun Ruan	5b6b0ceb31	Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355 )	10 months ago
chenrj	ce11674668	Fix k8sTaskExecutionContext setting configYaml (#15116 ) * fixed the issue of obtaining kubeConfig of k8s tasks * removed excess files * removed excess files * formatted the code --------- Co-authored-by: xiangzihao <460888207@qq.com> Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	11 months ago
Dyqer	0bb48f3429	fail-fast for dependent check (#15197 ) Co-authored-by: Leoric Yue <leoric.yue@zoom.us> Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	11 months ago
Wenjun Ruan	2119e41800	[Improvement] Move delay calculation to Master (#15278 )	11 months ago
Wenjun Ruan	db3d84b73d	[HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression (#15264 )	11 months ago
Wenjun Ruan	ef2e9c9b67	Set the tenant as the owner in final stage (#15256 )	11 months ago
Wenjun Ruan	71ee1f0c3d	Support parse task output params under multiple log (#15244 )	11 months ago
Wenjun Ruan	df656a7671	Fix home page workflow instance miss status (#15193 )	12 months ago
旺阳	5afd94136c	[Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992 ) * change data quality field name * fix-dao * fix-dao * fix-dao * fix-dao * update * test * update * update	12 months ago
chenrj	c532fea00e	[Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977 )	1 year ago
chenrj	5a3827eef4	[DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976 ) * Refactoring `Sagemaker` task plugin with connections managed in connection center. --------- Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	1 year ago
Orange Summer	688f84452d	[Feature-14678][Master][UI]Dependent task parameter passing (#14702 ) * feat: dependent task parameter passing * style: code format * refactor: remove inappropriate log * refactor: Modify unreasonable code structure * refactor: Modify unreasonable code structure * refactor: Solve conflicts caused by merge --------- Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>	1 year ago
Gallardot	049c1511fa	[Improvement][K8S] K8S task support passing context parameters to downstream task (#14934 ) * [Improvement][K8S] K8S task support passing context parameters to downstream task Signed-off-by: Gallardot <gallardot@apache.org> * [Improvement][K8S] K8S task support passing context parameters to downstream task Signed-off-by: Gallardot <gallardot@apache.org> * chore: update doc img Signed-off-by: Gallardot <gallardot@apache.org> * chore: update doc Signed-off-by: Gallardot <gallardot@apache.org> * chore: add UT Signed-off-by: Gallardot <gallardot@apache.org> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> --------- Signed-off-by: Gallardot <gallardot@apache.org> Co-authored-by: David Zollo <dailidong66@gmail.com> Co-authored-by: 旺阳 <qingwli@cisco.com> Co-authored-by: 旺阳 <wang@lqwang.net> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
fuchanghai	f90eadd40f	[feature-#14449] add secret in k8s Task (#14930 ) * [feature-#14449] add secret * [feature-#14449] upgrade UT and rename parameter ```secret``` * [feature-#14449] fix UT * [feature-#14449] fix UT * [feature-#14449] improvement * [feature-#14449] format --------- Co-authored-by: fuchanghai <‘2875334588@qq.com’>	1 year ago
Kerwin	6de1e2c1b3	Fix the error of using shell task to obtain Home variable in Ubuntu system. (#14964 )	1 year ago
Gallardot	f6a6794289	[Bug][Worker] Global and local parameters are not replaced in SQL components (#14926 ) Signed-off-by: Gallardot <gallardot@apache.org>	1 year ago
Wenjun Ruan	55cc77226f	[RPC] Refactor the remote module. (#14776 ) * Add dolphinscheduler-extract-base * Add dolphinscheduler-extract-master * Add dolphinscheduler-extract-worker * Add dolphinscheduler-extract-alert	1 year ago
Aaron Wang	a491e3a849	fix: null app-info-path cause NPE (#14752 )	1 year ago
caishunfeng	59998f4c75	[Improvement] add dispatch fail times when compare (#14761 ) Co-authored-by: Rick Cheng <rickchengx@gmail.com>	1 year ago
KingsleyY	b3af374fe6	[Fix-14646][Worker] Fix match wrong pid on linux server (#14652 ) * [DS-14646][Worker] Fix match wrong pid on linux server This closes #14646 --------- Co-authored-by: yangxin3 <yangxin3@newhope.cn>	1 year ago
Edison Catto	25480ae9e7	[Feature][Resource Center] Add support for Huawei Cloud OBS (#14643 ) * [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center * add license and add doc * add 3-party dependency license * Update LICENSE * fix * Update pom.xml * fix * fix --------- Co-authored-by: sunkang <sunkang@hjfruit.com> Co-authored-by: xiangzihao <460888207@qq.com> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	1 year ago
Aaron Wang	cb55476235	[Fix-14721] [K8S Task] Handle job delete event when user manually delete the job in k8s cluster (#14722 ) Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	1 year ago
Aaron Wang	5ec9085113	fix: do not override k8sConfigYaml in ShShellInterceptorBuilder (#14682 ) Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Wenjun Ruan	9ce8871158	Support get property from env/jvm/common.properties (#14645 )	1 year ago

1 2 3 4 5

221 Commits (225e969d2dd47f46d53d29cd4246752f2b175a33)