DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
chenrj	c532fea00e	[Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977 )	1 year ago
chenrj	5a3827eef4	[DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976 ) * Refactoring `Sagemaker` task plugin with connections managed in connection center. --------- Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	1 year ago
chenrj	e99c5950b9	[DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434 ) * Refactoring zeppelin task plugin with connections managed in connection center --------- Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	1 year ago
Wenjun Ruan	99214d0fc3	Fix SqlTask cannot split the given sql when browser in windows (#15062 )	1 year ago
Orange Summer	688f84452d	[Feature-14678][Master][UI]Dependent task parameter passing (#14702 ) * feat: dependent task parameter passing * style: code format * refactor: remove inappropriate log * refactor: Modify unreasonable code structure * refactor: Modify unreasonable code structure * refactor: Solve conflicts caused by merge --------- Co-authored-by: Rick Cheng <rickchengx@gmail.com> Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>	1 year ago
Gallardot	049c1511fa	[Improvement][K8S] K8S task support passing context parameters to downstream task (#14934 ) * [Improvement][K8S] K8S task support passing context parameters to downstream task Signed-off-by: Gallardot <gallardot@apache.org> * [Improvement][K8S] K8S task support passing context parameters to downstream task Signed-off-by: Gallardot <gallardot@apache.org> * chore: update doc img Signed-off-by: Gallardot <gallardot@apache.org> * chore: update doc Signed-off-by: Gallardot <gallardot@apache.org> * chore: add UT Signed-off-by: Gallardot <gallardot@apache.org> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> * merge suggestion Co-authored-by: 旺阳 <wang@lqwang.net> --------- Signed-off-by: Gallardot <gallardot@apache.org> Co-authored-by: David Zollo <dailidong66@gmail.com> Co-authored-by: 旺阳 <qingwli@cisco.com> Co-authored-by: 旺阳 <wang@lqwang.net> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
fuchanghai	f90eadd40f	[feature-#14449] add secret in k8s Task (#14930 ) * [feature-#14449] add secret * [feature-#14449] upgrade UT and rename parameter ```secret``` * [feature-#14449] fix UT * [feature-#14449] fix UT * [feature-#14449] improvement * [feature-#14449] format --------- Co-authored-by: fuchanghai <‘2875334588@qq.com’>	1 year ago
Kerwin	6de1e2c1b3	Fix the error of using shell task to obtain Home variable in Ubuntu system. (#14964 )	1 year ago
LiuCanWu	e748c2eb9a	fix the #14729 problem (#14902 ) Co-authored-by: 刘阳 <liuy2590@chinaunicom.cn> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Yhr-N	9083f9d0e0	[Fix-14546] seatunnel unable submit spark job to spark (#14617 )	1 year ago
Gallardot	f6a6794289	[Bug][Worker] Global and local parameters are not replaced in SQL components (#14926 ) Signed-off-by: Gallardot <gallardot@apache.org>	1 year ago
Jay Chung	3fa69d2db8	[Bug][Worker] Fix sql/shell task doesn't replace parameter (#14876 ) Fix parameter assign error, fix #14869 which including * shell task param not work, botch local and global * others task chain assign not work	1 year ago
zhangbaipeng	7640c29495	[Improvement] [Task] Change Seatunnel task run-mode to deploy-mode (#14800 )	1 year ago
Wenjun Ruan	55cc77226f	[RPC] Refactor the remote module. (#14776 ) * Add dolphinscheduler-extract-base * Add dolphinscheduler-extract-master * Add dolphinscheduler-extract-worker * Add dolphinscheduler-extract-alert	1 year ago
Aaron Wang	a491e3a849	fix: null app-info-path cause NPE (#14752 )	1 year ago
caishunfeng	59998f4c75	[Improvement] add dispatch fail times when compare (#14761 ) Co-authored-by: Rick Cheng <rickchengx@gmail.com>	1 year ago
KingsleyY	b3af374fe6	[Fix-14646][Worker] Fix match wrong pid on linux server (#14652 ) * [DS-14646][Worker] Fix match wrong pid on linux server This closes #14646 --------- Co-authored-by: yangxin3 <yangxin3@newhope.cn>	1 year ago
Edison Catto	25480ae9e7	[Feature][Resource Center] Add support for Huawei Cloud OBS (#14643 ) * [Feature][Resource Center] Add support for Huawei Cloud OBS as storage of resource center * add license and add doc * add 3-party dependency license * Update LICENSE * fix * Update pom.xml * fix * fix --------- Co-authored-by: sunkang <sunkang@hjfruit.com> Co-authored-by: xiangzihao <460888207@qq.com> Co-authored-by: Rick Cheng <rickchengx@gmail.com>	1 year ago
Aaron Wang	cb55476235	[Fix-14721] [K8S Task] Handle job delete event when user manually delete the job in k8s cluster (#14722 ) Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	1 year ago
Aaron Wang	5ec9085113	fix: do not override k8sConfigYaml in ShShellInterceptorBuilder (#14682 ) Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Wenjun Ruan	9ce8871158	Support get property from env/jvm/common.properties (#14645 )	1 year ago
KingsleyY	512f4c7021	[Fix-10795][plugin] sqoop task query columns bug (#10776 ) * [Improvement][Api] add @Override on the Override method * [FIX]sqoop task query columns bug * merge two if * update checkstyle problem * Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/SqoopColumnType.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * Update dolphinscheduler-task-plugin/dolphinscheduler-task-sqoop/src/main/java/org/apache/dolphinscheduler/plugin/task/sqoop/generator/sources/MySQLSourceGenerator.java Co-authored-by: Wenjun Ruan <wenjun@apache.org> * code format * code format --------- Co-authored-by: Wenjun Ruan <wenjun@apache.org> Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Wenjun Ruan	4aab0b234f	Use AdHoc datasource client in sqlTask (#14631 ) * Use AdHoc datasource client in sqlTask * Add method in DataSourceChannel to create PooledDataSourceClient and AdHocDataSourceClient	1 year ago
Eric Gao	d6a4e99e19	fix process utils comment typo (#14613 )	1 year ago
Aaron Wang	04800a48d1	[Feature-13763][K8S Task] collect real-time log (#14379 ) * [Improvement-13763][K8S Task] collect real-time log * fix codesmell * get pod watcher until pod is ready * fix codesmell * specify container name & loop waiting pod creation * sleep when pod is not initialized --------- Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	1 year ago
Kerwin	9664bef933	Fix wrong judgment condition when building parameters of seatunnel task node. (#14594 )	1 year ago
Jay Chung	de2d215aee	impv: Correct datax execute and python execute script name (#14523 ) * impv: Correct datax execute and python execute script name we use PYTHON_LAUNCHER for python script execute and DATAX_LAUNCHER for datax script name * Add pr number * fix ut * style --------- Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
Wenjun Ruan	c30cca9d9a	Support execute shell in different interceptor (#14582 )	1 year ago
Rick Cheng	9778652f17	[Improvement-14136][task] Support submitting spark-sql task with the sql file in resource center (#14527 ) Co-authored-by: xiangzihao <460888207@qq.com>	1 year ago
FlechazoW	027d66d200	[Typo] standardized license header. (#14548 ) Co-authored-by: wentz <wentz@getui.com> Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	1 year ago
Wenjun Ruan	e6d94632b9	Add WorkflowExecuteContext (#14544 )	1 year ago
Rick Cheng	09afa75a3d	[Improvement][Worker] No need to kill remote app when appid is empty (#14534 )	1 year ago
Rick Cheng	c1cffba349	[Improvement] Remove the unused newDaemonSingleThreadExecutor (#14520 )	1 year ago
zyfjrx	4111acb58e	[Bug] [Seatunnel-Task] Run Mode defaults to run, and you cannot select a null value (#14267 ) Co-authored-by: zhang <zhangyfcoder@163.com>	1 year ago
旺阳	175d976cd2	[Feature][Data Quality] Data Quality Support Choose Database (#14406 ) * add dataquality database api * change ui * api change * update * fix spotless * fix h2 * fix pg * fix-dead-line * update * fix-spotless * update pg sql * add ut * fix ut	1 year ago
jegger	75d29f6101	[improvement] DataQuality module improve (#14463 )	1 year ago
Aaron Wang	0b69236b04	[Feature-14251][Task] Support yarn queue definition in yarn task (#14310 )	1 year ago
fuchanghai	742a2dc780	[Fix-14447][K8S Task] Fix IndexOutofBoundsException for pod name without dash (#14448 )	1 year ago
Rick Cheng	cff53feaeb	[Improvement-14464][Task] Remove the useless taskResultString (#14465 )	1 year ago
Rick Cheng	68a3a75211	[Improvement-14457][UT] Improve the expected and actual value of Assertions (#14459 )	1 year ago
Aaron Wang	65b6a4b097	[Feature-14421][K8S Task] Configurable image pull policy (#14426 )	1 year ago
Rick Cheng	13dfa859b5	[Improvement-14371][Hivecli] Add support for hivevar setting in hivecli task (#14423 )	1 year ago
Jeremy	9c92b4b240	fix: default datax plugin (#14204 )	1 year ago
Rick Cheng	b49b91c45d	[Improvement-14331][common] Remove the duplicate ParameterUtils (#14332 )	1 year ago
Wenjun Ruan	a55612e4f7	Fix switch task use boolean type error (#14326 )	1 year ago
Rick Cheng	1cd5070b5d	[Improvement-14329][common] Remove the duplicate BusinessTimeUtils (#14330 )	1 year ago
Rick Cheng	4fa0ab4d7e	[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082 )	1 year ago
ORuteMa	de2cc0e235	[bug][plugin]Fix: Correct the way to determine the yarn queue in Flink CommandLine and SQL mode (#14237 ) * Fix: Correct the way to determine the yarn queue in Flink CommandLine * fix the yarn queue in sql mode && refine the code * refine code * remove unnecessary comment * fix yarn queue properties * remove redundant variable	1 year ago
Aaron Wang	b7fb393eed	fix: trim node selector requirement value (#14307 )	1 year ago
Rick Cheng	66e09dc66e	[Improvement-14295][common] Remove the duplicate FileUtils (#14301 )	1 year ago

1 2 3 4 5 ...

334 Commits (c532fea00ef876a920551067eb2f5c72e2b72d61)