DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Jeremy	9c92b4b240	fix: default datax plugin (#14204 )	2 years ago
Rick Cheng	b49b91c45d	[Improvement-14331][common] Remove the duplicate ParameterUtils (#14332 )	2 years ago
Wenjun Ruan	a55612e4f7	Fix switch task use boolean type error (#14326 )	2 years ago
Rick Cheng	1cd5070b5d	[Improvement-14329][common] Remove the duplicate BusinessTimeUtils (#14330 )	2 years ago
Rick Cheng	4fa0ab4d7e	[feature][Resource] Add support for Azure Blob Storage in the resource center (#14082 )	2 years ago
ORuteMa	de2cc0e235	[bug][plugin]Fix: Correct the way to determine the yarn queue in Flink CommandLine and SQL mode (#14237 ) * Fix: Correct the way to determine the yarn queue in Flink CommandLine * fix the yarn queue in sql mode && refine the code * refine code * remove unnecessary comment * fix yarn queue properties * remove redundant variable	2 years ago
Aaron Wang	b7fb393eed	fix: trim node selector requirement value (#14307 )	2 years ago
Rick Cheng	66e09dc66e	[Improvement-14295][common] Remove the duplicate FileUtils (#14301 )	2 years ago
JieguangZhou	e7cdc7c136	[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127 ) * add dynamic task plugin * fix ui * update code * add DOC * ADD UT * fix doc * fix sanity check * add upgrade ddl * fix sql	2 years ago
Rick Cheng	2c057d6a8f	[Improvement-14292][Common] Remove the duplicate OSUtils (#14293 )	2 years ago
Rick Cheng	4d798e774e	[Improvement-14280][Task] update the task execution status check (#14281 )	2 years ago
HQFGit	d587b5f03d	[Bug][Master][Fixes 14216]workflow state keep READY_STOP when sub_process state … (#14221 ) * [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP Fixes #14216 * [Bug] [Master] workflow state keep READY_STOP when sub_process state STOP Fixes mvn spotless:apply#14216 * Update testFile.txt.crc * Update testFile.txt.crc * Delete testFile.txt.crc	2 years ago
Aaron Wang	9e0991145e	[Improvement-14146][K8S Task] print complete error logs in task log file (#14147 )	2 years ago
Rick Cheng	1011852ab2	[Improvement-14195][Parameter] remove misleading comment of combining local and global parameter (#14196 )	2 years ago
Aaron Wang	4e78248238	[Feature][K8S Task] support node selector (#14126 ) * feat: support K8S node selector * fix CI	2 years ago
haibingtown	af7da0630e	[Feature] Add project name/workflow definition name/instance id/task name to the built-in variables (#14099 ) * [Feature] Add project name/workflow definition name/instance id/task name to the built-in variables	2 years ago
Alex Ting	606b56403e	[Fix-13381][plugin] fix error while parsing hive load sql (#13378 ) * [fix][task plugin][task sql] fix parsing error while using variables sometimes parsing exception happened if task sql contains a variable followed by \" or \' . for example: input sql: load inpath '/tmp/test_table/dt=${dt}' into table test_table partition(dt=${dt}) after replace: preparing : load inpath '/tmp/test_table/dt=? into table test_table partition(dt=?)	2 years ago
Kerwin	8315279620	[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150 ) * Added a dependent task failure policy in the dependent task node	2 years ago
Jay Chung	56b0f91f6e	fix: Save task seatunnel error (#14129 )	2 years ago
fuchanghai	67f50e3904	[fix-#13940] add status of ``` stop``` in class of TaskExecutionStatus (#14016 )	2 years ago
Aaron Wang	c3809fbecf	[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067 ) * [Improvement-13868] Support the custom labels for k8s task * fix front-end type mismatched	2 years ago
JieguangZhou	a3b2cc0275	[CI] Try fix api test error (#14094 ) * try fix api test error * add workergroupapitest to ci and fix log output * fix log output * skip remote shell UT --------- Co-authored-by: SbloodyS <460888207@qq.com>	2 years ago
Rick Cheng	3eb4c0ed1d	[Improvement-14054][Worker] Kill multiple yarn apps at the same time (#14055 ) * [Improvement-14054][Worker] Kill multiple yarn apps at the same time * Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/YarnApplicationManager.java Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	2 years ago
Rick Cheng	84edea7593	[Improvement-14052][Log] Remove the useless filter in getAppIdsFromLogFile (#14053 )	2 years ago
Aaron Wang	3bad68a942	[Bug-13929][K8S Task] Set command contains single quote is invalid (#13930 ) * [Fix-13929][K8S Task] Set command contains single quote is invalid * fix UT	2 years ago
Wenjun Ruan	cf91544b99	Refactor logic task (#13948 )	2 years ago
Jeremy	db6c061c8b	[Feature][plugin] Add databend datasource in datasource plugin (#13866 ) Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	2 years ago
fuchanghai	ec29220977	[improve-#13966] mask datax log (#13969 ) Co-authored-by: fuchanghai <‘2875334588@qq.com’>	2 years ago
Zzih	34f5b009e1	[Fix 13941]Fix replace time variable (#13975 ) * fix replace time variable Co-authored-by: <ziheng.zhan@longbridge.sg>	2 years ago
Aaron Wang	45586f71d5	[BUG][Resource Center] Task can not select main JAR (#13536 )	2 years ago
zzm	35bb533a50	[Improvement][Task Plugin] Integrate zeppelin password authentication with DS zeppelin task plugin (#13861 ) --------- Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	2 years ago
Aaron Wang	119f08d2ba	[Bug-13882][Worker] Upgrade kubernetes-client version to 6.0.0 (#13891 )	2 years ago
Assert	4439c1ec90	[Feature-13052][Task Plugin] Support Apache Seatunnel Connector-V2 (#13086 )	2 years ago
huangxinan1990	d772f2492b	fix: when sudo enable is false, execute command will failed (#13860 )	2 years ago
Aaron Wang	d6fcf60534	[Improvement-13751][Worker] Support real-time pod log collection (#13752 ) * Support real-time pod log collection * datax task test have to mock ShellCommandExecutor with whole dependencies * replace \n with EMPTY_STRING * modify error log msg * Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractCommandExecutor.java Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * throw exception in pod log collection thread --------- Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Wenjun Ruan	a1861bc2df	Use DATAX_PYTHON to specify a datax python version (#13849 ) (cherry picked from commit 752452ecbd2f8094b819eae219f3eec0f6a6427b)	2 years ago
JieguangZhou	273a5e78eb	[FEATURE][Task Plugin]Add remote-shell task plugin (#13801 )	2 years ago
Wenjun Ruan	9df89cf0cf	Use bootstrap user as the default tenant (#13825 )	2 years ago
Rick Cheng	85605bbef9	[Improvement-13653][Remote Logging] Support api-server to get task log from remote target (#13654 )	2 years ago
Wenjun Ruan	d1b6e6f02c	Take over task instance in master failover (#13798 )	2 years ago
Aaron Wang	b98566e070	[Bug-13782] match ')' in setValue regular expression (#13787 )	2 years ago
Rick Cheng	2dceb6b8ca	[Feature-13428][Resource Center] Add support for Google Cloud Storage in the resource center (#13562 )	2 years ago
Wenjun Ruan	aef5524ee7	Clearer task runnable. (#13689 ) * Clean unused method in AbstractTask * Kill task by process.destroy * wait 5/s after destroy process	2 years ago
fuchanghai	6218f818c0	[improve-#13665] improve datax parser if sql contain * (#13680 ) * [improve-#13665] improve datax parser if sql contain * * Update dolphinscheduler-task-plugin/dolphinscheduler-task-datax/src/main/java/org/apache/dolphinscheduler/plugin/task/datax/DataxTask.java Co-authored-by: fuchanghai <‘2875334588@qq.com’> Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	2 years ago
Wenjun Ruan	c9066e8de9	Use MDC to filter task instance log (#13673 ) * Use MDC to collect task instance log * Use MDCAutoClosableContext to remove the MDC key	2 years ago
Aaron Wang	fd720880c7	[Improvement] Add missing placeholder (#13663 ) * Add missing placeholder * Update dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/am/KubernetesApplicationManager.java Co-authored-by: kezhenxu94 <kezhenxu94@apache.org> --------- Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	2 years ago
Wenjun Ruan	ca9df868f1	Fix task instance log order might be wrong due to async print (#13660 )	2 years ago
旺阳	43d79e45b4	Fix data quality pwd error (#13643 )	2 years ago
QuantumXiecao	7586710d49	[fix-13625] Modify systemd-run from MemoryMax to MemoryLimit for more generality (#13627 ) Co-authored-by: xiecao <haolong.zhl@alibaba-inc.com>	2 years ago
Wenjun Ruan	4351a25f2a	Add execute function to handle the workflow instance operation (#13610 )	2 years ago

1 2 3 4 5 ...

292 Commits (221df4a278d1287073a6df8f164f0c5aae2de64f)