DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
guyinyou	3b581455fc	[Feature]Add Python task "task variable / result transfer" implementation (#3659 ) * 增加Python Task的“任务变量/结果传递”实现 Signed-off-by: 古崟佑 * add two files license Signed-off-by: 古崟佑 * fix 'server/worker/task/AbstractCommandExecutor.java' code style Signed-off-by: 1941815847Cy4 <1941815847cy4@kuaishou.com> * update DB Signed-off-by: 古崟佑 * update DB -- 2 Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codestyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * add VarPoolUtils Test Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * add test config for VarPoolUtilsTest Signed-off-by: 古崟佑 * fix unit test Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest.java Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * change the test class path Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * fix "print the error message" Signed-off-by: 古崟佑 * fix bug Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 Co-authored-by: 1941815847Cy4 <1941815847cy4@kuaishou.com>	4 years ago
CalvinKirs	db663a13a3	[Improvement][remote]load balance warm up (#3770 ) * [Improvement][remote]load balance warm up * reformat code * reformat code * code smell * code smell * add test * add test * add test * add test * fix bug * fix bug * add docs * add host test * add host test * add host test * add docs * code reformat * code reformat	4 years ago
qiaozhanwei	4087485416	[Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect (#3786 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * The batch delete function in the workflow definition and workflow instance pages cannot be canceled if selected. * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn> Co-authored-by: zhuangchong <zhuangchong8@163.com> Co-authored-by: JinyLeeChina <42576980+JinyLeeChina@users.noreply.github.com>	4 years ago
qiaozhanwei	5c8171e397	[Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect (#3784 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * The batch delete function in the workflow definition and workflow instance pages cannot be canceled if selected. * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn> Co-authored-by: zhuangchong <zhuangchong8@163.com> Co-authored-by: JinyLeeChina <42576980+JinyLeeChina@users.noreply.github.com>	4 years ago
qiaozhanwei	d74f6e71e4	[Fix-3616][Server] when worker akc/response master exception , async retry (#3776 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
zhuangchong	36d5349610	[fix-3745][server] server get tasktype NPE exception (#3746 )	4 years ago
qiaozhanwei	29f1123d1d	[Fix-3616][Server] when worker akc/response master exception , async retry (#3748 )	4 years ago
zhuangchong	fad2852768	[Improvement][server] WATERDROP task plug-in optimization in switch case code cleaning. (#3652 ) * WATERDROP switch case code checkstyle. * add TaskManagerTest. * TaskManagerTest checkstyle. * TaskManagerTest checkstyle. * TaskManagerTest add pom maven-surefire * TaskManagerTest update.	4 years ago
felix.wang	4ed3638750	[Bug][server] fix 3629 pull request (#3706 ) * fix 3629 pr * fix e2e build	4 years ago
Hsu Pu	68bc58892b	[Improvement][server] Refactor code for getTaskLogPath to reduce NPE log during UT (#3629 ) * init * update * update * update * fix * fix * enable test * fix * fix	4 years ago
Hsu Pu	feec629554	[Improvement][server] unit test for SubProcessTask with PowerMockRunner (#3632 )	4 years ago
赤月	69201ac346	[Improvement][ALL] Remove some un-used code and code review #3639 (#3640 ) * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review	4 years ago
CalvinKirs	632d52cd69	[refactor][server-test] refactor RoundRobinHostManagerTest (#3511 ) * [refactor][server-test] refactor RoundRobinHostManagerTest * add RoundRobinHostManagerTest * format code * format code	4 years ago
zhuangchong	efee53bec9	[Improvement][server] server model ProcessUtils.java code cleaning. (#3382 ) * server model ProcessUtils.java code cleaning. * add checkstyle,server model ProcessUtils.java code cleaning. * ProcessUtils.java checkstyle. * update. * update. Co-authored-by: unknown <zhuangchong-phq@sinosig.com>	4 years ago
felix.wang	2ba529a96c	[Improvement][alert] Optimize alarm information (#3559 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style * Optimize alarm information * fix code style * add license * fix code smell * Update dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java Co-authored-by: Yichao Yang <1048262223@qq.com> * fix code smell * fix code smell * 修改ut 和replace问题。 * 修改ut Co-authored-by: wangjianda <Felix@thinkingdata.com> Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
Yichao Yang	8fea8f913c	[Test][server] Add the master server test case (#3574 )	4 years ago
felix.wang	2f01025802	[Fix-3299][dao&server] Fix 3299,when Json string parsing problem caused by non-standard json format. (#3552 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style Co-authored-by: wangjianda <Felix@thinkingdata.com>	4 years ago
JinyLeeChina	d30bc7bcf3	'3549' (#3550 )	4 years ago
CalvinKirs	a1ce54b8e6	[Improvement][server] Fix some sonar analyzed bugs (#3415 ) * [FIX_BUG][]fix sonar bugs fix assert error(assertions always pass) fix assert error(assertions always pass) insert data should judging the success status * fix assert error(assertions always pass) * use AtomicReference<Object> to replace unsafe volatile Object * use AtomicReference<Object> to replace unsafe volatile Object * lazy initialization holder class Singleton... * reformat code judge database operations * reformat code judge database operations * revert * use ThreadLocalRandom to build random numbers * reform code * fix dao test error * judge database operations	4 years ago
vanilla111	a4ee351a3a	delay execution of tasks and improve some designs (#3427 )	4 years ago
Hsu Pu	59610a5661	[Improvement][dao,server] unit test for ConditionsTask (#3385 )	4 years ago
XiaotaoYi	0b7b6d4e2a	[bug-3480][server]fix ds muti-level directory in zk, which lead to fa… (#3532 ) * [bug-3480][server]fix ds muti-level directory in zk, which lead to fail to assign work * miss whitespace for if statement	4 years ago
qiaozhanwei	917a4b20b5	release 1.3.2 version rollback (#3527 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback * modify tag 1.3.0 to HEAD Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	32edd19ac5	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	4d2f0b0578	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	11d3c07e46	modify tag 1.3.0 to HEAD (#3525 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback * modify tag 1.3.0 to HEAD Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
XiaotaoYi	5fdc43cdca	fix ds muti-level directory in zk, which lead to fail to assign work	4 years ago
qiaozhanwei	f3f895751b	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	f19b125374	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	4ba6b35b0f	test release 1.3.2 version rollback (#3504 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	f50353f8a6	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	afd227a179	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	660eb5a1e6	test release 1.3.2 version rollback (#3503 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	b5f0f23d85	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	88b3ef5d30	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	45424ec265	test release 1.3.2 version rollback (#3499 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	b4b8c801ed	test release 1.3.2 version rollback	4 years ago
qiaozhanwei	c6f0c8901c	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	8a6732ae4c	[maven-release-plugin] prepare release 1.3.2	4 years ago
bao liang	5756d6b029	fix bug: Fix master task dependency check bug (#3473 ) Co-authored-by: lenboo <baoliang@analysys.com.cn>	4 years ago
zixi0825	a7a1156ff1	fix zk path error (#3470 )	4 years ago
CalvinKirs	d6a32ac652	[Feature#3234][cluster]enhanced load balancing (#3235 ) * [Future#3234][cluster]enhanced load balancing weight-based load balancing algorithm this close # 3234 * remove useless parameter * code smell * load balancing according to work group * add smooth weight round robin * remove unused constants * perfect unit test * code smell * code smell * add work weight config * fix config error * add weight docs to readme.md	4 years ago
Yichao Yang	f419fe6239	[Test][server] Add LoggerServerTest (#3405 )	4 years ago
zixi0825	40a21816ab	[Fix] [Server] Fix the spell error and add log in SqlTask (#3243 ) * fix the spell and modify logger print format	4 years ago
lenboo	f936b07fdf	fix bug: Fix master task dependency check bug	4 years ago
lgcareer	a3793be7da	[Fix-3390][server]Running hive sql task need find the hdfs path correctly (#3396 ) * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * update soft version	4 years ago
CalvinKirs	6ecc95a338	[FIX_BUG][] fix some bugs from sonar analysis (#3322 ) [FIX_BUG][] fix some bugs from sonar analysis remove invalid single test * code smell * remove exception catches that never happen * delete invalid exception catch * remove excess locks * fix e2e test error * recovery related exception removal	4 years ago
lgcareer	3744167d52	[Fix-3364]Running the spark task fail because the can't find the jar (#3378 )	4 years ago
lenboo	cdd76d6b11	refactor depend result	4 years ago
lenboo	0e885cd0ee	remove unused import	4 years ago

1 2 3 4 5 ...

520 Commits (6672ac8f1f1fc4c8c508808cb4774abdbece4514)