DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
bao liang	3dc5845389	[FIX-3966] The timeout warning does not take effect in sub_process (#3982 ) * fix #3966 sub process doesnot send alert mail after process instance ending. * fix bug 3964: sub_process The timeout warning does not take effect add timeout warning for sub_process/dependent task. * fix code smell * fix code smell * fix code smell * update worker group inherit from parent Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
lgcareer	075d1638d0	[Fix-#3618][server] resolve task executed finished but not release the file handle (#3975 ) * [Fix-#3618][server] resolve task executed finished but not release the file handle * [Fix-#3618][server] resolve task executed finished but not release the file handle	4 years ago
bao liang	7a088b7325	fix #3966 sub process doesnot send alert mail after process instance ending. (#3972 ) Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
baoliang	ba971912bf	fix bug:3615 After the task is executed successfully, but the next task has not been submitted, stop the master	4 years ago
zhuangchong	2fbbf96cde	[Improvement-3686][service] ProcessService method name meets naming convention. (#3687 ) * ProcessService method name meets naming convention. * add code checkstyle. * update test. * update test. * add code checkstyle. * add code checkstyle. * update pom. * update pom. * ProcessService method name meets naming convention. * update processService code. * update code style. * update code style. * update code style. Co-authored-by: zhuangchong <zhuangchong8@163.com>	4 years ago
bao liang	f29f4e8384	[FIX-3617][Service]after subtask fault tolerance, 2 task instances are generated (#3830 ) * fix bug(#3617): after subtask fault tolerance, 2 task instances are generated. * delete unused code * update code smell * refactor sub work command process * add process service ut * add license header * fix some code smell * chang ut java8 to java11 * update sonar to java11 * copy ut config from dev * remove checkstyle * revert to 1.3.3 * change proess service test to executor service * add process service test * add process service test * revert * revert * add comments * change dev to 1.3.3-release * revert Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
bao liang	39411ce03b	[FIX-3617][Service]fix 2 tasks instance are generated when fault tolerance (#3873 ) * fix 2 tasks instance are generated when fault tolerance * update code style * update code style * update code style * update code style * update code style * update code style * update code style * update code style * update code style * update code style * update code style * update ut * update code style Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
CalvinKirs	11d3c2cdaf	[Improvement][server]lower weight round robin support weight (#3768 ) * [Improvement][server]lower weight round robin support weight * delete code * resolve conflicts	4 years ago
guyinyou	3b581455fc	[Feature]Add Python task "task variable / result transfer" implementation (#3659 ) * 增加Python Task的“任务变量/结果传递”实现 Signed-off-by: 古崟佑 * add two files license Signed-off-by: 古崟佑 * fix 'server/worker/task/AbstractCommandExecutor.java' code style Signed-off-by: 1941815847Cy4 <1941815847cy4@kuaishou.com> * update DB Signed-off-by: 古崟佑 * update DB -- 2 Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codestyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * add VarPoolUtils Test Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * add test config for VarPoolUtilsTest Signed-off-by: 古崟佑 * fix unit test Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest.java Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * change the test class path Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * fix "print the error message" Signed-off-by: 古崟佑 * fix bug Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 Co-authored-by: 1941815847Cy4 <1941815847cy4@kuaishou.com>	4 years ago
CalvinKirs	db663a13a3	[Improvement][remote]load balance warm up (#3770 ) * [Improvement][remote]load balance warm up * reformat code * reformat code * code smell * code smell * add test * add test * add test * add test * fix bug * fix bug * add docs * add host test * add host test * add host test * add docs * code reformat * code reformat	4 years ago
qiaozhanwei	4087485416	[Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect (#3786 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * The batch delete function in the workflow definition and workflow instance pages cannot be canceled if selected. * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn> Co-authored-by: zhuangchong <zhuangchong8@163.com> Co-authored-by: JinyLeeChina <42576980+JinyLeeChina@users.noreply.github.com>	4 years ago
qiaozhanwei	5c8171e397	[Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect (#3784 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * The batch delete function in the workflow definition and workflow instance pages cannot be canceled if selected. * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect * [Fix-3549] [Server][sqlTask]The alias column in the query SQL does not take effect Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn> Co-authored-by: zhuangchong <zhuangchong8@163.com> Co-authored-by: JinyLeeChina <42576980+JinyLeeChina@users.noreply.github.com>	4 years ago
qiaozhanwei	d74f6e71e4	[Fix-3616][Server] when worker akc/response master exception , async retry (#3776 ) * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry * [Fix-3616][Server] when worker akc/response master exception , async retry Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
zhuangchong	36d5349610	[fix-3745][server] server get tasktype NPE exception (#3746 )	4 years ago
qiaozhanwei	29f1123d1d	[Fix-3616][Server] when worker akc/response master exception , async retry (#3748 )	4 years ago
zhuangchong	fad2852768	[Improvement][server] WATERDROP task plug-in optimization in switch case code cleaning. (#3652 ) * WATERDROP switch case code checkstyle. * add TaskManagerTest. * TaskManagerTest checkstyle. * TaskManagerTest checkstyle. * TaskManagerTest add pom maven-surefire * TaskManagerTest update.	4 years ago
felix.wang	4ed3638750	[Bug][server] fix 3629 pull request (#3706 ) * fix 3629 pr * fix e2e build	4 years ago
Hsu Pu	68bc58892b	[Improvement][server] Refactor code for getTaskLogPath to reduce NPE log during UT (#3629 ) * init * update * update * update * fix * fix * enable test * fix * fix	4 years ago
Hsu Pu	feec629554	[Improvement][server] unit test for SubProcessTask with PowerMockRunner (#3632 )	4 years ago
赤月	69201ac346	[Improvement][ALL] Remove some un-used code and code review #3639 (#3640 ) * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review	4 years ago
CalvinKirs	632d52cd69	[refactor][server-test] refactor RoundRobinHostManagerTest (#3511 ) * [refactor][server-test] refactor RoundRobinHostManagerTest * add RoundRobinHostManagerTest * format code * format code	4 years ago
zhuangchong	efee53bec9	[Improvement][server] server model ProcessUtils.java code cleaning. (#3382 ) * server model ProcessUtils.java code cleaning. * add checkstyle,server model ProcessUtils.java code cleaning. * ProcessUtils.java checkstyle. * update. * update. Co-authored-by: unknown <zhuangchong-phq@sinosig.com>	4 years ago
felix.wang	2ba529a96c	[Improvement][alert] Optimize alarm information (#3559 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style * Optimize alarm information * fix code style * add license * fix code smell * Update dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java Co-authored-by: Yichao Yang <1048262223@qq.com> * fix code smell * fix code smell * 修改ut 和replace问题。 * 修改ut Co-authored-by: wangjianda <Felix@thinkingdata.com> Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
Yichao Yang	8fea8f913c	[Test][server] Add the master server test case (#3574 )	4 years ago
felix.wang	2f01025802	[Fix-3299][dao&server] Fix 3299,when Json string parsing problem caused by non-standard json format. (#3552 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style Co-authored-by: wangjianda <Felix@thinkingdata.com>	4 years ago
JinyLeeChina	d30bc7bcf3	'3549' (#3550 )	4 years ago
CalvinKirs	a1ce54b8e6	[Improvement][server] Fix some sonar analyzed bugs (#3415 ) * [FIX_BUG][]fix sonar bugs fix assert error(assertions always pass) fix assert error(assertions always pass) insert data should judging the success status * fix assert error(assertions always pass) * use AtomicReference<Object> to replace unsafe volatile Object * use AtomicReference<Object> to replace unsafe volatile Object * lazy initialization holder class Singleton... * reformat code judge database operations * reformat code judge database operations * revert * use ThreadLocalRandom to build random numbers * reform code * fix dao test error * judge database operations	4 years ago
vanilla111	a4ee351a3a	delay execution of tasks and improve some designs (#3427 )	4 years ago
Hsu Pu	59610a5661	[Improvement][dao,server] unit test for ConditionsTask (#3385 )	4 years ago
XiaotaoYi	0b7b6d4e2a	[bug-3480][server]fix ds muti-level directory in zk, which lead to fa… (#3532 ) * [bug-3480][server]fix ds muti-level directory in zk, which lead to fail to assign work * miss whitespace for if statement	4 years ago
XiaotaoYi	5fdc43cdca	fix ds muti-level directory in zk, which lead to fail to assign work	4 years ago
bao liang	5756d6b029	fix bug: Fix master task dependency check bug (#3473 ) Co-authored-by: lenboo <baoliang@analysys.com.cn>	4 years ago
zixi0825	a7a1156ff1	fix zk path error (#3470 )	4 years ago
CalvinKirs	d6a32ac652	[Feature#3234][cluster]enhanced load balancing (#3235 ) * [Future#3234][cluster]enhanced load balancing weight-based load balancing algorithm this close # 3234 * remove useless parameter * code smell * load balancing according to work group * add smooth weight round robin * remove unused constants * perfect unit test * code smell * code smell * add work weight config * fix config error * add weight docs to readme.md	4 years ago
Yichao Yang	f419fe6239	[Test][server] Add LoggerServerTest (#3405 )	4 years ago
zixi0825	40a21816ab	[Fix] [Server] Fix the spell error and add log in SqlTask (#3243 ) * fix the spell and modify logger print format	4 years ago
lenboo	f936b07fdf	fix bug: Fix master task dependency check bug	4 years ago
lgcareer	a3793be7da	[Fix-3390][server]Running hive sql task need find the hdfs path correctly (#3396 ) * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * update soft version	4 years ago
CalvinKirs	6ecc95a338	[FIX_BUG][] fix some bugs from sonar analysis (#3322 ) [FIX_BUG][] fix some bugs from sonar analysis remove invalid single test * code smell * remove exception catches that never happen * delete invalid exception catch * remove excess locks * fix e2e test error * recovery related exception removal	4 years ago
lgcareer	3744167d52	[Fix-3364]Running the spark task fail because the can't find the jar (#3378 )	4 years ago
lenboo	cdd76d6b11	refactor depend result	4 years ago
lenboo	0e885cd0ee	remove unused import	4 years ago
lenboo	ed78aea2f8	fix bug: there exists some problems in checking task dependency	4 years ago
dailidong	6d903e266f	[Feature][server] add embeded zookeeper server in dolphinscheduler-daemon.sh (#3293 ) * update README about DolphinScheduler * Update issue templates * update * regularize api pom xml update rpc maven compile to 1.8 * regularize api pom xml * change commons.lang3.StringUtils to common.utils.StringUtils * update pom.xml * update * correct equals method * jasper-runtime is needed when api server start * jasper-runtime jar is needed when api server start * combine logback config of master/worker/alert/api server to one logback.xml * remove tomcat runtime jar * add UT * add license * remove jasper-runtime jar, not need anymore * sovle jar conflict， remove servlet-api 2.5 jar * remove servlet 2.5 * add embedded database h2 and update embedded zookeeper * delete logs * add license * change log level to INFO * simplify and optimize config * add development state * simplify common config * add worker group config * add worker group config * add worker group config * this command just for getting a quick experience，not recommended for production. this operation will start a standalone zookeeper server * Merge remote-tracking branch 'upstream/dev' into dev * add logback for zookeeper * Update logback-zookeeper.xml Co-authored-by: lidongdai <escheduler@outlook.com> Co-authored-by: dailidong <dolphinschedule@gmail.com> Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>	4 years ago
xsbai	87eb7c8211	adds waterdrop plugin (#3073 ) * add plugin waterdrop * add plugin waterdrop * add plugin waterdrop * fix deploy mode error * Update en_US.js fix conflict * Update en_US.js fix conflict * Update en_US.js Add missing commas * Update zh_CN.js Add missing commas * Update waterdrop.vue Fix the no resource hint * Update zh_CN.js Add 'Please select the waterdrop resources' * Update en_US.js Add 'Please select the waterdrop resources' * Update waterdrop.vue fix bug when click the waterdrop node again, it still show the `client` mode in deploy mode Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
zixi0825	5fe31546ba	[Fix][all] fix spell error (#3289 ) * fix spell error * test unit test Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	4 years ago
chendapao	afd9139c3f	[Feature]use zk own del func (#3310 ) * use zk own del func * Update remove-zk-node.sh Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
CalvinKirs	3a0d4da27e	[Test][server] Fix Test ContextConfiguration error. (#3304 ) * [FIX_BUG]fix test error * small change * add test * reformat * fix test no qualifying bean	4 years ago
zixi0825	78856fb08e	remove the duplicate function in MasterExecThread (#3329 ) Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	4 years ago
xingchun-chen	57eee5695a	Merge pull request #3331 from lenboo/dev-complement [FIX-1336] [master] serial complement data can have multiple process instances	4 years ago

1 2 3 4 5 ...

500 Commits (aa0974fd1f759e96430d3f1b8dac291d6ea7388c)