DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
guyinyou	3b581455fc	[Feature]Add Python task "task variable / result transfer" implementation (#3659 ) * 增加Python Task的“任务变量/结果传递”实现 Signed-off-by: 古崟佑 * add two files license Signed-off-by: 古崟佑 * fix 'server/worker/task/AbstractCommandExecutor.java' code style Signed-off-by: 1941815847Cy4 <1941815847cy4@kuaishou.com> * update DB Signed-off-by: 古崟佑 * update DB -- 2 Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codestyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * add VarPoolUtils Test Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest codeStyle Signed-off-by: 古崟佑 * add test config for VarPoolUtilsTest Signed-off-by: 古崟佑 * fix unit test Signed-off-by: 古崟佑 * fix codeStyle Signed-off-by: 古崟佑 * fix VarPoolUtilsTest.java Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * change the test class path Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 * fix "print the error message" Signed-off-by: 古崟佑 * fix bug Signed-off-by: 古崟佑 * fix Signed-off-by: 古崟佑 Co-authored-by: 1941815847Cy4 <1941815847cy4@kuaishou.com>	4 years ago
lgcareer	2e4f9f19ce	[Fix-#3713][common]Fix that catfile method Stream not closed (#3810 ) * [Bug-3713][HadoopUtils] catfile method Stream not closed (#3715) * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * dag add close button * reset last version * reset last version * dag add close buttion dag add close buttion * update CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * Update CreateWorkflowLocator.java modify submit workflow button * Update CreateWorkflowLocator.java * Update CreateWorkflowLocator.java modify CLICK_ADD_BUTTON * Update CreateWorkflowLocator.java delete print * Update CreateWorkflowLocator.java 1 * Update CreateWorkflowLocator.java 1 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dag.vue * Update dag.vue * Update dag.vue * Update CreateWorkflowLocator.java * Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks" This reverts commit `3a2cba7a` * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dolphinscheduler-daemon.sh * catfile method Stream not closed * catfile method Stream not closed Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com> * [Fix-#3713][common]Fix that catfile method Stream not closed Co-authored-by: BoYiZhang <39816903+BoYiZhang@users.noreply.github.com> Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>	4 years ago
lgcareer	268d09de1a	[Fix-#3713][common]Fix that catfile method Stream not closed	4 years ago
BoYiZhang	375ec125c5	[Feature-3773][processInstance, taskInstance] Change title name : Replacement System.currentTimeMillis () (#3774 ) * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * dag add close button * reset last version * reset last version * dag add close buttion dag add close buttion * update CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * Update CreateWorkflowLocator.java modify submit workflow button * Update CreateWorkflowLocator.java * Update CreateWorkflowLocator.java modify CLICK_ADD_BUTTON * Update CreateWorkflowLocator.java delete print * Update CreateWorkflowLocator.java 1 * Update CreateWorkflowLocator.java 1 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dag.vue * Update dag.vue * Update dag.vue * Update CreateWorkflowLocator.java * Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks" This reverts commit `3a2cba7a` * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dolphinscheduler-daemon.sh * Replacement System.currentTimeMillis () to DateUtils.getCurrentTimeStamp() * update checkstyle * update checkstyle Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>	4 years ago
zhuangchong	36d5349610	[fix-3745][server] server get tasktype NPE exception (#3746 )	4 years ago
qiaozhanwei	29f1123d1d	[Fix-3616][Server] when worker akc/response master exception , async retry (#3748 )	4 years ago
zhuangchong	fad2852768	[Improvement][server] WATERDROP task plug-in optimization in switch case code cleaning. (#3652 ) * WATERDROP switch case code checkstyle. * add TaskManagerTest. * TaskManagerTest checkstyle. * TaskManagerTest checkstyle. * TaskManagerTest add pom maven-surefire * TaskManagerTest update.	4 years ago
felix.wang	565b8d3b66	[Improvement-3690][common] Get the native IP policy problem (获取本机ip策略问题 ) (#3695 ) * Get the Intranet IP * Get the Intranet IP * fix code smell * fix code smell * fix code smell * fix code smell * support ipv6 --x:--x:--x:--x:--x:--x:--x:--x * Update dolphinscheduler-common/src/main/resources/common.properties Co-authored-by: Yichao Yang <1048262223@qq.com> Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
BoYiZhang	7af20ca3af	[Bug-3713][HadoopUtils] catfile method Stream not closed (#3715 ) * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * dag add close button * reset last version * reset last version * dag add close buttion dag add close buttion * update CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * Update CreateWorkflowLocator.java modify submit workflow button * Update CreateWorkflowLocator.java * Update CreateWorkflowLocator.java modify CLICK_ADD_BUTTON * Update CreateWorkflowLocator.java delete print * Update CreateWorkflowLocator.java 1 * Update CreateWorkflowLocator.java 1 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dag.vue * Update dag.vue * Update dag.vue * Update CreateWorkflowLocator.java * Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks" This reverts commit `3a2cba7a` * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dolphinscheduler-daemon.sh * catfile method Stream not closed * catfile method Stream not closed Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>	4 years ago
小清	ba3adbd34b	[FIXBUG][common]fix yarn applications status cause NPE(#3645 ) (#3648 ) * fix #3645 fix get yarn applications status from yarn server,http code return 404, get yarn applications status cause NullPointerException * Update HadoopUtils.java * Update HadoopUtils.java	4 years ago
Yichao Yang	ac4ed94061	[Improvement][common] Add UnsupportedOperationException for utils construct (#3381 ) * [Improvement][common] Add UnsupportedOperationException for utils construct * Fix checkstyle	4 years ago
Zhou Zheng	de19fabbc4	change back to original import order	4 years ago
zshit	26184de905	fix bug#3583 (#3585 )	4 years ago
felix.wang	2ba529a96c	[Improvement][alert] Optimize alarm information (#3559 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style * Optimize alarm information * fix code style * add license * fix code smell * Update dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java Co-authored-by: Yichao Yang <1048262223@qq.com> * fix code smell * fix code smell * 修改ut 和replace问题。 * 修改ut Co-authored-by: wangjianda <Felix@thinkingdata.com> Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
Zhou Zheng	31cd1f6cb2	adapt to code style	4 years ago
Zhou Zheng	295796a5c5	fix	4 years ago
vanilla111	a4ee351a3a	delay execution of tasks and improve some designs (#3427 )	4 years ago
dengc367	ad89f433f1	[Feature]modify some cases from rockxsj:Feature-presto to add presto datasource support (#3468 ) * Feature presto (#1) * * add presto datasource support update .gitigonre to igonre some files * * use another presto driver * * add LICENSE files about presto-jdbc * * just for test sonar Co-authored-by: rockxsj <junjun@mgtv.com> * modify the io.prestosql.jdbc.PrestoDriver to com.facebook.presto.jdbc.PrestoDriver * add presto connection in sql node Co-authored-by: rockxsj <junjun@mgtv.com>	4 years ago
qiaozhanwei	917a4b20b5	release 1.3.2 version rollback (#3527 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback * modify tag 1.3.0 to HEAD Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	32edd19ac5	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	4d2f0b0578	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	11d3c07e46	modify tag 1.3.0 to HEAD (#3525 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback * modify tag 1.3.0 to HEAD Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	f3f895751b	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	f19b125374	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	4ba6b35b0f	test release 1.3.2 version rollback (#3504 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	f50353f8a6	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	afd227a179	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	660eb5a1e6	test release 1.3.2 version rollback (#3503 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback * test * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	b5f0f23d85	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	88b3ef5d30	[maven-release-plugin] prepare release 1.3.2	4 years ago
qiaozhanwei	45424ec265	test release 1.3.2 version rollback (#3499 ) * [Feature] JVM parameter optimization , related issue #3370 * [Feature] JVM parameter optimization , related issue #3370 * test release 1.3.2 version rollback * test release 1.3.2 version rollback Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	4 years ago
qiaozhanwei	3191bfd19c	test release 1.3.2 version rollback	4 years ago
qiaozhanwei	b4b8c801ed	test release 1.3.2 version rollback	4 years ago
qiaozhanwei	c6f0c8901c	[maven-release-plugin] prepare for next development iteration	4 years ago
qiaozhanwei	8a6732ae4c	[maven-release-plugin] prepare release 1.3.2	4 years ago
rockxsj	2b46db0bf7	[Feature]add presto datasource support (#3308 ) * * add presto datasource support update .gitigonre to igonre some files * * use another presto driver * * add LICENSE files about presto-jdbc * * just for test sonar Co-authored-by: rockxsj <junjun@mgtv.com>	4 years ago
zixi0825	46ab86d6df	batch copy or move process #2753 (#2884 ) * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process sovle code smell * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * batch copy or move process * Roll back the package.json file * rerun test * revert blank * resolve conflicts * resolve conflicts * resolve ut error * resolve sonar error Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
felix.wang	5584f0cb4d	[Fix-3262][common] When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled (#3264 ) * fix bug #3165 get resource.storage.type value toUpperCase * fix bug #3176 optimize Gets the value of this property “resource.storage.type” * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix When you request the URL through applicationID to get the application status, you cannot get it if Kerberos authentication is enabled * fix miss * add KerberosHttpClient fix kerberos bug * fix map init * add juint test * Extraction of public methods * Extraction of public methods * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * Fix code quality * rebuild test * rebuild test * check style * check style * check style * revert UT POM * Kerberos judgment goes up to hadoopUtils * fix merge * Remove connection pool shutdown Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
Yichao Yang	3ed0afa6ac	[Improvement-3369][api] Introduce data analysis service interface for clear code (#3439 ) * [Improvement][api] Introduce data analysis service interface for clear code * Remove the bad smell * Remove the bad smell	4 years ago
Zhou Zheng	90a060128f	修改与新增commandType相关的代码 1. dataAnalysis 2. alertManager 3. businessTimeUtils的schedule选择	4 years ago
Yelli	e4097a488c	cancel spark task version check (#3406 ) Co-authored-by: Eights-Li <yelli.hl@gmail.com>	4 years ago
dailidong	d64127b90a	optimize TheadUtils test	4 years ago
lgcareer	a3793be7da	[Fix-3390][server]Running hive sql task need find the hdfs path correctly (#3396 ) * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * update soft version	4 years ago
CalvinKirs	6ecc95a338	[FIX_BUG][] fix some bugs from sonar analysis (#3322 ) [FIX_BUG][] fix some bugs from sonar analysis remove invalid single test * code smell * remove exception catches that never happen * delete invalid exception catch * remove excess locks * fix e2e test error * recovery related exception removal	4 years ago
lgcareer	3744167d52	[Fix-3364]Running the spark task fail because the can't find the jar (#3378 )	4 years ago
BoYiZhang	d70d8a6054	[Feature-3222][datasource] Store password in ciphertext instead (#3330 ) * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * fix bug Delete invalid field: executorcores Modify verification prompt * dag add close button * reset last version * reset last version * dag add close buttion dag add close buttion * update CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * updae CLICK_SAVE_WORKFLOW_BUTTON xpath * Update CreateWorkflowLocator.java modify submit workflow button * Update CreateWorkflowLocator.java * Update CreateWorkflowLocator.java modify CLICK_ADD_BUTTON * Update CreateWorkflowLocator.java delete print * Update CreateWorkflowLocator.java 1 * Update CreateWorkflowLocator.java 1 * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Update dag.vue * Update dag.vue * Update dag.vue * Update CreateWorkflowLocator.java * Revert "Setting '-XX:+DisableExplicitGC ' causes netty memory leaks" This reverts commit `3a2cba7a` * Setting '-XX:+DisableExplicitGC ' causes netty memory leaks in addition update '- XX: largepagesizeinbytes = 128M' to '- XX: largepagesizeinbytes = 10M' * Store password in ciphertext instead * Store password in ciphertext instead * Store password in ciphertext instead * Store password in ciphertext instead * Store password in ciphertext instead * update test unit * add test unit * add test unit * update e2e test * update unit test * update unit test Co-authored-by: dailidong <dailidong66@gmail.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com>	4 years ago
xsbai	87eb7c8211	adds waterdrop plugin (#3073 ) * add plugin waterdrop * add plugin waterdrop * add plugin waterdrop * fix deploy mode error * Update en_US.js fix conflict * Update en_US.js fix conflict * Update en_US.js Add missing commas * Update zh_CN.js Add missing commas * Update waterdrop.vue Fix the no resource hint * Update zh_CN.js Add 'Please select the waterdrop resources' * Update en_US.js Add 'Please select the waterdrop resources' * Update waterdrop.vue fix bug when click the waterdrop node again, it still show the `client` mode in deploy mode Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
RedemptionC	0c5754c3f2	add feature : query top n success process instance order by running duration (#3315 ) * add feature : query top n success process instance order by running duration * add feature : add params check * add feature : remove code smell * add feature : remove code smell * add feature : add param check * add feature : add param check improve handleEscape method in ParameterUtils.java * top n : add java doc and format code	4 years ago
zixi0825	5fe31546ba	[Fix][all] fix spell error (#3289 ) * fix spell error * test unit test Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	4 years ago
felix.wang	b555d0a086	[Improvement][common] HttpClient singleton mode #3332 (#3350 ) * Optimize the httpclient * Optimize the httpclient singleton * Merge branch 'github-local/dev' into feature/httpClientsingleton # Conflicts: # dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/HttpUtils.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/HttpUtilsTest.java * Merge branch 'github-local/dev' into feature/httpClientsingleton # Conflicts: # dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/HttpUtils.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/HttpUtilsTest.java * Merge branch 'github-local/dev' into feature/httpClientsingleton # Conflicts: # dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/HttpUtils.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/HttpUtilsTest.java	4 years ago

... 5 6 7 8 9 ...

707 Commits (57ade3893948a5a9a78a0a42f8676a40f7629dc7)