DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
赤月	69201ac346	[Improvement][ALL] Remove some un-used code and code review #3639 (#3640 ) * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review #3639 * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review * [Improvement][ALL] Remove some un-used code and code review	4 years ago
CalvinKirs	632d52cd69	[refactor][server-test] refactor RoundRobinHostManagerTest (#3511 ) * [refactor][server-test] refactor RoundRobinHostManagerTest * add RoundRobinHostManagerTest * format code * format code	4 years ago
Zhou Zheng	d2a43b0c25	fix bug about CONDITION-task 1. condition shoudn't be in error list 2. condition need more checks when rusume_from_forced_success	4 years ago
zhuangchong	efee53bec9	[Improvement][server] server model ProcessUtils.java code cleaning. (#3382 ) * server model ProcessUtils.java code cleaning. * add checkstyle,server model ProcessUtils.java code cleaning. * ProcessUtils.java checkstyle. * update. * update. Co-authored-by: unknown <zhuangchong-phq@sinosig.com>	4 years ago
felix.wang	2ba529a96c	[Improvement][alert] Optimize alarm information (#3559 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style * Optimize alarm information * fix code style * add license * fix code smell * Update dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java Co-authored-by: Yichao Yang <1048262223@qq.com> * fix code smell * fix code smell * 修改ut 和replace问题。 * 修改ut Co-authored-by: wangjianda <Felix@thinkingdata.com> Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
Yichao Yang	8fea8f913c	[Test][server] Add the master server test case (#3574 )	4 years ago
Zhou Zheng	6e5145f7c4	fix some code smell problems 1. use Collections.isEmpt() instead of size() > 0 2. make if statements more readable	4 years ago
Zhou Zheng	31cd1f6cb2	adapt to code style	4 years ago
felix.wang	2f01025802	[Fix-3299][dao&server] Fix 3299,when Json string parsing problem caused by non-standard json format. (#3552 ) * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. * #3299 Json string parsing problem caused by non-standard json format. fix code style * #3299 Json string parsing problem caused by non-standard json format. fix code style Co-authored-by: wangjianda <Felix@thinkingdata.com>	4 years ago
JinyLeeChina	d30bc7bcf3	'3549' (#3550 )	4 years ago
CalvinKirs	a1ce54b8e6	[Improvement][server] Fix some sonar analyzed bugs (#3415 ) * [FIX_BUG][]fix sonar bugs fix assert error(assertions always pass) fix assert error(assertions always pass) insert data should judging the success status * fix assert error(assertions always pass) * use AtomicReference<Object> to replace unsafe volatile Object * use AtomicReference<Object> to replace unsafe volatile Object * lazy initialization holder class Singleton... * reformat code judge database operations * reformat code judge database operations * revert * use ThreadLocalRandom to build random numbers * reform code * fix dao test error * judge database operations	4 years ago
vanilla111	a4ee351a3a	delay execution of tasks and improve some designs (#3427 )	4 years ago
Hsu Pu	59610a5661	[Improvement][dao,server] unit test for ConditionsTask (#3385 )	4 years ago
XiaotaoYi	0b7b6d4e2a	[bug-3480][server]fix ds muti-level directory in zk, which lead to fa… (#3532 ) * [bug-3480][server]fix ds muti-level directory in zk, which lead to fail to assign work * miss whitespace for if statement	4 years ago
XiaotaoYi	5fdc43cdca	fix ds muti-level directory in zk, which lead to fail to assign work	4 years ago
bao liang	5756d6b029	fix bug: Fix master task dependency check bug (#3473 ) Co-authored-by: lenboo <baoliang@analysys.com.cn>	4 years ago
zixi0825	a7a1156ff1	fix zk path error (#3470 )	4 years ago
CalvinKirs	d6a32ac652	[Feature#3234][cluster]enhanced load balancing (#3235 ) * [Future#3234][cluster]enhanced load balancing weight-based load balancing algorithm this close # 3234 * remove useless parameter * code smell * load balancing according to work group * add smooth weight round robin * remove unused constants * perfect unit test * code smell * code smell * add work weight config * fix config error * add weight docs to readme.md	4 years ago
Yichao Yang	f419fe6239	[Test][server] Add LoggerServerTest (#3405 )	4 years ago
Zhou Zheng	079768fdaa	revert	4 years ago
Zhou Zheng	90a060128f	修改与新增commandType相关的代码 1. dataAnalysis 2. alertManager 3. businessTimeUtils的schedule选择	4 years ago
zixi0825	40a21816ab	[Fix] [Server] Fix the spell error and add log in SqlTask (#3243 ) * fix the spell and modify logger print format	4 years ago
Zhou Zheng	48afb2e2f8	增加强制成功对运行中process的影响 1. 失败任务强制成功后会继续submit后续结点 2. 失败重试的节点强制成功后会继续submit后面结点，并且停止retry 3. 对于失败的sub-process如果其中的结点强制成功了，在parent-process中不会有任何影响，只能等到结束后“从强制成功处继续执行”。	4 years ago
Zhou Zheng	93653768c8	支持sub-process和condition的TFS	4 years ago
Zhou Zheng	23277bf160	Revert "[bugfix] issue #3324" This reverts commit `fa0bb5e546`.	4 years ago
lenboo	f936b07fdf	fix bug: Fix master task dependency check bug	4 years ago
lgcareer	a3793be7da	[Fix-3390][server]Running hive sql task need find the hdfs path correctly (#3396 ) * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * [Fix-3390][api]Running hive sql task need find the hdfs path correctly * update soft version	4 years ago
CalvinKirs	6ecc95a338	[FIX_BUG][] fix some bugs from sonar analysis (#3322 ) [FIX_BUG][] fix some bugs from sonar analysis remove invalid single test * code smell * remove exception catches that never happen * delete invalid exception catch * remove excess locks * fix e2e test error * recovery related exception removal	4 years ago
lgcareer	3744167d52	[Fix-3364]Running the spark task fail because the can't find the jar (#3378 )	4 years ago
lenboo	cdd76d6b11	refactor depend result	4 years ago
lenboo	0e885cd0ee	remove unused import	4 years ago
lenboo	ed78aea2f8	fix bug: there exists some problems in checking task dependency	4 years ago
dailidong	6d903e266f	[Feature][server] add embeded zookeeper server in dolphinscheduler-daemon.sh (#3293 ) * update README about DolphinScheduler * Update issue templates * update * regularize api pom xml update rpc maven compile to 1.8 * regularize api pom xml * change commons.lang3.StringUtils to common.utils.StringUtils * update pom.xml * update * correct equals method * jasper-runtime is needed when api server start * jasper-runtime jar is needed when api server start * combine logback config of master/worker/alert/api server to one logback.xml * remove tomcat runtime jar * add UT * add license * remove jasper-runtime jar, not need anymore * sovle jar conflict， remove servlet-api 2.5 jar * remove servlet 2.5 * add embedded database h2 and update embedded zookeeper * delete logs * add license * change log level to INFO * simplify and optimize config * add development state * simplify common config * add worker group config * add worker group config * add worker group config * this command just for getting a quick experience，not recommended for production. this operation will start a standalone zookeeper server * Merge remote-tracking branch 'upstream/dev' into dev * add logback for zookeeper * Update logback-zookeeper.xml Co-authored-by: lidongdai <escheduler@outlook.com> Co-authored-by: dailidong <dolphinschedule@gmail.com> Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>	4 years ago
xsbai	87eb7c8211	adds waterdrop plugin (#3073 ) * add plugin waterdrop * add plugin waterdrop * add plugin waterdrop * fix deploy mode error * Update en_US.js fix conflict * Update en_US.js fix conflict * Update en_US.js Add missing commas * Update zh_CN.js Add missing commas * Update waterdrop.vue Fix the no resource hint * Update zh_CN.js Add 'Please select the waterdrop resources' * Update en_US.js Add 'Please select the waterdrop resources' * Update waterdrop.vue fix bug when click the waterdrop node again, it still show the `client` mode in deploy mode Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
zixi0825	5fe31546ba	[Fix][all] fix spell error (#3289 ) * fix spell error * test unit test Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	4 years ago
chendapao	afd9139c3f	[Feature]use zk own del func (#3310 ) * use zk own del func * Update remove-zk-node.sh Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
CalvinKirs	3a0d4da27e	[Test][server] Fix Test ContextConfiguration error. (#3304 ) * [FIX_BUG]fix test error * small change * add test * reformat * fix test no qualifying bean	4 years ago
zixi0825	78856fb08e	remove the duplicate function in MasterExecThread (#3329 ) Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	4 years ago
xingchun-chen	57eee5695a	Merge pull request #3331 from lenboo/dev-complement [FIX-1336] [master] serial complement data can have multiple process instances	4 years ago
lenboo	82295eea52	fix bug#1336 set start/end time before complement the next process	4 years ago
bao liang	1b98db9240	fix bug#1336 serial complement data can have multiple process instances (#3317 ) Co-authored-by: lenboo <baoliang@analysys.com.cn>	4 years ago
Zhou Zheng	fa0bb5e546	[bugfix] issue #3324	4 years ago
bao liang	624f0aeab9	fix bug#1336 serial complement data can have multiple process instances (#3317 ) Co-authored-by: lenboo <baoliang@analysys.com.cn>	4 years ago
lgcareer	6b964be60a	[Feature][server]support one worker can belongs different worker groups when execute install script (#3307 )	4 years ago
lenboo	39182568b2	fix bug#1336 serial complement data can have multiple process instances	4 years ago
Yichao Yang	0577dc9780	[Test-3288][server] Fix github ci unit test oom (#3305 ) * [Improvement] Test github action oom * Optimize the test case performance * Remove the unused import	4 years ago
dailidong	58d6a1ec9a	Merge remote-tracking branch 'upstream/dev' into dev	4 years ago
tswstarplanet	5b7efd2d33	[Feature-3134]Refactor to use a shared singleton Curator Zookeeper Client (#3244 ) * [Feature-3134]Refactor to use a shared singleton Curator Zookeeper Client * autowire CuratorZookeeperClient to ZookeeperOperator * [Improvement] Add the issue specifications reference (#3221) * log zookeeper address when the connect state change * resume the operation of add connect state listener in MasterRegistry Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
lgcareer	f854c5f794	[Feature-2815]cherry pick commit from dev for one worker can belong different worker groups (#3277 ) * [Feature-2815]cherry pick commit from dev for one worker can belong to different worker groups * fix 2975:download resource need find the tenant code of resource owner * change NetUtils to OSUtils because NetUtils didn't exist in the 1.3.2-release branch Co-authored-by: Yichao Yang <1048262223@qq.com>	4 years ago
LEI SHENG	6f2667bf1a	[Fix-3240][worker] Cannot find a (Map) Key deserializer for type (#3245 ) * fix the bug #2923 (Hive JDBC connection parameter ignored) , the hive jdbc connection url ; * fix the bug index out of bound and add some test case * add the Licensed * fix the checkstyle and import StringBuilder * put HiveDataSourceTest.java to root pom maven-surefire-plugin to avoiding the sonar 0.0% Coverage. * Update HiveDataSource.java * fix the bug #3240 [worker] Cannot find a (Map) Key deserializer for type * [DS-3245][fix] change toString use JsonString - change the method of UdfFunc.toString use JsonString This closes #3245 * [DS-3245][fix] change toString use JsonString - fix the junit test for full This closes #3245 * [DS-3245][fix] change toString use JsonString - fix the sonarcloud merge error, Swap these 2 arguments so they are in the correct order: expected value, actual value. This closes #3245 * [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java move the class UdfFuncDeserializer.java to UdfFunc.java This closes #3245 * [DS-3245][fix] move the Class UdfFuncDeserializer to UdfFunc.java add blank line This closes #3245 * [DS-3245][fix] add the unit test of UdfFunc add the unit test of UdfFunc.java This closes #3245 * [DS-3245][fix] add the unit test of UdfFunc remove the UdfFuncTest.java from maven-surefire-plugin list This closes #3245 * [DS-3245][fix] add the unit test of UdfFunc add the UdfFuncTest to the root pom maven-surefire-plugin This closes #3245 Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago

1 2 3 4 5 ...

396 Commits (6df87b89d7b0ec013c5a2bfdfb92fa3ff1496c40)