DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
lenboo	8e7bdfa276	update ut	4 years ago
simon824	24120a4641	fix the bad code smell	4 years ago
simon824	fad09075f9	remove fastjson maven dependence	4 years ago
simon824	6e907f150c	1. specified jackson Date format. 2. remove getMapper method,replace with toList() 3. rewrite toList method,support constructCollectionType. 4. parseObject(resp, Map.class) replace to toMap() method 5. rename JacksonSerialize to JsonSerializer rewrite createArrayNode,createObjectNode method will Affect too many lines ，i will fix it in the next pr.	4 years ago
bao liang	422fe5136d	[license] add license and notice (#2916 ) * fix bug: send task result to master until success. * fix bug: send task result to master until success. * add sleep * set null if send result failed * set null if send result failed * change max length of username to 39 * test for gc * change version to 1.3.0 * check and add some license files * check and add some license files * revert Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
simon	bb089288c4	Using Jackson instead of Fastjson	4 years ago
simon	f26e246706	Using Jackson instead of Fastjson	4 years ago
simon	39d2713d0a	Using Jackson instead of Fastjson	4 years ago
张世鸣	e386af700d	Using Jackson instead of Fastjson	4 years ago
张世鸣	a9f72c2081	Using Jackson instead of Fastjson	4 years ago
Han Gao	8f8ddae030	Using Jackson instead of Fastjson (#2850 ) * Using Jackson instead of Fastjson * Fix some json bugs Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
gabry.wu	1771aa50d5	change variable name ,make it easy to understand (#2647 ) Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
xiaozhaoying	de3a81cab5	support ali nail(ding talk) , issue:2458 (#2594 ) * Create TextMessage.java * Create DingTalkUtils.java * Update alert.properties * Update Constants.java * Update Constants.java * Create DingTalkMsgFormatter.java * Update alert.properties * Create DingTalkMsgFormatterTest.java * Create DingTalkUtilsTest.java * Update DingTalkUtils.java * Create DingTalkManager.java * Update EmailAlertPlugin.java * feature: test send msg with proxy * fix:delete comment and add exception info * Update DingTalkUtilsTest.java * Update DingTalkUtils.java * Update DingTalkManager.java * Update EmailAlertPlugin.java * Update DingTalkUtilsTest.java * Update DingTalkMsgFormatter.java * Update DingTalkUtils.java * Update DingTalkMsgFormatterTest.java * Update DingTalkUtilsTest.java * Update TextMessage.java * Update DingTalkManager.java * Delete TextMessage.java * fix: add test case * fix:add http client test case * fix:delete ignore test case * Update pom.xml Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
bao liang	d99471806e	[bug fix] some bugs from 1.2.0 to 1.3.0 (#2676 ) * fix bug: some bugs about worker group from 1.2.0 to 1.3.0 * fix bug: scheduler from 1.2.0 to 1.3.0 do not work * fix bug: scheduler from 1.2.0 to 1.3.0 do not work * fix ut bug Co-authored-by: baoliang <baoliang@analysys.com.cn>	5 years ago
qiaozhanwei	83ede1037e	blank in eamil and left font align #2648 (#2673 ) * script variable has "processDefinitionId" is error #2664 * blank in eamil and left font align #2648 Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	5 years ago
chenxingchun	d37e843cd0	Modify the alert log file	5 years ago
hgaol	906ffa09a9	resolve code checks	5 years ago
hgaol	85f3ac10a0	feat: add plugin management for alert service	5 years ago
qiaozhanwei	f2bfdc14f7	#2499 bug fix (#2505 ) * dispatch task fail will set task status failed * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * #2486 bug fix * host and workergroup compatible * EnterpriseWeChatUtils modify * EnterpriseWeChatUtils modify * EnterpriseWeChatUtils modify * #2499 bug fix Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	5 years ago
qiaozhanwei	e837a73fcd	EnterpriseWeChatUtils modify (#2502 ) * dispatch task fail will set task status failed * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * #2486 bug fix * host and workergroup compatible * EnterpriseWeChatUtils modify * EnterpriseWeChatUtils modify * EnterpriseWeChatUtils modify Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	5 years ago
qiaozhanwei	28766df53f	send mail error, #2466 bug fix (#2470 ) * dispatch task fail will set task status failed * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，no worker condition , master will while ture wait for worker startup 2，worker response task status sync wait for result * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * 1，task status statistics and process status statistics bug fix (#2357) 2，worker group bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix * send mail error, #2466 bug fix Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	5 years ago
dailidong	eec92ed1fc	simplify and optimize config (#2469 ) * [Refactor worker] simplify and optimize config (#2386) * simplify config * simplify config * simplify and optimize config * Update HadoopUtils.java optimize HadoopUtils * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HttpUtils.java * Update pom.xml * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java * Update HadoopUtilsTest.java	5 years ago
dailidong	b854d6b77a	[Refactor worker] simplify and optimize config (#2386 ) * simplify config * simplify config * simplify and optimize config	5 years ago
Rubik-W	f60edc8e61	fix：mail send fail #2345 (#2346 ) Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
dailidong	ace907e7dd	[refactor-worker] simplify master、 worker、alert、dao properties (#2304 ) * update logback * update log * refactor worker registry (#2107) * Refactor worker (#2115) * refactor worker registry * refactor master server * Modify workgroupid parameter name (#2105) * Delete worker group management page * Modify workgroupid parameter name * Refactor worker (#2121) * refactor worker registry * refactor master server * refactor MasterSchedulerService * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126) * 1, master persistent task 2. extract master and worker communication model * 1, master persistent task 2. extract master and worker communication model * 1, master persistent task 2. extract master and worker communication model * add license * modify javadoc error * TaskExecutionContext create modify * buildAckCommand taskInstanceId not set modify * java doc error modify * add comment * ExecutorManager interface add generic type * add TaskInstanceCacheManager receive Worker report result * TaskInstance setExecutePath * add TaskInstanceCacheManager to receive Worker Task result report * TaskInstanceCacheManager add remove method * add license * add dispatcht task method * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * AbstractCommandExecutor remove db access * taskInstanceCache is null ,need load from db * taskInstanceCache is null ,need load from db * taskInstanceCache is null ,need load from db * 1，worker TaskPros use TaskExecutionContext replase 2，Master kill Task , KillTaskProcessor modify * worker remove db * ShellTask modify * master persistence processId and appIds * master persistence processId and appIds * master add kill task logic * master add kill task logic * master add kill task logic * javadoc error modify * remove chinese log * executeDirectly method add Override * remote module modify * TaskKillResponseProcessor command type modify * create buildKillCommand * host add host:port format * host add host:port format * TaskAckProcessor modify * TaskAckProcessor modify * task prioriry refator * remove ITaskQueue * task prioriry refator * remove ITaskQueue * TaskPriority refactor * remove logs * WorkerServer refactor * MasterSchedulerService modify * WorkerConfig listen port modify * modify master and worker listen port * cancelTaskInstance set TaskExecutionContext host,logPath,executePath * cancelTaskInstance set TaskExecutionContext host,logPath,executePath Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn> * not exist in openjdk,just delete * add master and worker properties * add master and worker properties * add master and worker properties * fix cpu 100% bug * simplify master、 worker、alert、dao properties * add master and worker properties * add master and worker properties * add master and worker properties Co-authored-by: Tboy <guo.jiwei@immomo.com> Co-authored-by: break60 <790061044@qq.com> Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com> Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>	5 years ago
tswstarplanet	3c5227ac0f	Refactor ConnectionFactory to static inner holder Singleton (#2204 ) * refactor ConnectionFactory to static inner holder Singleton * remove redundant import * make getSqlSessionFactory() method private * fix sonar issue * remove @Ignore of MailUtilsTest * add MailUtilsTest to pom.xml to test * fix MailUtilsTest path error in pom.xml * modify test method name * add assert and logger to unit test * add log * add log * add AlertDaoTest * move AlertDaoTest to new module * modify test in pom.xml * remove unnecessary log	5 years ago
gabry.wu	fcc57320d6	Adapting partial code(file name start with M #1 ) to the sonar cloud rule (#2173 ) * Adapting partial code(file name start with M #1) to the sonar cloud rule * remove unused import	5 years ago
gabry.wu	a076ae4c36	Adapting partial code(file name start with J) to the sonar cloud rule (#2165 ) * Adapting partial code(file name start with J) to the sonar cloud rule * fix unit failure	5 years ago
gabry.wu	daad5efbab	use static method in static class JSON (#2156 )	5 years ago
t1mon	46e30b1e50	Add mail server configuration description information (#2143 ) * Add mail server configuration description information * Remove mail server configuration note in alert.properties	5 years ago
tswstarplanet	afb907b4b0	fix unequal number of arguments and placeholder (#2149 )	5 years ago
gabry.wu	ebf7a980d2	Adapting partial code(file name start with F) to the sonar cloud rule (#2045 ) * Adapting partial code(file name start with F) to the sonar cloud rule * add more unit test * add License * add includes configuration to maven-surefire-plugin * fix getResourceFilesList incorrect logic	5 years ago
dailidong	f551913249	split logback config into seperate child module logback (#2120 ) * update logback * update log	5 years ago
gabry.wu	450a1f56fc	Adapting partial code(file name start with E) to the sonar cloud rule (#1999 ) * Adapting partial code(file name start with E) to the sonar cloud rule * remove isEmpty invoke * resolve conflicts	5 years ago
qiaozhanwei	3e5a939913	delete unused import (#2066 )	5 years ago
gabry.wu	44b76468a8	Adapting partial code(file name start with C) to the sonar cloud rules (#1918 ) * Adapting partial code(file name start with C) to the sonar cloud rules * add some UT * add some UT(rollback JSONUtils.checkJsonVaild) * add some UT(fix OSUtils.exeCmd UT)	5 years ago
Tboy	29f2b41ed0	Refactor architecture (#1926 ) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
khadgarmage	c447bb489f	add stringutils ut (#1921 ) * add stringutils ut	5 years ago
dailidong	c63cd3e237	combine logback config of master/worker/alert/api server to one (#1898 ) * combine logback config of master/worker/alert/api server to one logback.xml	5 years ago
dailidong	835383105c	combine logback config of master/worker/alert/api server to one logback.xml	5 years ago
Jave-Chen	c522ea7ebb	Fix bug: NullPointerException etc. (#1721 ) * #1720 Fix bug: NullPointerException etc. * fix code smell * Update DateInterval.java refactor equals method Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
ZHAOLIPAN	68f736953b	fix typos (#1821 )	5 years ago
Yelli	8399ab4718	add null check in markdownTable & modify EnterpriseWeChatManager logger class (#1809 )	5 years ago
Yelli	1a86e7bae7	add retMap null check for AlertSender (#1796 ) * fix bug: zk hasTask method NPE * add retMap null check for AlertSender	5 years ago
DK.Pino	9eb823c0aa	Refactor alert template (#1713 ) * refactor Alert Template * refactor alert template(remove freemarker) * add license * update abstract class to interface * make test into root pom * fix powermock static * fix powermock static * remove custom exception * remove custom exception	5 years ago
Tboy	0e66c71f38	remove commons-collections4/commons-logging/commons-io dependancy for API module (#1693 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy * remove commons-collections4/commons-logging/commons-io dependancy * tmp add commons-lang3 for compile	5 years ago
Jave-Chen	dad75727ff	fix bug (#1633 ) dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/utils/EnterpriseWeChatUtils.java https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&issues=AW9PvkP_YzPBRjkobY7y&open=AW9PvkP_YzPBRjkobY7y https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&issues=AW9PvkP_YzPBRjkobY7z&open=AW9PvkP_YzPBRjkobY7z dolphinscheduler-alert/src/main/java/org/apache/dolphinscheduler/alert/AlertServer.java https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&issues=AW9PvkRwYzPBRjkobY87&open=AW9PvkRwYzPBRjkobY87	5 years ago
Yelli	1d65080507	#1300 Add right alignment function in sql email content (#1542 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl	5 years ago
zhukai	a4b57f8a47	Add PropertyUtilsTest, the UT of PropertyUtils (#1528 ) 1. Add PropertyUtilsTest 2. Add null check and formatparse check in PropertyUtils 3. Add UT path in parent.pom	5 years ago
zhukai	0567b5829c	Add the UTs of FuncUtils and JSONUtilsTest. (#1507 ) 1.Add FuncUtilsTest.java and JSONUtilsTest.java 2.Add null check in FuncUtils.mkString 3.Add pom config	5 years ago

1 2 3 4

169 Commits (6c819ee16d575e62039d98183b93fd3a06c628ed)