DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
qiaozhanwei	c39e511262	master/worker basic communication	5 years ago
qiaozhanwei	f6a2130ba1	master/worker basic communication	5 years ago
qiaozhanwei	910401fb2d	master/worker basic communication	5 years ago
qiaozhanwei	e7c32affc6	master/worker basic communication	5 years ago
Tboy	ac93d78379	Refactor worker (#1979 ) * updates * move FetchTaskThread logic to WorkerNettyRequestProcessor * add NettyRemotingClient to scheduler thread * refactor TaskScheduleThread, add TaskInstanceCallbackService	5 years ago
Tboy	f9500c58b1	Refactor worker (#1975 ) * updates * move FetchTaskThread logic to WorkerNettyRequestProcessor * add NettyRemotingClient to scheduler thread	5 years ago
qiaozhanwei	9b75bebf1b	1，add sendAsync method 2，refactor LoggerClient (#1965 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * move datasource classes to dao module * fix send4LetterWord bug * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel * refactor log client service * add sendSync method * 1，quartz.properties add conf category 2，dolphinscheduler-daemon.sh modify * dolphinscheduler-binary.xml modify * add sendAsync method (#1962) * add sendAsync method * add sendAsync method * 1，add sendAsync method 2，refactor LoggerClient * LogClientService modify Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
qiaozhanwei	c1ee133392	Refactor Architecture Basic modification #1658 (#1946 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
Technoboy-	8e154ecbe4	refactor log client service	5 years ago
Tboy	1e812ca078	add finally block to close channel (#1951 ) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel	5 years ago
Technoboy-	e39d6ba973	add finally block to close channel	5 years ago
gabry.wu	44b76468a8	Adapting partial code(file name start with C) to the sonar cloud rules (#1918 ) * Adapting partial code(file name start with C) to the sonar cloud rules * add some UT * add some UT(rollback JSONUtils.checkJsonVaild) * add some UT(fix OSUtils.exeCmd UT)	5 years ago
Tboy	d3f8bb0a2b	Refactor architecture (#1936 ) * move datasource classes to dao module * fix send4LetterWord bug	5 years ago
Technoboy-	b1a68c645d	move datasource classes to dao module	5 years ago
qiaozhanwei	e0a5a15d49	dolphinscheduler-common remove spring (#1931 ) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring	5 years ago
Tboy	29f2b41ed0	Refactor architecture (#1926 ) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
qiaozhanwei	9a70e77955	1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify	5 years ago
zhangzy	515255b919	ut	5 years ago
Rubik	fccbcc8d7d	fix: The constructor has passed in an taskAppId, no need to get from taskAppId. (#1906 )	5 years ago
zhangzy	9d944d3f76	Optimize duplicate code Use public methods to simplify duplicate code	5 years ago
zhangzy	662233e0dd	Remove ScheduleUtil，use the existing CronUtils CronUtils is a public quartz tools, then the project dolphinscheduler-api can remove dolphinscheduler-server	5 years ago
dailidong	c63cd3e237	combine logback config of master/worker/alert/api server to one (#1898 ) * combine logback config of master/worker/alert/api server to one logback.xml	5 years ago
魔方不在手	f942e5ced3	[feature] data synchronization function (#1881 ) * feature：data synchronization function * feature：data synchronization function * feature：data synchronization function * fix：add license * fix：resource close bug * fix：remove class author * fix：Improve test coverage * fix：add UT * fix：add UT * fix：data sync node renamed to datax * fix：add UT * fix: UT bug * fix：Optimize variable name * fix：pom * fix：Variable name error * fix：optimize the code	5 years ago
Yelli	78bfe918d0	change datasource null check position (#1883 )	5 years ago
Yelli	5169689c35	class overrides equals() and should therefore also override hashCode() (#1882 )	5 years ago
Tboy	0712ccc342	#1871 correct spelling (#1872 ) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling	5 years ago
liwenhe1993	30db5c1467	Api module relp server module/1756 (#1766 ) * Remove server module on api module 1. Remove server module and add dao module. 2. Move quartz in server module to dao module. 3. Update config and class. to resolve conflicts，I deleted CombinedApplicationServer.java Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
Jave-Chen	d371745ddf	Fix bug: Use try-with-resources or close this "Socket" in a "finally" clause. (#1716 ) * #1714	5 years ago
gabry.wu	abe80fc538	[Feature] python task logs print delayed (#1844 ) * [Feature] python task logs print delayed #1843	5 years ago
samz406	aa91572def	fix Misspelled words (#1841 ) * modify UdfFuncServiceTest UT * fix get tenantCode my NPE * add ResourcesServiceTest * add error log * add BaseServiceTest BaseServiceTest UT * update * fix word spelling * Revert "fix word spelling" This reverts commit `19bde51350`. * fix Misspelled words	5 years ago
lilin	9ebe177e11	fix Misspelled words	5 years ago
lilin	55923016b4	Revert "fix word spelling" This reverts commit `19bde51350`.	5 years ago
lilin	19bde51350	fix word spelling	5 years ago
老佛爷	1c77708a89	Supplementary data by schedule (#1830 ) * Supplementary data by schedule * fix sonar check bug * fix code duplicated blocks * ut * loop by day * MasterExecThread test * test add licene Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
gabry.wu	c531c88e7e	[Feature] AbstractCommandExecutor.commandType difficult to understand (#1833 ) issue: https://github.com/apache/incubator-dolphinscheduler/issues/1831	5 years ago
lgcareer	779672ec2a	[Fix issue #1770 ]check udf and data source in order to fix issue 1770 (#1826 ) * check udf and data source in order to fix issue 1770 * check udf and data source in order to fix issue 1770 * update testListAuthorizedUdfFunc	5 years ago
ZHAOLIPAN	68f736953b	fix typos (#1821 )	5 years ago
qiaozhanwei	b9ac6d66f1	fix #1775 bug，delete process definition when process instance is running (#1776 ) * remove LogViewServiceGrpc.java file and pom modify * remove kazoo * remove kazoo * remove kazoo * remove common monitor package * add license * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * install.sh remove python kazoo * add system param whether repeat running * remove kazoo modify * BusinessTimeUtils remove whther repeat running inner param * add AccessTokenMapperTest UT * CI UT yml modify，start postgresql and zookeeper by default * add AlertGroupMapperTest UT in github action * Conflicts reslove * AlertMappert UT modify * AlertMappert UT modify * AlertMappert UT modify * CommandMapperTest UT modify * DataSourceMapperTest UT modify * fix #1775 bug，delete process definition when process instance is running * verifyTenantIsNull remove process definnition id print log	5 years ago
gabry.wu	88b022cb57	ITaskQueue should have "hasTask" function (#1744 ) * issue https://github.com/apache/incubator-dolphinscheduler/issues/1742 * remove unnecessary catch * fix exception type * fix bad code smell * remove log exceptions * catch exception	5 years ago
DK.Pino	aa715e17bf	remove lombok dependency(last) (#1771 )	5 years ago
bao liang	e0e0696b4f	add out put log when master/worker server start (#1769 ) * merge hadoop.properties into common.properties * merge hadoop,zookeeper.properties into common.properties remove combined.properties/master.properties/worker.properties * change db user/pwd to test/test * rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh remove some unused in install.sh * add out put log when master/worker server start... * add start log when servers start	5 years ago
Yelli	963ed4a8c6	ds.server & ds.common.zk regularize log print (#1754 )	5 years ago
gabry.wu	0a39f1a4dd	why not invoke checkWorkerGroup in advance (#1747 ) * issue https://github.com/apache/incubator-dolphinscheduler/issues/1743 * issue https://github.com/apache/incubator-dolphinscheduler/issues/1743	5 years ago
Yelli	8125974c61	ds.server regularize log print (#1751 ) * ds.server regularize log print * log print modify * log print modify * modify lang3 to lang	5 years ago
Yelli	7762a62270	add null check in SubProcessTaskExecThread (#1737 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments * fix bug sonar: add null check in daghelper && add hashcode method in ProcessData * fix bug sonar: add null check in daghelper * CollectionUtils.isEmpty() * add hashcode() && null check * merge if * remove hashcode * remove e.getMessage	5 years ago
Yelli	7ecd38f7d6	fix sonar bug: change condition & not enough arguments (#1692 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments	5 years ago
Tboy	884237487c	remove commons-lang3 dependancy, using common-module instead for server module (#1698 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy * remove commons-collections4/commons-logging/commons-io dependancy * tmp add commons-lang3 for compile * remove commons-lang3 dependancy, using common-module instead * remove common StringUtils instead of lang3 * add tmp lang3 for compile	5 years ago
Tboy	0e66c71f38	remove commons-collections4/commons-logging/commons-io dependancy for API module (#1693 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy * remove commons-collections4/commons-logging/commons-io dependancy * tmp add commons-lang3 for compile	5 years ago
khadgarmage	bb414b0794	delete bytes file (#1669 )	5 years ago
zhukai	f311c966ab	Fix bug in #1634 ,replace the current datetime with a fixed time (#1665 )	5 years ago

... 2 3 4 5 6

270 Commits (8e080ef6085e285480e906ee8dee301e3790bc02)