DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Rubik-W	e0389aebf6	fix: NullPointException in the case of task queuing (#2175 )	5 years ago
Rubik-W	80c6ce5711	The master and worker server exit exception #2163 (#2176 ) * fix: #2163 * fix: format	5 years ago
gabry.wu	daad5efbab	use static method in static class JSON (#2156 )	5 years ago
gabry.wu	7473d5e928	Adapting partial code(file name start with H) to the sonar cloud rule (#2145 )	5 years ago
gabry.wu	ebf7a980d2	Adapting partial code(file name start with F) to the sonar cloud rule (#2045 ) * Adapting partial code(file name start with F) to the sonar cloud rule * add more unit test * add License * add includes configuration to maven-surefire-plugin * fix getResourceFilesList incorrect logic	5 years ago
tison	9224b49b58	access field handle of FileDescriptor in ProcessImplForWin32 by reflection for portability (#2113 ) * access field handle of FileDescriptor in ProcessImplForWin32 by reflection for portability Current implementation relies on `sun.misc.JavaIOFileDescriptorAccess` which is only accessible on oraclejdk8. Basically the demand is getting & setting `handle` field of `FileDescriptor`, so we can directly do that with reflection. Though, I suspect the necessity we introduce ProcessImplForWin32. Maybe we could have a better way to support worker server to run bat script. * harden initialization of ProcessImplForWin32 * ignore ShellTaskTest#testHandleForWindows outside Windows	5 years ago
gabry.wu	0e1dd8d7d9	remove incorrect or unnecessary URL tag (#2099 )	5 years ago
dailidong	6070738acb	Support worker server to run bat script (#2023 ) * Support worker server to run bat script 1. Reimplement ProcessImpl.java, ProcessEnvironment.java and ProcessBuilder.java for Windows 2. Modify shell task code for windows 3. Add ASF License * Add Unit Test	5 years ago
Tboy	7ed28af4fe	Upgrade curator version (#2083 ) * upgrade curator version issue: https://github.com/apache/incubator-dolphinscheduler/issues/2020 curator issue: https://github.com/apache/curator/pull/297 * add DefaultEnsembleProvider override * add some unit test * add License	5 years ago
dailidong	4230d5a737	add embedded database h2 and update embedded zookeeper (#2082 ) add embedded database h2 and update embedded zookeeper	5 years ago
dailidong	6ec85540bf	fix typo (#2093 )	5 years ago
qiaozhanwei	d5c795bd45	fix ugly logger usage (#2063 ) * fix ugly logger usage * remove space	5 years ago
qiaozhanwei	3e5a939913	delete unused import (#2066 )	5 years ago
qiaozhanwei	b8014d91cf	add workflow id, name for email content (#2071 ) * add tenantService UT * fix spell * #464 email content * modify mysql1.2.2 ddl	5 years ago
bao liang	0df7c6719d	[New Feature] add conditions task #205 (#2003 ) * add funtion conditions task * update conditions tasks * update conditions for ui * update conditions * update * revert * update	5 years ago
gabry.wu	5ca4862ea9	remove String.format for org.slf4j.Logger (#2001 )	5 years ago
孙朝和	3d6eee5d80	#203 add sqoop task (#1974 ) * add sqoop task * add sqoop task * add sqoop task test * add sqoop task test * add sqoop task test * modify add sqoop task test * modify sqoop task test * modify sqoop task test * modify sqoop task test * modify sqoop task test 2 * modify sqoop task test 3 * modify sqoop task test 3 * modify sqoop task test 3 * modify sqoop task test 4	5 years ago
qiaozhanwei	9b75bebf1b	1，add sendAsync method 2，refactor LoggerClient (#1965 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * move datasource classes to dao module * fix send4LetterWord bug * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel * refactor log client service * add sendSync method * 1，quartz.properties add conf category 2，dolphinscheduler-daemon.sh modify * dolphinscheduler-binary.xml modify * add sendAsync method (#1962) * add sendAsync method * add sendAsync method * 1，add sendAsync method 2，refactor LoggerClient * LogClientService modify Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
qiaozhanwei	c1ee133392	Refactor Architecture Basic modification #1658 (#1946 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
gabry.wu	44b76468a8	Adapting partial code(file name start with C) to the sonar cloud rules (#1918 ) * Adapting partial code(file name start with C) to the sonar cloud rules * add some UT * add some UT(rollback JSONUtils.checkJsonVaild) * add some UT(fix OSUtils.exeCmd UT)	5 years ago
zhangzy	515255b919	ut	5 years ago
Rubik	fccbcc8d7d	fix: The constructor has passed in an taskAppId, no need to get from taskAppId. (#1906 )	5 years ago
zhangzy	9d944d3f76	Optimize duplicate code Use public methods to simplify duplicate code	5 years ago
zhangzy	662233e0dd	Remove ScheduleUtil，use the existing CronUtils CronUtils is a public quartz tools, then the project dolphinscheduler-api can remove dolphinscheduler-server	5 years ago
dailidong	c63cd3e237	combine logback config of master/worker/alert/api server to one (#1898 ) * combine logback config of master/worker/alert/api server to one logback.xml	5 years ago
魔方不在手	f942e5ced3	[feature] data synchronization function (#1881 ) * feature：data synchronization function * feature：data synchronization function * feature：data synchronization function * fix：add license * fix：resource close bug * fix：remove class author * fix：Improve test coverage * fix：add UT * fix：add UT * fix：data sync node renamed to datax * fix：add UT * fix: UT bug * fix：Optimize variable name * fix：pom * fix：Variable name error * fix：optimize the code	5 years ago
Yelli	78bfe918d0	change datasource null check position (#1883 )	5 years ago
Yelli	5169689c35	class overrides equals() and should therefore also override hashCode() (#1882 )	5 years ago
Tboy	0712ccc342	#1871 correct spelling (#1872 ) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling	5 years ago
liwenhe1993	30db5c1467	Api module relp server module/1756 (#1766 ) * Remove server module on api module 1. Remove server module and add dao module. 2. Move quartz in server module to dao module. 3. Update config and class. to resolve conflicts，I deleted CombinedApplicationServer.java Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
Jave-Chen	d371745ddf	Fix bug: Use try-with-resources or close this "Socket" in a "finally" clause. (#1716 ) * #1714	5 years ago
gabry.wu	abe80fc538	[Feature] python task logs print delayed (#1844 ) * [Feature] python task logs print delayed #1843	5 years ago
samz406	aa91572def	fix Misspelled words (#1841 ) * modify UdfFuncServiceTest UT * fix get tenantCode my NPE * add ResourcesServiceTest * add error log * add BaseServiceTest BaseServiceTest UT * update * fix word spelling * Revert "fix word spelling" This reverts commit `19bde51350`. * fix Misspelled words	5 years ago
lilin	9ebe177e11	fix Misspelled words	5 years ago
lilin	55923016b4	Revert "fix word spelling" This reverts commit `19bde51350`.	5 years ago
lilin	19bde51350	fix word spelling	5 years ago
老佛爷	1c77708a89	Supplementary data by schedule (#1830 ) * Supplementary data by schedule * fix sonar check bug * fix code duplicated blocks * ut * loop by day * MasterExecThread test * test add licene Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
gabry.wu	c531c88e7e	[Feature] AbstractCommandExecutor.commandType difficult to understand (#1833 ) issue: https://github.com/apache/incubator-dolphinscheduler/issues/1831	5 years ago
lgcareer	779672ec2a	[Fix issue #1770 ]check udf and data source in order to fix issue 1770 (#1826 ) * check udf and data source in order to fix issue 1770 * check udf and data source in order to fix issue 1770 * update testListAuthorizedUdfFunc	5 years ago
ZHAOLIPAN	68f736953b	fix typos (#1821 )	5 years ago
qiaozhanwei	b9ac6d66f1	fix #1775 bug，delete process definition when process instance is running (#1776 ) * remove LogViewServiceGrpc.java file and pom modify * remove kazoo * remove kazoo * remove kazoo * remove common monitor package * add license * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * install.sh remove python kazoo * add system param whether repeat running * remove kazoo modify * BusinessTimeUtils remove whther repeat running inner param * add AccessTokenMapperTest UT * CI UT yml modify，start postgresql and zookeeper by default * add AlertGroupMapperTest UT in github action * Conflicts reslove * AlertMappert UT modify * AlertMappert UT modify * AlertMappert UT modify * CommandMapperTest UT modify * DataSourceMapperTest UT modify * fix #1775 bug，delete process definition when process instance is running * verifyTenantIsNull remove process definnition id print log	5 years ago
gabry.wu	88b022cb57	ITaskQueue should have "hasTask" function (#1744 ) * issue https://github.com/apache/incubator-dolphinscheduler/issues/1742 * remove unnecessary catch * fix exception type * fix bad code smell * remove log exceptions * catch exception	5 years ago
DK.Pino	aa715e17bf	remove lombok dependency(last) (#1771 )	5 years ago
bao liang	e0e0696b4f	add out put log when master/worker server start (#1769 ) * merge hadoop.properties into common.properties * merge hadoop,zookeeper.properties into common.properties remove combined.properties/master.properties/worker.properties * change db user/pwd to test/test * rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh remove some unused in install.sh * add out put log when master/worker server start... * add start log when servers start	5 years ago
Yelli	963ed4a8c6	ds.server & ds.common.zk regularize log print (#1754 )	5 years ago
gabry.wu	0a39f1a4dd	why not invoke checkWorkerGroup in advance (#1747 ) * issue https://github.com/apache/incubator-dolphinscheduler/issues/1743 * issue https://github.com/apache/incubator-dolphinscheduler/issues/1743	5 years ago
Yelli	8125974c61	ds.server regularize log print (#1751 ) * ds.server regularize log print * log print modify * log print modify * modify lang3 to lang	5 years ago
Yelli	7762a62270	add null check in SubProcessTaskExecThread (#1737 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments * fix bug sonar: add null check in daghelper && add hashcode method in ProcessData * fix bug sonar: add null check in daghelper * CollectionUtils.isEmpty() * add hashcode() && null check * merge if * remove hashcode * remove e.getMessage	5 years ago
Yelli	7ecd38f7d6	fix sonar bug: change condition & not enough arguments (#1692 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments	5 years ago
Tboy	884237487c	remove commons-lang3 dependancy, using common-module instead for server module (#1698 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy * remove commons-collections4/commons-logging/commons-io dependancy * tmp add commons-lang3 for compile * remove commons-lang3 dependancy, using common-module instead * remove common StringUtils instead of lang3 * add tmp lang3 for compile	5 years ago

1 2 3

129 Commits (e0389aebf6416c90f31ec0f6a4ff5a5d94cfecfb)