DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
gabry.wu	ebf7a980d2	Adapting partial code(file name start with F) to the sonar cloud rule (#2045 ) * Adapting partial code(file name start with F) to the sonar cloud rule * add more unit test * add License * add includes configuration to maven-surefire-plugin * fix getResourceFilesList incorrect logic	5 years ago
tison	9224b49b58	access field handle of FileDescriptor in ProcessImplForWin32 by reflection for portability (#2113 ) * access field handle of FileDescriptor in ProcessImplForWin32 by reflection for portability Current implementation relies on `sun.misc.JavaIOFileDescriptorAccess` which is only accessible on oraclejdk8. Basically the demand is getting & setting `handle` field of `FileDescriptor`, so we can directly do that with reflection. Though, I suspect the necessity we introduce ProcessImplForWin32. Maybe we could have a better way to support worker server to run bat script. * harden initialization of ProcessImplForWin32 * ignore ShellTaskTest#testHandleForWindows outside Windows	5 years ago
gabry.wu	ad381fcb71	move UT class to reasonable package (#2116 )	5 years ago
gabry.wu	0e1dd8d7d9	remove incorrect or unnecessary URL tag (#2099 )	5 years ago
dailidong	6070738acb	Support worker server to run bat script (#2023 ) * Support worker server to run bat script 1. Reimplement ProcessImpl.java, ProcessEnvironment.java and ProcessBuilder.java for Windows 2. Modify shell task code for windows 3. Add ASF License * Add Unit Test	5 years ago
dailidong	1f92b4c4db	Optimize ParameterUtils.curingGlobalParams() execution efficiency (#2090 ) * Optimize ParameterUtils.curingGlobalParams() execution efficiency * Remove excess null check	5 years ago
qiaozhanwei	3e5a939913	delete unused import (#2066 )	5 years ago
bao liang	0df7c6719d	[New Feature] add conditions task #205 (#2003 ) * add funtion conditions task * update conditions tasks * update conditions for ui * update conditions * update * revert * update	5 years ago
gabry.wu	5ca4862ea9	remove String.format for org.slf4j.Logger (#2001 )	5 years ago
孙朝和	3d6eee5d80	#203 add sqoop task (#1974 ) * add sqoop task * add sqoop task * add sqoop task test * add sqoop task test * add sqoop task test * modify add sqoop task test * modify sqoop task test * modify sqoop task test * modify sqoop task test * modify sqoop task test 2 * modify sqoop task test 3 * modify sqoop task test 3 * modify sqoop task test 3 * modify sqoop task test 4	5 years ago
dailidong	24f22974a2	solve jar conflict, delete servlet-api 2.5 jar (#1966 ) * update README about DolphinScheduler * Update issue templates * update * regularize api pom xml update rpc maven compile to 1.8 * regularize api pom xml * change commons.lang3.StringUtils to common.utils.StringUtils * update pom.xml * update * correct equals method * jasper-runtime is needed when api server start * jasper-runtime jar is needed when api server start * combine logback config of master/worker/alert/api server to one logback.xml * remove tomcat runtime jar * add UT * add license * remove jasper-runtime jar, not need anymore * sovle jar conflict， remove servlet-api 2.5 jar * remove servlet 2.5 Co-authored-by: DS <escheduler@outlook.com>	5 years ago
liwenhe1993	d674eaba57	Support DS to create user and group in windows environment (#1953 ) * Support DS to create user and group in windows environment * Add unit test	5 years ago
gabry.wu	99ac739851	rename vaild to valid (#1961 )	5 years ago
qiaozhanwei	c1ee133392	Refactor Architecture Basic modification #1658 (#1946 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
gabry.wu	44b76468a8	Adapting partial code(file name start with C) to the sonar cloud rules (#1918 ) * Adapting partial code(file name start with C) to the sonar cloud rules * add some UT * add some UT(rollback JSONUtils.checkJsonVaild) * add some UT(fix OSUtils.exeCmd UT)	5 years ago
xiaochun.liu	0ed6156b22	swap param	5 years ago
xiaochun.liu	980b5ae5ea	swap param	5 years ago
xiaochun.liu	17162341c3	add ResInfoTest.java ut	5 years ago
Yelli	d937a6ae94	Add modify user name for process definition (#1919 ) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql	5 years ago
khadgarmage	c447bb489f	add stringutils ut (#1921 ) * add stringutils ut	5 years ago
gabry.wu	b77dddfeef	Adapting partial code(file name start with B) to the sonar cloud rules (#1915 ) * Adapting partial code(file name start with B) to the sonar cloud rules * add @Ignore to BaseTaskQueueTest class	5 years ago
xiaochun.liu	2f33a9e2ab	delete dup code	5 years ago
xiaochun.liu	bd10b78e29	delete dup code	5 years ago
xiaochun.liu	3364a8c8a9	add script runner ut	5 years ago
Jave-Chen	b3b075d915	Fix bug: Use try-with-resources or close this "Statement" in a "finally" clause. (#1702 ) * #1701 Fix bug: Use try-with-resources or close this "Statement" in a "finally" clause. * fix some indent * refix code smell	5 years ago
dailidong	c63cd3e237	combine logback config of master/worker/alert/api server to one (#1898 ) * combine logback config of master/worker/alert/api server to one logback.xml	5 years ago
魔方不在手	f942e5ced3	[feature] data synchronization function (#1881 ) * feature：data synchronization function * feature：data synchronization function * feature：data synchronization function * fix：add license * fix：resource close bug * fix：remove class author * fix：Improve test coverage * fix：add UT * fix：add UT * fix：data sync node renamed to datax * fix：add UT * fix: UT bug * fix：Optimize variable name * fix：pom * fix：Variable name error * fix：optimize the code	5 years ago
Yelli	5169689c35	class overrides equals() and should therefore also override hashCode() (#1882 )	5 years ago
Tboy	38eaaa98e6	some updates for TaskQueueZkImpl (#1874 ) small changes, no need more people review, I will merge.	5 years ago
gabry.wu	0d5c6e4e7c	[Feature] set acquireTriggersWithinLock true (#1866 ) issue: https://github.com/apache/incubator-dolphinscheduler/issues/1863	5 years ago
liwenhe1993	30db5c1467	Api module relp server module/1756 (#1766 ) * Remove server module on api module 1. Remove server module and add dao module. 2. Move quartz in server module to dao module. 3. Update config and class. to resolve conflicts，I deleted CombinedApplicationServer.java Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
Jave-Chen	16913bacd7	fix return, obj error (#1855 )	5 years ago
Jave-Chen	c522ea7ebb	Fix bug: NullPointerException etc. (#1721 ) * #1720 Fix bug: NullPointerException etc. * fix code smell * Update DateInterval.java refactor equals method Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
lgcareer	779672ec2a	[Fix issue #1770 ]check udf and data source in order to fix issue 1770 (#1826 ) * check udf and data source in order to fix issue 1770 * check udf and data source in order to fix issue 1770 * update testListAuthorizedUdfFunc	5 years ago
ZHAOLIPAN	07f96375b3	replace strings with constants already exist. (#1825 )	5 years ago
bao liang	0b272f9ca6	[feature] #1813 remove "_001" after the master/server register path in zookeeper (#1820 ) * change master/worker register path. * remove "_" from register path.	5 years ago
ZHAOLIPAN	68f736953b	fix typos (#1821 )	5 years ago
DK.Pino	ea0caef88f	Regularize quartz.properties conf file (#1783 ) * remove lombok dependency(last) * regularize quartz.properties conf file	5 years ago
Yelli	2ec9943f64	fix bug: zk hasTask method NPE (#1785 )	5 years ago
gabry.wu	88b022cb57	ITaskQueue should have "hasTask" function (#1744 ) * issue https://github.com/apache/incubator-dolphinscheduler/issues/1742 * remove unnecessary catch * fix exception type * fix bad code smell * remove log exceptions * catch exception	5 years ago
bao liang	e0e0696b4f	add out put log when master/worker server start (#1769 ) * merge hadoop.properties into common.properties * merge hadoop,zookeeper.properties into common.properties remove combined.properties/master.properties/worker.properties * change db user/pwd to test/test * rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh remove some unused in install.sh * add out put log when master/worker server start... * add start log when servers start	5 years ago
Yelli	963ed4a8c6	ds.server & ds.common.zk regularize log print (#1754 )	5 years ago
xingchun-chen	dad643dbb5	commom/Preconditions Util Test (#1727 ) * common/parameterUtils unit test	5 years ago
Tboy	4d1abb3fc7	remove commons-lang3 dependancy (#1709 ) * remove commons-lang3 dependancy * remove commons-lang3 dependancy * remove unused import	5 years ago
khadgarmage	5f145efa6b	DependentUtils.java ut (#1703 ) * delete bytes file * DependentUtilsTest.java ut	5 years ago
Yelli	7ecd38f7d6	fix sonar bug: change condition & not enough arguments (#1692 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments	5 years ago
elonlo	cae656c1bc	uniform naming	5 years ago
Tboy	884237487c	remove commons-lang3 dependancy, using common-module instead for server module (#1698 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy * remove commons-collections4/commons-logging/commons-io dependancy * tmp add commons-lang3 for compile * remove commons-lang3 dependancy, using common-module instead * remove common StringUtils instead of lang3 * add tmp lang3 for compile	5 years ago
elonlo	c21d25edf2	Fixed tasks_queue and tasks_kill did not exist in zookeeper #1696	5 years ago
lgcareer	8090f14504	get root path from zookeeper config	5 years ago

1 2 3

139 Commits (b03e0a02c5533ac6c6dc7189cef96b7f686e5497)