DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
qiaozhanwei	373423ae40	mapper add Transactional and rollback	4 years ago
Tboy	c61c59ae54	Refactor worker (#2186 ) * let quartz use the same datasource * move master/worker config from dao.properties to each config add master/worker registry test	4 years ago
qiaozhanwei	8b990b5c1c	java doc error modify (#2004 ) * 1, master persistent task 2. extract master and worker communication model * 1, master persistent task 2. extract master and worker communication model * 1, master persistent task 2. extract master and worker communication model * add license * modify javadoc error * TaskExecutionContext create modify * buildAckCommand taskInstanceId not set modify * java doc error modify	4 years ago
zixi0825	3f044e7771	#2282 fix workflow dependent bug (#2329 ) * fix workflow dependent bug * fix workflow dependent bug 2 * fix workflow dependent bug 2 Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
Rubik-W	668b86f12b	fix：Optimize content returned by interface (#2294 )	4 years ago
lgcareer	82d6dc9e52	new feature for #404 add resource tree function (#2323 ) * add create resource directory * add create resource directory * update the resource test * add upgrade sql in version 1.2.2 * Adding request parameter id to update queryResourceListPaging * set isDirectory value is false default * add full name to update updateResource * remove request parameter isDirectory to update createResource method * update queryResourceListPaging with change get to post * update updateResource method with remove fullName * File management list modification (#1976) * add resource component * add resource tree visitor * return json string * update queryResourceList * upload file need fullName * add method rootNode * Shell task resources and authorization resources (#1989) * File management list modification * Shell task resources and authorization resources * download resource when execute task * download resource when execute task * update authorization type * download resource when execute task * Spark task resource changes (#1990) * File management list modification * Shell task resources and authorization resources * Spark task resource changes * download resource when execute task * update udf function service * add resource type in ResourceComponent * UDF resource tree and change DAG style (#2019) * File management list modification * Shell task resources and authorization resources * Spark task resource changes * UDF resource tree and change DAG style * add deleteIds method in ResourceMapper and ResourceMapperTest * Add comments on class and method * add queryResourceByName method in controller * update verify-name with change name to full name * update queryResource with add parameter pid * update queryResource with add parameter pid * add resource ids in process definition and delete resource need judge whether it is used by any process definition * Breadcrumb development (#2033) * File management list modification * Shell task resources and authorization resources * Spark task resource changes * UDF resource tree and change DAG style * Breadcrumb development * Breadcrumb development * Resource tree bug fix (#2040) * File management list modification * Shell task resources and authorization resources * Spark task resource changes * UDF resource tree and change DAG style * Breadcrumb development * Breadcrumb development * Resource tree bug fix * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * Fix github action rerun failed (#2067) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * Change crumb position * Change crumb position (#2068) * build resource process definition map * UDF changed to multiple choice * UDF changed to multiple choice (#2077) * Change crumb position * UDF changed to multiple choice * build resource process definition map (#2076) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * build resource process definition map * update resource name also need update all the children full name * need add queryResource * update resource name also need update all the children full name (#2096) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * build resource process definition map * update resource name also need update all the children full name * need add queryResource * Limit customization file content to no more than 3000 lines * Limit customization file content to no more than 3000 lines(#2128) * Limit customization file content to no more than 3000 lines(#2128) (#2140) * Change crumb position * UDF changed to multiple choice * Limit customization file content to no more than 3000 lines * Limit customization file content to no more than 3000 lines(#2128) * add queryResourceJarList * add queryResourceJarList * add queryResourceJarList * add queryResourceJarList (#2192) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * build resource process definition map * update resource name also need update all the children full name * need add queryResource * add queryResourceJarList * add queryResourceJarList * add queryResourceJarList * Modify the main jar package * Modify the main jar package (#2200) * Change crumb position * UDF changed to multiple choice * Limit customization file content to no more than 3000 lines * Limit customization file content to no more than 3000 lines(#2128) * Modify the main jar package * add resource filter in order to get filtered resource * add comments of resource filter * update list children by resource * choose main jar with resource tree (#2220) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * build resource process definition map * update resource name also need update all the children full name * need add queryResource * add queryResourceJarList * add queryResourceJarList * add queryResourceJarList * add resource filter in order to get filtered resource * add comments of resource filter * update list children by resource * Return null if query resource list is empty * update queryResource method change parameter pid to id * getResouDelete checksum and modify parameter namerceId * revert .env * remove parameter pid * Delete request interface * go back to the last page * jar interface call * Fix issue #2234 and #2228 * change resource name with full name * Fix issue #2234 and #2228 (#2246) * update resource service test * Fix github action rerun failed * add status of PARENT_RESOURCE_NOT_EXIST * build resource process definition map * update resource name also need update all the children full name * need add queryResource * add queryResourceJarList * add queryResourceJarList * add queryResourceJarList * add resource filter in order to get filtered resource * add comments of resource filter * update list children by resource * Return null if query resource list is empty * update queryResource method change parameter pid to id * revert .env * remove parameter pid * Fix issue #2234 and #2228 * change resource name with full name * Fix list query value error * remove unauth-file with authorize-resource-tree * Repair data cannot be echoed * Repair data cannot be echoed * execute mr and spark task need query resource name before * Authorized resource interface replacement * Authorized resource interface replacement * Filter UDF resources * Change parameters * need query all authorized directory children when create task * Change normalize.scss import method and animation.scss license modification * Delete file list update processing * It's fixed that resource not deleted in hdfs when delete it. * add tooltips * add tooltips (#2310) * Echo workflow name and modify udf management name * [new feature]add resource tree function * revert front code in order to be same as dev branch * revert front code in order to be same as dev branch * revert common.properties and application.properties * add super method * update flink parameter test * update flink parameter and unit test * update resource service test * If resource list is empty,need init it * update flink parameter test Co-authored-by: break60 <790061044@qq.com> Co-authored-by: xingchun-chen <55787491+xingchun-chen@users.noreply.github.com> Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>	4 years ago
gabry.wu	30b98b89a2	Adapting partial code(file name start with T) to the sonar cloud rule (#2271 )	4 years ago
tswstarplanet	0c5ff32797	Decouple DruidDataSource in ConnectionFactory and cache DataSource instance (#2232 ) * Decouple DruidDataSource in ConnectionFactory and cache DataSource instance * init dataSource first * fix code smell * add unit test * add unit test * add unit test * add unit test * fix unit test * delete useless logger	4 years ago
gabry.wu	a1f7614476	Adapting partial code(file name start with W) to the sonar cloud rule (#2287 )	4 years ago
gabry.wu	afa9a6467a	Adapting partial code(file name start with Q) to the sonar cloud rule (#2242 )	4 years ago
gabry.wu	e1771de45a	Adapting partial code(file name start with R) to the sonar cloud rule (#2243 )	4 years ago
John Liu	4898447236	Optimizing code (#2240 ) * updated * optimized the code * Delete ParameterUtils.java * rollback source code * rollback source code * rollback source code Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
tswstarplanet	5a74b8bbf5	Refactor ConnectionFactory to static inner holder Singleton (#2204 ) * refactor ConnectionFactory to static inner holder Singleton * remove redundant import * make getSqlSessionFactory() method private * fix sonar issue * remove @Ignore of MailUtilsTest * add MailUtilsTest to pom.xml to test * fix MailUtilsTest path error in pom.xml * modify test method name * add assert and logger to unit test * add log * add log * add AlertDaoTest * move AlertDaoTest to new module * modify test in pom.xml * remove unnecessary log	4 years ago
gabry.wu	015a8ca269	Adapting partial code(file name start with M #2 ) to the sonar cloud rule (#2179 ) * Adapting partial code(file name start with M #2) to the sonar cloud rule * remove unused import	4 years ago
tswstarplanet	1d4cad7913	fix ResultSet not close and reformat code (#2183 ) * fix ResultSet not close * fix ResultSet not close * extract code of closing resource to a method * remove redundant if condition * modify e2e timeout	4 years ago
gabry.wu	2f4fda7cdb	Adapting partial code(file name start with M #1 ) to the sonar cloud rule (#2173 ) * Adapting partial code(file name start with M #1) to the sonar cloud rule * remove unused import	4 years ago
gabry.wu	610c95a470	use static method in static class JSON (#2156 )	4 years ago
gabry.wu	156533ad5e	Adapting partial code(file name start with H) to the sonar cloud rule (#2145 )	4 years ago
gabry.wu	6a8cef08e4	Adapting partial code(file name start with E) to the sonar cloud rule (#1999 ) * Adapting partial code(file name start with E) to the sonar cloud rule * remove isEmpty invoke * resolve conflicts	4 years ago
gabry.wu	fdc9e0090b	remove incorrect or unnecessary URL tag (#2099 )	4 years ago
dailidong	4230d5a737	add embedded database h2 and update embedded zookeeper (#2082 ) add embedded database h2 and update embedded zookeeper	5 years ago
qiaozhanwei	3e5a939913	delete unused import (#2066 )	5 years ago
qiaozhanwei	b8014d91cf	add workflow id, name for email content (#2071 ) * add tenantService UT * fix spell * #464 email content * modify mysql1.2.2 ddl	5 years ago
Yelli	84409b57ee	fix taskinstance.isSubprocess misjudgment (#2007 ) * add processInstanceService UT * fix taskInstance.isSubProcess add processInstanceService UT * add taskInstance.isSubProcess UT * modify taskInstance.isSubProcess UT * add license * remove author&date	5 years ago
Yelli	619fb30c50	#1310 add executor user to the process instance & task instance pages (#1973 ) * add executor name in processDefinitionInstance & taskInstance * modify processInstanceTest * modify processInstanceTest * #1310 add executor user to the process instance & task instance pages * add processInstanceUT & taskInstanceUT * add processInstanceUT & taskInstanceUT * modify processInstanceTest & taskInstanceTest * Remove duplicate code * add userServiceUT	5 years ago
gabry.wu	99ac739851	rename vaild to valid (#1961 )	5 years ago
qiaozhanwei	c1ee133392	Refactor Architecture Basic modification #1658 (#1946 ) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module (#1925) * 1，remove dolphinscheduler-rpc module 2，add dolphinscheduler-remote module 3，add dolphinscheduler-service module 4，refactor LoggerServer module * ProcessUtils modify * Refactor architecture (#1926) * move version to parent pom * move version properties to parent pom for easy management * remove freemarker dependency * delete CombinedApplicationServer * #1871 correct spelling * #1873 some updates for TaskQueueZkImpl * #1875 remove unused properties in pom * #1878 1. remove tomcat dependency 2. remove combined_logback.xml in api module 3. format pom.xml for not aligning * #1885 fix api server startup failure 1. add jsp-2.1 dependency 2. remove jasper-runtime dependency * add stringutils ut (#1921) * add stringutils ut * Newfeature for #1675. (#1908) Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell. * Add modify user name for process definition (#1919) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql * refactor module * updates Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com> * dolphinscheduler-common remove spring (#1931) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * SpringApplicationContext class title add license (#1932) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * add license (#1934) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * Refactor architecture (#1936) * move datasource classes to dao module * fix send4LetterWord bug * LoggerServiceTest remove ProcessDao (#1944) * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * dolphinscheduler-common remove spring * LoggerServiceTest remove ProcessDao * exclude jasper-compiler in case of runtime conflict (#1938) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * DataAnaylysisServiceTest and ProcessDefinitionService modify * remote module add comment * OSUtilsTest modify * add finally block to close channel (#1951) * move datasource classes to dao module * fix send4LetterWord bug * exclude jasper-compiler in case of runtime conflict * add finally block to close channel Co-authored-by: Tboy <technoboy@yeah.net> Co-authored-by: khadgarmage <khadgar.mage@outlook.com> Co-authored-by: zhukai <boness@qq.com> Co-authored-by: Yelli <amarantine@my.com>	5 years ago
Yeleights	6c90575a39	add process null check Remove duplicate code in processDefinitionService add processDefinitionService UT	5 years ago
gabry.wu	44b76468a8	Adapting partial code(file name start with C) to the sonar cloud rules (#1918 ) * Adapting partial code(file name start with C) to the sonar cloud rules * add some UT * add some UT(rollback JSONUtils.checkJsonVaild) * add some UT(fix OSUtils.exeCmd UT)	5 years ago
Yelli	d937a6ae94	Add modify user name for process definition (#1919 ) * class overrides equals() and should therefore also override hashCode() * #1862 add modify user in process difinition list * #1862 add pg-1.2.2 ddl.sql * modify ScriptRunnerTest * add updateProessDifinition UT * modify updateProcessDifinition UT * modify updateProcessDifinition UT * modify mysql 1.2.2 ddl.sql&dml.sql * add scope test to mysql in pom * modify pg-1.2.2 ddl.sql	5 years ago
zhangzy	0eec3b8661	Remove useless code	5 years ago
zhangzy	6b586f31fc	pom add ut， add cronutils ut	5 years ago
zhangzy	a09d2d9d0a	add CronUtils ut	5 years ago
zhangzy	9d944d3f76	Optimize duplicate code Use public methods to simplify duplicate code	5 years ago
liwenhe1993	30db5c1467	Api module relp server module/1756 (#1766 ) * Remove server module on api module 1. Remove server module and add dao module. 2. Move quartz in server module to dao module. 3. Update config and class. to resolve conflicts，I deleted CombinedApplicationServer.java Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
Jave-Chen	c522ea7ebb	Fix bug: NullPointerException etc. (#1721 ) * #1720 Fix bug: NullPointerException etc. * fix code smell * Update DateInterval.java refactor equals method Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
老佛爷	1c77708a89	Supplementary data by schedule (#1830 ) * Supplementary data by schedule * fix sonar check bug * fix code duplicated blocks * ut * loop by day * MasterExecThread test * test add licene Co-authored-by: dailidong <dailidong66@gmail.com>	5 years ago
lgcareer	779672ec2a	[Fix issue #1770 ]check udf and data source in order to fix issue 1770 (#1826 ) * check udf and data source in order to fix issue 1770 * check udf and data source in order to fix issue 1770 * update testListAuthorizedUdfFunc	5 years ago
qiaozhanwei	b9ac6d66f1	fix #1775 bug，delete process definition when process instance is running (#1776 ) * remove LogViewServiceGrpc.java file and pom modify * remove kazoo * remove kazoo * remove kazoo * remove common monitor package * add license * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * install.sh remove python kazoo * add system param whether repeat running * remove kazoo modify * BusinessTimeUtils remove whther repeat running inner param * add AccessTokenMapperTest UT * CI UT yml modify，start postgresql and zookeeper by default * add AlertGroupMapperTest UT in github action * Conflicts reslove * AlertMappert UT modify * AlertMappert UT modify * AlertMappert UT modify * CommandMapperTest UT modify * DataSourceMapperTest UT modify * fix #1775 bug，delete process definition when process instance is running * verifyTenantIsNull remove process definnition id print log	5 years ago
zjcnb	a96e17ea4e	Remove @Data annotation and add @TableField annotation (#1653 ) * remove @Data * Modify the test class * remove assert * Add hashcode method and equals method for AccessToken class * remove code * add ut test	5 years ago
DK.Pino	aa715e17bf	remove lombok dependency(last) (#1771 )	5 years ago
bao liang	e0e0696b4f	add out put log when master/worker server start (#1769 ) * merge hadoop.properties into common.properties * merge hadoop,zookeeper.properties into common.properties remove combined.properties/master.properties/worker.properties * change db user/pwd to test/test * rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh remove some unused in install.sh * add out put log when master/worker server start... * add start log when servers start	5 years ago
DK.Pino	343434b294	remove lombok dependence in dao module (#1735 )	5 years ago
Yelli	13d5a5ae9b	fix bug sonar: add null check in daghelper (#1719 ) * modify FileUtils.readFile2Str * #1300 Add right alignment function in sql email content * cancel formatted for alert_mail_template.ftl * #747 sql task password Log desensitization * cancel mail_temple * edit ExcelUtils * modify test method name * #747 sql task password Log desensitization * #1544 workflow import * Constants add DATASOURCE_PASSWORD_REGEX * #747 sql task password Log desensitization * deal with import project have sub process * modify export process addTaskNodeParam method name * add testAddTaskNodeSpecialParam UT * add ProcessDefinitionServiceTest-ut to pom * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportSubProcess in ProcessDefinitionServiceTest * add testImportProcessDefinition * fix sonar bug: not enough arguments * fix sonar bug: change condition & not enough arguments * fix bug sonar: add null check in daghelper && add hashcode method in ProcessData * fix bug sonar: add null check in daghelper * CollectionUtils.isEmpty()	5 years ago
Jave-Chen	36e244297d	Fix bug : Use try-with-resources or close this "ResultSet" in a "finally" clause (#1689 ) * #1688 Fix bug : Use try-with-resources or close this "ResultSet" in a "finally" clause * replace while to if where possible * merge TaskRecordDao.java from dev	5 years ago
Yelli	3593a60374	fix sonar bug: change condition & not enough arguments (#1705 )	5 years ago
Yelli	216154dc06	fix sonar bug: null check & clean throw exception (#1690 ) * fix sonar bug: null check & clean throw exception * fix sonar bug: null check & clean throw exception	5 years ago
Tboy	a9cd31eca6	remove commons-lang3 and commons-lang dependancy for Dao module (#1663 ) * remove commons-lang3 dependancy * remove commons-lang3 and commons-lang dependancy	5 years ago
DK.Pino	30dd867acb	remove lombok depend in dao dodule (#1683 )	5 years ago
qiaozhanwei	b73979360e	DataSourceMapperTest UT modify #1465 (#1642 ) * remove LogViewServiceGrpc.java file and pom modify * remove kazoo * remove kazoo * remove kazoo * remove common monitor package * add license * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * remove kazoo modify * install.sh remove python kazoo * add system param whether repeat running * remove kazoo modify * BusinessTimeUtils remove whther repeat running inner param * add AccessTokenMapperTest UT * CI UT yml modify，start postgresql and zookeeper by default * add AlertGroupMapperTest UT in github action * Conflicts reslove * AlertMappert UT modify * AlertMappert UT modify * AlertMappert UT modify * CommandMapperTest UT modify * DataSourceMapperTest UT modify	5 years ago

1 2 3

128 Commits (8d46953599c4d1fad0ded0a2657764415642b11d)