DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Kirs	30c88032d3	[Feature-#3961][Registry]Registry-SPI (#5562 ) [Feature#3961]Registry SPI All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD The registry supports distributed locks. todo: The specific information about the registration center of the API module needs to be adjusted.	4 years ago
JinyLeeChina	a561a618af	[Feature][JsonSplit-api] api of processDefinition create/update (#5602 ) * processDefinition create/update * fix codeStyle * fix codeStyle * fix ut Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Kirs	e2243d63be	[Feature-#3961][Registry]Registry-SPI (#5562 ) [Feature#3961]Registry SPI All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD The registry supports distributed locks. todo: The specific information about the registration center of the API module needs to be adjusted.	4 years ago
Shiwen Cheng	a5a0c7c5f8	[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571 )	4 years ago
ruanwenjun	f8ecb536b7	[Improvement][Alert] server down will send repetitive message #5525 (#5529 ) * [Improvement][Alert] server down will send repetitive message #5525 * add ut	4 years ago
Shiwen Cheng	b537f4eb26	[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393 ) * [Improvement][Docker] Support more configurations and improve image for python * [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations * [Improvement][Python] Improve the compatibility of python home * [Improvement][Install] Fix install config and install.sh * [Improvement][Install] Fix workflow ut * [Improvement][Docker] Optimize docker-swarm/check script * [Improvement][DB] Update default username and password of database * Update comments in master/worker.properties * Specify version for all images * [Improvement][Docker] Optimize PS1 and WORKDIR * [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh * [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS	4 years ago
zhuangchong	1b7dcea610	[Improvement-5440][Maven] Project module maven dependency optimization (#5441 ) * Optimize dependencies between modules. * update module-alert dependency. * add repository in the pom xml. * update Central Repository in the pom.xml.	4 years ago
Yao WANG	bc22ae7c91	[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492 ) * remove the depreated data quality module * fix lint Co-authored-by: Yao <ywang46@paypal.com>	4 years ago
ruanwenjun	a925f64571	[Feature][api] schedule add timezone support #5259 (#5465 ) * [Feature][api] schedule add timezone support #5259 * import moment-timezone * fix code smell	4 years ago
JinyLeeChina	847865fba6	[Feature][JsonSplit] Fix dao ut (#5433 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev * fix process lineage bug * fix codeStyle for json_split * Fix dao ut * Fix dao ut * codeStyle * modify postgreSQL * fix TaskInstanceMapper ut * fix ProjectMapper ut * fix ProcessDefinitionDao ut * datasource * fix postgreSQL Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	363426de71	[Feature][JsonSplit] fix process lineage bug (#5418 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev * fix process lineage bug Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
ruanwenjun	71f39fa875	[Improvement][Dao] Database add connection check (#5408 ) (#5409 )	4 years ago
ruanwenjun	0bdf15efb9	[Improvement][DAO] Add Unique key in t_ds_alertgroup and t_ds_datasource (#5373 ) * [Improvement][DAO] Add Unique key to t_ds_worker_group t_ds_datasource * Add exception catch * add ddl * fix ut	4 years ago
Shiwen Cheng	0f3eed9d00	[Fix-5386][Alert] Fix ERROR: relation t_ds_plugin_define does not exist (#5387 )	4 years ago
JinyLeeChina	2a44cb9de6	[Feature][JsonSplit] update codeStyle for merge to dev (#5392 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	c3558965c1	update taskParams/add task delayTime/fix conditionType bug (#5385 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Shiwen Cheng	6b8461e901	Revert "[Improvement][DAO] CreateDolphinScheduler (#5357 ) (#5358 )" (#5383 ) This reverts commit `b108ac43b8`.	4 years ago
ruanwenjun	e6d8da484f	[Improvement][API] Create Datasource #5083 (#5116 ) * [Improvement][API] Create Datasource #5083 * Refact create/ update datasource API * fix Code Smells * fix code smell * resolve code smell * use ConnectionParam to replace BaseDatasource * solve license * add ut * code check * add ut * fix ut coverage * fix ut	4 years ago
ruanwenjun	b108ac43b8	[Improvement][DAO] CreateDolphinScheduler (#5357 ) (#5358 ) * [Improvement][DAO] Create CreateDolphinScheduler (#5357) * add ut * fix code smell	4 years ago
JinyLeeChina	862565a7c7	[Feature][JsonSplit] Fix dependTask bug (#5360 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path * Fix dependTask bug Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Wenjun	5f1fc462c9	[Bug][server-api] copy the node ,the preTasks is error #5261 (#5264 )	4 years ago
JinyLeeChina	49b234609a	update SnowFlake (#5321 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	f7a06a033d	[Feature][JsonSplit] Fix master/worker about shellTask (#5300 ) * Fix quoted bug about processDefineId of processInstance * Fix master/worker about shellTask * codeStyle * codeStyle * update taskType * codeStyle * update timeoutNotifyStrategy * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wen-hemin	784b3550b2	fix: The instance page DAG does not display bug (#5298 ) Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
fanwq	87588ca9f7	fix bug:delete the user ,the project list of admin will lost the projects of this user #5301 (#5302 )	4 years ago
mrproliu	b6453da298	Remove useless table fields (#5284 ) Co-authored-by: dalekliuhan <dalekliuhan@didiglobal.com>	4 years ago
JinyLeeChina	645847c096	Fix quoted bug about processDefineId of processInstance (#5263 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	31188ffca0	[Feature][JsonSplit] Fix taskInstance (#5246 ) * Fix dependency failure * Fix taskInstance * task instance list page * code review * fix logger path Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wen-hemin	556c37155b	[Feature][JsonSplit] When create the process instance, save the field "locations" and "connects" (#5248 ) * fix: dag show bugs * fix: code format * fix: code format * fix: code format * fix: When create the process instance, save the field "locations" and "connects" Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
wen-hemin	cc82a98f50	[FixBug][JsonSplit] dag show bugs (#5226 ) * fix: dag show bugs * fix: code format * fix: code format * fix: code format Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
bao liang	86ce8f133a	[JsonSplit-4417][master/worker/api]json split- remove json in task instance. (#5160 ) * [json split] refactor json in task instance * add task_pramas in task_instance * feature #4417 refactor json split in task instance * code style * code style * code style * code style * code style * update * update * update unit test * update	4 years ago
wenjun	f20bb54896	[Improvement][API] Improvement query all project list (#5169 ) (#5192 )	4 years ago
zhuangchong	e53369318b	[Fix-4721][worker]The shell background starts the YARN task scenario, and the kill function is abnormal (#4722 ) * fix the shell starts the yarn task in the background * update StringUtils code style. * solve code smell. * add method comment in StringUtils class. * update AlertGroupMapper code style. * update AlertGroupMapperTest * update sql script test.	4 years ago
JinyLeeChina	689106d114	transform taskCode from long to string (#5174 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wen-hemin	f960eacdcd	[FixBug][Jsonsplit] sql condition bug #4417 (#5171 ) * fix: task page, rename "description" to "desc" * fix: The default value of field dependence is null. * fix: frontend compile check * fix: When create process, the version button is set to unavailable * fix: sql condition bug Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
Simon	3c9b214da7	[Feature][jsonsplit]add ProcessServiceTest (#5097 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add ProcessServiceTest * 1 * 1	4 years ago
Simon	21b7b77d50	[Feature][JsonSplit]fix modifyBy field (#5112 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add ProcessServiceTest * 1 * 1 * fix modifyBy field * 1 * ut fix	4 years ago
wenjun	5d264c9f20	[Improvement][Api] Optimize query processInstanceList #5134 (#5135 ) * Batch query user rather than several query	4 years ago
Shiwen Cheng	0d065c0712	[Feature-5062][] Create/Edit/Delete Worker Group in Web UI (#5113 ) [Improvement][Server] Rename MASTER_PREFIX to MASTER_TYPE and WORKER_PREFIX to WORKER_TYPE * [Feature][Api&Dao] Support api and dao of worker group * [Feature][UI] Support to create, edit and delete worker group * [Feature][API&UI] Support work groups from database and zookeeper to display together in worker group management * [Feature][API&Dao] Support long ip list and check request parameters when saving worker group * [Feature][] Refactor ipList to addrList [Feature][Server] Support host manager to select worker host by worker group in database * [Improvement][Server] Improve the config of master and worker * [Improvement][] Rename zkRegistered to systemDefault [Improvement][Test] Fix unit test and improve ui * [Improvement][Server] Improve getServerMaps Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
Kirs	f109a758f8	[Bug][PGSQL] Delete the stopped workflow without deleting the correspon… (#5066 ) * [Bug][Api] Delete the stopped workflow without deleting the corresponding sub process, the workflow instance name is not displayed in the sub process * fix ut * fix ut err * sql style * fix error	4 years ago
JinyLeeChina	d99934d0da	[Feature][JsonSplit] Fix api bug (#5102 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
zhuangchong	ba039dc252	[Improvement][dao] Resource features SQL slow query optimization. (#4947 ) * Resourse features SQL slow query optimization. * update resource mapper queryResourcePaging method. * split resource and resource_uesr sql statement. * determine the size of the collection. * update process service class code style. * update ResourceUserMapper java class code style. * add resourceUserMapper in the test config file. * solve code smell * split paging query join statement. * update ResourceUserMapper class. * remove sql join statement. * update resource test class code style. * update ResourcesServiceTest test class. * rerun ut. * update user service test class. * solve query resource list method code smell.	4 years ago
wenjun	086e716441	[Improvement][Dao] SQL optimization - check exist #5069 (#5070 )	4 years ago
zhuangchong	705715c313	[Improvement-5059][API] Verify that the new workflow definition version is the current version before removing it #5059 (#5060 ) * this process definition version is used, not allowed to delete. * update ProcessDefinitionVersionServiceTest test class. * update check has associated process definition sql.	4 years ago
Ts686	6216817861	[Improvement-4971][alert\|dao\|service]Remove redundant PropertyUtils.class (#5020 ) * [Improvement][alert\|dao\|service] 1. Remove redundant PropertyUtils.class (#4971) 2. Remove useless import package. * [Improvement][alert\|dao\|service] 1. Remove redundant PropertyUtils.class (#4971) 2. Remove useless import package. * [Improvement][alert\|dao\|service] 1. Remove redundant PropertyUtils.class (#4971) 2. Remove useless import package. * [Improvement][alert\|dao\|service] 1. Remove redundant PropertyUtils.class (#4971) 2. Remove useless import package.	4 years ago
Simon	00dcc3f78e	[Feature][jsonsplit]add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest (#5047 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest	4 years ago
JinyLeeChina	d98c2c5cfe	[Feature][JsonSplit] Fix bug in interface of queryProcessDefinitionList (#5043 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Kirs	6bf5031f45	[FIX] fix MySQL datasource jdbc connect parameters (#4851 ) * [FIX-CVE-2020-11974] fix MySQLDataSource Security * remove useless code * add ut * A more reasonable way * code style * fix test error * code style * update exception msg	4 years ago
Simon	22ec6c069d	[Feature][jsonsplit]Refactor process lineage (#5034 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage	4 years ago
Simon	c4d9ceffd1	[Feature][jsonsplit]add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix (#5012 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle	4 years ago

... 2 3 4 5 6 ...

608 Commits (f1a3c52a66eb8dec1f853b9c9a02b88cdebbd0dc)