DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
OS	e34c65d5a6	[Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6095 ) * [Feature-4355][Master-Worker-API] improvements of master and scheduler module (#6085) * master refactor: 1. spi for task submit and other actions(pause, kill) 2. remove threads for process instance and task instance. 3. add events for process instance and task instance * ut npe * add try catch * code style * fix critical bugs * fix critical bugs * fix critical bugs * fix critical bugs	3 years ago
wangxj3	2e1768aae6	[Feature-#5273][server-master] Task node of SWITCH (#5922 ) Co-authored-by: wangxj <wangxj31>	3 years ago
Squidyu	1401c2e5f7	[Fix-5886][server] Enhanced scheduler delete check (#5936 ) * Add:Name verification remove the first and last spaces. * Update: wrong word: 'WAITTING' ->'WAITING' * Add: Strengthen verification Co-authored-by: Squid <2824638304@qq.com>	3 years ago
Yao WANG	efad0ed2ba	correct the wrong annotion from zk queue implemented to java priority blocking queue (#5906 ) Co-authored-by: ywang46 <ywang46@paypal.com>	3 years ago
wen-hemin	596821a5b6	[Improvement][Api Module] refactor registry client, remove spring annotation (#5814 ) * fix: refactor registry client, remove spring annotation * fix UT * fix UT * fix checkstyle * fix UT * fix UT * fix UT * fix: Rename RegistryCenterUtils method name Co-authored-by: wen-hemin <wenhemin@apache.com>	3 years ago
wangxj3	6df58e8d78	[Feature-#5565][Master Worker-Server] Global Param passed by sense dependencies (#5603 ) * add globalParams new plan with varPool * add unit test * add python task varPoolParams Co-authored-by: wangxj <wangxj31>	4 years ago
Kirs	f508788689	[BUG-#5678][Registry]fix registry init node miss (#5686 )	4 years ago
Shiwen Cheng	93f1d4df7d	[Improvement-5405][Docker/K8s] Adapt to registry SPI (#5681 )	4 years ago
Squidyu	664206cb81	wrong word: 'WAITTING' ->'WAITING' (#5682 ) * Add:Name verification remove the first and last spaces. * Update: wrong word: 'WAITTING' ->'WAITING' Co-authored-by: Squid <2824638304@qq.com>	4 years ago
kyoty	75813e7866	[bug fix] Some password attributes can be viewd directly in the log (#5638 ) * fix the password display incorrectly * update * update * fic code style fic code style * Update SensitiveDataConverterTest.java * Update SensitiveDataConverter.java * Update SensitiveDataConverter.java * Update SensitiveDataConverterTest.java * Update pom.xml	4 years ago
zhuangchong	e2d6265e26	[Improvement][registry-plugin] Optimize registry plugin loading and initial installation #5635	4 years ago
Kirs	e2243d63be	[Feature-#3961][Registry]Registry-SPI (#5562 ) [Feature#3961]Registry SPI All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD The registry supports distributed locks. todo: The specific information about the registration center of the API module needs to be adjusted.	4 years ago
Chouc	75be09735a	[DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588 ) * Close spring context to destory beans that has running thread	4 years ago
Shiwen Cheng	a5a0c7c5f8	[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571 )	4 years ago
ruanwenjun	842c5400e6	[Improvement][Server] Must restart master if Zk reconnect (#5210 ) (#5211 )	4 years ago
ruanwenjun	a925f64571	[Feature][api] schedule add timezone support #5259 (#5465 ) * [Feature][api] schedule add timezone support #5259 * import moment-timezone * fix code smell	4 years ago
JinyLeeChina	515fa4912e	[Feature][JsonSplit] Fix ProcessService ut (#5435 ) * Fix ProcessService ut * codeStyle * Fix AlertPlugin ut * Fix AlertPlugin ut * Fix server module ut * Fix server module ut * Fix api ut * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
zhuangchong	9c77faa8ac	[Improvement-5058][Master] The master-server creates the DB data source twice (#5139 ) * reduce the number of data sources created twice by master server. * update ProcessAlertManagerTest test class to increase coverage. * add DolphinSchedulerPluginLoaderTest test ignore. Co-authored-by: zhuang chong	4 years ago
JinyLeeChina	847865fba6	[Feature][JsonSplit] Fix dao ut (#5433 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev * fix process lineage bug * fix codeStyle for json_split * Fix dao ut * Fix dao ut * codeStyle * modify postgreSQL * fix TaskInstanceMapper ut * fix ProjectMapper ut * fix ProcessDefinitionDao ut * datasource * fix postgreSQL Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	2a44cb9de6	[Feature][JsonSplit] update codeStyle for merge to dev (#5392 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	c3558965c1	update taskParams/add task delayTime/fix conditionType bug (#5385 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	db96bf2dfe	[Feature][JsonSplit] Fix batchMove of processDefinition bug (#5371 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path * Fix dependTask bug * Fix batchMove of processDefinition bug * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	862565a7c7	[Feature][JsonSplit] Fix dependTask bug (#5360 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path * Fix dependTask bug Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wanghong1314	e12a26289b	【BUG-5328】 modify process contain depend task is always running (#5344 ) Co-authored-by: wanghong1314 <wanghong1@onething.net>	4 years ago
JinyLeeChina	d60f31bcf3	[Feature][JsonSplit] update processDefinite from processInstance (#5325 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	49b234609a	update SnowFlake (#5321 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
luoyuan	513eb76919	[Improvement-5147][Service]This judgment always returns true (#5156 ) * this expression which always evaluates "true" * delete unused variables * LogClientService add AutoCloseable * reformat code * reformat code * reformat code * add log in ProcessService * reformat code * Optimize the code * Optimize the code * [improvement]modify all methods that refer to LogClientService in the code. * delete unused code	4 years ago
QuakeWang	5ef1f731b7	Update PeerTaskInstancePriorityQueueTest.java (#5314 ) change `TaskInstance taskInstanceMediumPriority = createTaskInstance("high", Priority.MEDIUM);` to `TaskInstance taskInstanceMediumPriority = createTaskInstance("medium", Priority.MEDIUM);`	4 years ago
JinyLeeChina	f7a06a033d	[Feature][JsonSplit] Fix master/worker about shellTask (#5300 ) * Fix quoted bug about processDefineId of processInstance * Fix master/worker about shellTask * codeStyle * codeStyle * update taskType * codeStyle * update timeoutNotifyStrategy * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wangxj3	6dbbf6d55d	fix bug of If start a process instance form fail node or stop node ,the param will be init. (#5267 ) Co-authored-by: wangxj <wangxj31>	4 years ago
wenjun	f3dfaacca2	[Improvement][Service] Optimize query log (#5205 ) * [Improvement][Service] Optimize query log * remove IPUtils	4 years ago
Shiwen Cheng	1c1f6663a6	[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select (#5182 ) * [Improvement][Server] Optimize and reduce database and ZooKeeper query * [Improvement][WorkerGroup] Replace worker address input with multiple-select * [Improvement][WorkerGroup] Fix unit test * [Improvement][API&UI] Optimize long host to short host and long host display in k8s	4 years ago
JinyLeeChina	645847c096	Fix quoted bug about processDefineId of processInstance (#5263 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Bruce Lau	3e64f43138	[Test-4124][service] Add the testCreateCommand test of ProcessService Class (#5257 ) * [uint test] Improve code test coverage of ProcessService class * [Test-4124][service] Add the testCreateCommand test of ProcessService Class Co-authored-by: liuziying <liuziying@longfor.com>	4 years ago
JinyLeeChina	31188ffca0	[Feature][JsonSplit] Fix taskInstance (#5246 ) * Fix dependency failure * Fix taskInstance * task instance list page * code review * fix logger path Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
wen-hemin	cc82a98f50	[FixBug][JsonSplit] dag show bugs (#5226 ) * fix: dag show bugs * fix: code format * fix: code format * fix: code format Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
JinyLeeChina	a8f2894b79	[Feature][JsonSplit] Fix master/processInstance bug (#5206 ) * transform taskCode from long to string * fix process bug * code review * code review * code review * Fix master/processInstance bug Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
bao liang	86ce8f133a	[JsonSplit-4417][master/worker/api]json split- remove json in task instance. (#5160 ) * [json split] refactor json in task instance * add task_pramas in task_instance * feature #4417 refactor json split in task instance * code style * code style * code style * code style * code style * update * update * update unit test * update	4 years ago
JinyLeeChina	dd36da8d1f	[Feature][JsonSplit] fix process bug (#5193 ) * transform taskCode from long to string * fix process bug * code review * code review * code review Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	689106d114	transform taskCode from long to string (#5174 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	a467fffd7b	[Feature][JsonSplit] fix taskId in json (#5165 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" * fix taskId in processDefinitionJson * fix json taskId * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Simon	cd19507271	[feature][jsonsplit]fix copy/export/import processDefinition bugs (#5146 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add ProcessServiceTest * 1 * 1 * fix copy/export/import processDefinition bugs * 1 * codestyle	4 years ago
Simon	3c9b214da7	[Feature][jsonsplit]add ProcessServiceTest (#5097 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add ProcessServiceTest * 1 * 1	4 years ago
wen-hemin	e53367bdcc	[Feature][JsonSplit] task page, rename field "description" to "desc" (#5137 ) * fix: task page, rename "description" to "desc" * fix: The default value of field dependence is null. * fix: frontend compile check Co-authored-by: wen-hemin <wenhemin@apache.com>	4 years ago
JinyLeeChina	1eaf1f6234	[Feature][JsonSplit] fix taskId in processDefinitionJson (#5136 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" * fix taskId in processDefinitionJson Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Shiwen Cheng	0d065c0712	[Feature-5062][] Create/Edit/Delete Worker Group in Web UI (#5113 ) [Improvement][Server] Rename MASTER_PREFIX to MASTER_TYPE and WORKER_PREFIX to WORKER_TYPE * [Feature][Api&Dao] Support api and dao of worker group * [Feature][UI] Support to create, edit and delete worker group * [Feature][API&UI] Support work groups from database and zookeeper to display together in worker group management * [Feature][API&Dao] Support long ip list and check request parameters when saving worker group * [Feature][] Refactor ipList to addrList [Feature][Server] Support host manager to select worker host by worker group in database * [Improvement][Server] Improve the config of master and worker * [Improvement][] Rename zkRegistered to systemDefault [Improvement][Test] Fix unit test and improve ui * [Improvement][Server] Improve getServerMaps Co-authored-by: dailidong <dailidong66@gmail.com>	4 years ago
JinyLeeChina	d99934d0da	[Feature][JsonSplit] Fix api bug (#5102 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
zhuangchong	ba039dc252	[Improvement][dao] Resource features SQL slow query optimization. (#4947 ) * Resourse features SQL slow query optimization. * update resource mapper queryResourcePaging method. * split resource and resource_uesr sql statement. * determine the size of the collection. * update process service class code style. * update ResourceUserMapper java class code style. * add resourceUserMapper in the test config file. * solve code smell * split paging query join statement. * update ResourceUserMapper class. * remove sql join statement. * update resource test class code style. * update ResourcesServiceTest test class. * rerun ut. * update user service test class. * solve query resource list method code smell.	4 years ago
wangxj3	29d42fd92d	[Feature-#3805][server-master] Task parameter transfer (#5077 ) * fix out param format bug Co-authored-by: wangxj <wangxj31>	4 years ago
Shiwen Cheng	5856a12855	[Improvement-4984][Worker] Refactor and Improve worker load balance (#4996 ) * [Improvement][Remote] Improve unit tests * [Improvement][Worker] Improve worker load balance * [Improvement][Worker] Fix code smells * [Improvement][Worker] Rename weight to hostWeight	4 years ago

1 2 3 4 5

210 Commits (e34c65d5a676ad4ff9b8eca5c5446d578b0b39b3)