DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
qianli2022	ff065d8e5b	[Feature][Improvement] Support multi cluster environments - k8s type (#10096 ) * service code * [Feature][UI] Add front-end for cluster manage * fix e2e * remove comment on cluster controller * doc * img * setting e2e.yaml * test * rerun e2e * fix bug from comment * Update index.tsx use Nspace instead of css. * Update index.tsx Remove the style. * Delete index.module.scss Remove the useless file. Co-authored-by: qianl4 <qianl4@cicso.com> Co-authored-by: William Tong <weitong@cisco.com> Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>	2 years ago
陈家名	b86dc53ad1	[fix][Python] Support same task name in project defferent process definition (#10428 ) close: #10431	2 years ago
WangJPLeo	9782fe4e7c	[Fix-10367] Permission check related key adjustment. (#10368 ) * Permission check related key adjustment. * resource create or upload fix. * Analysis Permission fix. * Ut coverage add. * rerun * source permission fix. * ut coverage is achieved * Reference permission package path modification * k8s path bug fix. * k8s path bug fix. * Corrected controller method name and rerun.	2 years ago
xiangzihao	b1fb17119b	[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373 )	2 years ago
WangJPLeo	e3e39cbdea	[Fix] Privilege Reconstruction Data Query Fix & Resource Creation Post Oper… (#10313 ) * Privilege Reconstruction Data Query Fix & Resource Creation Post Operations. * Resource Retry * e2e retry * create project log add * project list query log add * clean project log * delete delay * delete delay * remove post handle * project e2e * browser refresh * browser refresh * e2e fix * e2e browser refresh * rowk flow e2e fix * mapper deduplication * udf e2e * e2e	3 years ago
kezhenxu94	d80cf21456	Clean up unused dependencies and packaging issues (#9944 )	3 years ago
Wenjun Ruan	3a9e67325e	Fix database initialize late in standalone. (#10296 )	3 years ago
WangJPLeo	a4948f58e6	[Feature][Permission] Reconstruction of permissions of resource center and monitoring center. (#10307 ) * Reconstruction of permissions of resource center and monitoring center. * clear local logs. * resource query fix	3 years ago
hstdream	53ab6f7b92	[Feature][API] Modify the permissions of project management, security center, data source center and data quality module. (#10289 ) * Resource userName is null * [Fix-10082]Resource userName is null and udf function manager add a username * [Fix-10082]Resource userName is null and udf function manager add a username * [Fix-10082]Resource userName is null and udf function manager add a username * [Feature][API] Modify the permissions of project management, security center, data source center and data quality module. * [Feature][API] Modify the permissions of project management, security center, data source center and data quality module. * [Feature][API] Modify the permissions of project management, security center, data source center and data quality module. Co-authored-by: houshitao <shitaohou@163.com>	3 years ago
WangJPLeo	7ac8ea493c	[Feature][Permission] Project management module authority control refactoring, authority abstract interface setting. (#10261 ) * Create process definition with task group and task group priority cannot be save into db * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * [Feature][API] Permission control of project * The result of the assertion cannot be changed. The only difference is the judgment condition. * test recovery. * controller test fix. * ProjectE2ETest fix. * WebElement import. * Prioritize problem solving. * Judging the length of the set fix Co-authored-by: houshitao <shitaohou@163.com> Co-authored-by: hstdream <33045461+hstdream@users.noreply.github.com>	3 years ago
Jiajie Zhong	d8db2b57d2	[fix] Task group queue query all list error (#10237 ) Add support query all task queue by not given specific groupId close: #10102	3 years ago
longtb	bd34e66b8a	[Fix-10076] queryUserByToken use server timezone (#10177 ) * [Fix-10076] queryUserByToken use server timezone * [Fix-10076] queryUserByToken use server timezone	3 years ago
BaoLiang	ee2b855ced	[BUG][TaskGroup] Task group does not take effect (#10093 ) * fix 10092: Task group does not take effect * fix 10092: Task group does not take effect * fix 10092: Task group does not take effect	3 years ago
hstdream	701b535ae6	[Fix-10082]Resource userName is null and udf function manager add a username (#10064 ) * Resource userName is null * [Fix-10082]Resource userName is null and udf function manager add a username * [Fix-10082]Resource userName is null and udf function manager add a username * [Fix-10082]Resource userName is null and udf function manager add a username Co-authored-by: houshitao <shitaohou@163.com>	3 years ago
hstdream	cd70ad584a	Create process definition with task group and task group priority cannot be save into db (#10078 ) Co-authored-by: houshitao <shitaohou@163.com>	3 years ago
qianli2022	bc1c15b142	[Feature-8252][doc] K8s and namespace manager docs and web page update (#9881 ) * test * test * doc * fix image error * fix * Update docs/docs/en/guide/security.md * Update docs/docs/en/guide/security.md * Update docs/docs/en/guide/security.md * Update docs/docs/zh/guide/security.md * fix doc Co-authored-by: qianl4 <qianl4@cicso.com> Co-authored-by: William Tong <weitong@cisco.com> Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago
Jiajie Zhong	316b611826	[chore] Combine version 206 and 210 sql upgrade to 300 (#9959 )	3 years ago
WangJPLeo	fb0f96ed94	[Fix-9868] A task flow definition isolates the runs of different execution strategies by version numbers. (#9869 ) * The thread cache task flow definition should get the latest version. * Coverage on New Code * Coverage on New Code * Coverage on New Code * use an existing method. * Increase unit test coverage. * Task flow definitions enforce policy isolation.	3 years ago
Town	fcb32e4c3c	[fix] fix query access token for specified user failed (#9855 )	3 years ago
WangJPLeo	ab2d535e54	The node ID under serial is greater than the current ID. (#9820 ) Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>	3 years ago
caishunfeng	70dae6945f	revert delete dumplicate task_definition_log ddl (#8567 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
leiwingqueen	c837580c68	[bug][db] Table relation_project_user have duplicate record (#9536 ) * update sql ddl * fix syntax err	3 years ago
WangJPLeo	f839b527bf	Task group queue supports fuzzy search. (#9784 )	3 years ago
WangJPLeo	5c0be8a3d7	A task instance that normally queries the serial wait state. (#9777 ) Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>	3 years ago
WangJPLeo	7bcec7115a	[Fix-9717] The failure policy of the task flow takes effect (#9718 ) * Failure policy takes effect. * Coverage on New Code * correct description logic * Compatible with all scenarios * clearer logic Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>	3 years ago
yimaixinchen	fb11525e49	[chore] Correct the java doc in funtion DagHelperTest generateDag2 (#9602 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago
naziD	10f8c9d983	[Bug-9608] Serialize the task definition failed (#9622 ) * BugFix: serialize the task definition failed * Remove a comment Co-authored-by: lipandong <pandong.lpd@alibaba-inc.com>	3 years ago
Eric Gao	a863c6f8f1	[Bug][DAO] Update db init script and soft_version (#9628 ) (#9637 )	3 years ago
WangJPLeo	ae84900329	[Fix-9617]New task group project name drop-down data is displayed according to user type. (#9625 ) * New task group project name drop-down data by user type * remove unused import * avoid import * Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>	3 years ago
qianli2022	165d7aa51f	[Feature][Task] K8s namespace auth manager (#9303 ) * k8s auth * remove log * fix test * use constants * use constants K8S_LOCAL_TEST_CLUSTER * simple auth get * change test * add namespace authorize in user page * prettier code * change test data Co-authored-by: qianl4 <qianl4@cicso.com> Co-authored-by: William Tong <weitong@cisco.com>	3 years ago
xiangzihao	a3bf10c88d	[Feature][API] Refactor get dependent node information api (#9591 ) * feature_8922 * fix comment error * remove unused import * fix unused import	3 years ago
Tq	c5b7e5adff	[Bug] [API-9558]fix homepage task instance count method to use submit time to recount (#9559 ) * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method JUNIT * fix homepage task instance count method JUNIT * fix homepage task instance count method JUNIT	3 years ago
WangJPLeo	b1d57dbce4	Check the status of the child process when the parent process is running (#9567 ) Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>	3 years ago
Tq	1192fb8e12	fix Fault tolerance warning mapper add alert type to insert (#9533 )	3 years ago
WangJPLeo	95ccc0c855	[Fix-9516] [Statistics] Statistics Manager shows data should belongs to current user (#9515 )	3 years ago
czeming	706cdb6a8e	[Fix-9174] [Alert] Fix deduplication of alarm information (#9371 ) * feat(issue #9174): Fix-9174	3 years ago
Tq	fb0139e959	[Feature] [ALERT-9406]enrich alert info when insert new row into DB (#9445 ) * enrich alert info when insert new row into DB * fix comments	3 years ago
nobolity	037692517a	[Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319 ) * feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser) * fix(server): fix the udf serialize * fix(master task): update the udfTest to update the json string * fix(test): update the udfFuncTest * fix(common): syn the common.properties * fix(udfTest): upgrade the udfTest * fix(common): revent the common.properties	3 years ago
Tq	e2759a8f42	[Feature] [ALERT-9406]add new properties to alert class (#9408 ) * add new properties to Alert.java and do minor changes to comments * fix Integer to int * fix Integer to int * fix sql files * fix not null properties to default null	3 years ago
Eric Gao	fd6b43bc81	[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223 ) (#9299 )	3 years ago
worry	2bab12f2c8	[Feature-9204][alert] Implement alert send status (#9208 ) * [DS-9204][feat][alert,dao] Implement alert send status - implement alert send status - add alert send status entity、mapper - modify alert dao - modify alert sender - add test - add sql This closes #9204 * [DS-9204][feat][alert,dao] Implement alert send status - add license header This closes #9204	3 years ago
JinYong Li	85e56b5e2a	fix 9243 (#9244 )	3 years ago
worry	d3251c9bcc	[Improvement-9227][master]implement use the slot to scan the database (#9228 ) when the master assigns tasks by slot,implement use the slot to scan the database. This closes #9227	3 years ago
shuai hou	5bd8ba4268	[fix-8929][DAO]Description Failed to upload the file because the full name was too long (#9020 ) * [fix-8929][DAO]Description Failed to upload the file because the full name was too long * [DS-#8929][fix]Description Failed to upload the file because the full name was too long * [DS-#8929][fix]Description Failed to upload the file because the full name was too long * [DS-#8929][fix]Description Failed to upload the file because the full name was too long Co-authored-by: houshuai <houshuai@jiguang.cn>	3 years ago
nobolity	0e3cafec1d	[Feature-8612][RESOURCE] extend s3 to the storage of ds (#8637 ) * feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser)	3 years ago
hjli	242b5dd5b6	[Bug-8760]Resource file deletion conditions (#8765 )	3 years ago
Kerwin	a1bef43981	[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584 ) * Task plug-in optimization, task-related classes are migrated to the task plugin module * remove tasktype enum class. * fix code style. * fix code style * fix code style * fix ProcessServiceTest.testUpdateResourceInfo test class * fix code style * fix test task plugin manager check parameters null * fix test ut * update aws license * change TaskTimeoutStrategy class	3 years ago
wangyang	0d8079a816	[DS-7992][feat] Alert module judging strategy (#8636 )	3 years ago
ouyangyewei	b0ffec5a4c	to issue/#8826 (#8827 ) Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>	3 years ago
Martin Huang	b0fc6e7a69	[Feature-5752][server]Add blocking task (#6272 ) * fix python task execution error * modify code style * delete AbstractTask#setCommand * migrate blocking task alert feature and common attribute * blocking task migrate(complete base features) * migrate blocking task test * resolve TaskNode.java conflict * fix package problem in BlockingParameters * resolve duplicate code * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * resolve code style * optimise code based on pr#6283 in ds master repo * add log * modify log * resolve conflicts * change hardcode to variable * Add blocking task UI * refactor old code to compatable with the newest branch * add override annotation * remove old code * remove never used packages * add missing packages declaration * Refine the i18n description * add UT * resolve some code smell problems * add fetch-depth * enable unit test in sonar analysis * disable unit test * remove unused packages * resolve duplicate codes * add logs when task status changed and rename some variables * add BLOCK & READY_BLOCK status and corresponding processing code * revoke UI * revert unit-test Co-authored-by: Jave-Chen <baicai.chen@gmail.com>	3 years ago

1 2 3 4 5 ...

777 Commits (f9cf9331a6d9399d512302dead39880fcd59d3e2)