DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Wenjun Ruan	24ff70dc88	Fix out parameter may loss (#15617 )	4 months ago
Wenjun Ruan	5b6b0ceb31	Fix resource file usage(Delete Resource/ResourceUser which is deprecated) (#15355 )	6 months ago
chenrj	ce11674668	Fix k8sTaskExecutionContext setting configYaml (#15116 ) * fixed the issue of obtaining kubeConfig of k8s tasks * removed excess files * removed excess files * formatted the code --------- Co-authored-by: xiangzihao <460888207@qq.com> Co-authored-by: Aaron Wang <wangweirao16@gmail.com>	7 months ago
Wenjun Ruan	71ee1f0c3d	Support parse task output params under multiple log (#15244 )	7 months ago
chenrj	c532fea00e	[Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977 )	8 months ago
fuchanghai	f90eadd40f	[feature-#14449] add secret in k8s Task (#14930 ) * [feature-#14449] add secret * [feature-#14449] upgrade UT and rename parameter ```secret``` * [feature-#14449] fix UT * [feature-#14449] fix UT * [feature-#14449] improvement * [feature-#14449] format --------- Co-authored-by: fuchanghai <‘2875334588@qq.com’>	9 months ago
Wenjun Ruan	e6d94632b9	Add WorkflowExecuteContext (#14544 )	12 months ago
Aaron Wang	0b69236b04	[Feature-14251][Task] Support yarn queue definition in yarn task (#14310 )	12 months ago
Aaron Wang	65b6a4b097	[Feature-14421][K8S Task] Configurable image pull policy (#14426 )	1 year ago
JieguangZhou	e7cdc7c136	[Feature][Task Plugin] Add Dynamic task to generate dynamic worklfows with list parameters (#14127 ) * add dynamic task plugin * fix ui * update code * add DOC * ADD UT * fix doc * fix sanity check * add upgrade ddl * fix sql	1 year ago
Aaron Wang	4e78248238	[Feature][K8S Task] support node selector (#14126 ) * feat: support K8S node selector * fix CI	1 year ago
Kerwin	8315279620	[Feature-#14148][Task] Added status check interval and dependent failure policy parameters for dependent task nodes (#14150 ) * Added a dependent task failure policy in the dependent task node	1 year ago
Aaron Wang	c3809fbecf	[Improvement-13868][K8S Task] Support the custom labels for k8s task (#14067 ) * [Improvement-13868] Support the custom labels for k8s task * fix front-end type mismatched	1 year ago
Aaron Wang	3bad68a942	[Bug-13929][K8S Task] Set command contains single quote is invalid (#13930 ) * [Fix-13929][K8S Task] Set command contains single quote is invalid * fix UT	1 year ago
Wenjun Ruan	aef5524ee7	Clearer task runnable. (#13689 ) * Clean unused method in AbstractTask * Kill task by process.destroy * wait 5/s after destroy process	1 year ago
JieguangZhou	16b193454b	[Improvement][Task Plugin] Support Task Plugin output response as a parameter (#13529 ) * support http output response as param * add UT * fix sqoop UT	1 year ago
seedscoder	8d12dc0702	[Improvement-13491] Use lombok @Slf4j annotation to generate logger (#13509 )	1 year ago
Aaron Wang	560d232cbd	[Bug][Worker] Fix duplicated key bug when have out parameters of same name (#12930 )	2 years ago
rickchengx	3c31ddfd9f	[Improvement-12536][k8s] Support the command for the container in k8s task plugin (#12538 )	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
zhuxt2015	e6832220c3	[Improvement][SQL Task]use default sql segment separator (#10869 )	2 years ago
rickchengx	08a4c7981f	[improve] Remove the spark version of spark task (#11860 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
caishunfeng	f95cdd350a	reduce task dependencies (#11731 )	2 years ago
Wenjun Ruan	a41c6824fc	Add dependent task instance log (#11541 ) * Add dependent task instance log * Optimize log * Fix dependent task initialize failed will throw exception	2 years ago
caishunfeng	818648df7d	[Bug-11071] fix local params (#11184 ) * fix local params * add CI case	2 years ago
chuxing	427c58546c	[fix][plugin]: fix spark sql use custom parma. (#10821 ) * [fix][plugin]: fix spark sql use custom parma. * [fix][plugin] roll back part of the code Co-authored-by: huaangcg <huangcg@getui.com>	2 years ago
kezhenxu94	d80cf21456	Clean up unused dependencies and packaging issues (#9944 )	2 years ago
Kerwin	0e7c98d465	[Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements (#9917 ) * Support sql segmentation to execute multiple functions.	2 years ago
Tq	04d4e4e0c4	fix the OUT direct param could pass to the current script (#9463 )	2 years ago
caishunfeng	b285ccf930	[Future-9396]Support output parameters transfer from parent workflow to child work flow (#9410 ) * [Future-9396]Support output parameters transfer from parent workflow to child work flow * fix note	2 years ago
nobolity	037692517a	[Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319 ) * feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser) * fix(server): fix the udf serialize * fix(master task): update the udfTest to update the json string * fix(test): update the udfFuncTest * fix(common): syn the common.properties * fix(udfTest): upgrade the udfTest * fix(common): revent the common.properties	2 years ago
Tq	2a4fa9cdb1	[BUG][WORKER-9349]fix param priority (#9379 ) * fix param priority * fix params priority code logic	2 years ago
caishunfeng	852597c9bf	[Bug-9070][Server]fix taskExecutionContext json convert error (#9072 ) * [Bug-9070][Server]fix taskExecutionContext json convert error * test * add license header Co-authored-by: caishunfeng <534328519@qq.com>	2 years ago
Kerwin	a1bef43981	[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584 ) * Task plug-in optimization, task-related classes are migrated to the task plugin module * remove tasktype enum class. * fix code style. * fix code style * fix code style * fix ProcessServiceTest.testUpdateResourceInfo test class * fix code style * fix test task plugin manager check parameters null * fix test ut * update aws license * change TaskTimeoutStrategy class	2 years ago

36 Commits (e3fdb1a3ff8831275ce2e46d0ae9d481305b3c23)