DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
fuchanghai	f0a34cddec	[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449 )	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
insist777	1e11034049	[Fix][Task] Fix dependent task can not predicate the status of the corresponding task correctly (#12253 ) * [Fix][Task] dependent task can not predicate the status of the corresponding task correctly	2 years ago
simsicon	ba538067f2	[fix] Change the default unix shell executor from sh to bash (#12180 ) Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>	2 years ago
Kerwin	55004bebe0	[Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function (#12392 ) * Workflow definitions that contain logical task nodes support the copy function.	2 years ago
Yann Ann	7aa8a77fb2	[Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable	2 years ago
rickchengx	7b44612f28	[Improvement-12372][k8s] Update the deprecated k8s api (#12373 )	2 years ago
kezhenxu94	db1d319159	Reorganize some classes in common module, remove duplicate classes (#12321 )	2 years ago
Eric Gao	875682d267	[Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299 ) * Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example	2 years ago
Yann Ann	c87f6d89a4	[fix#12195] Change date to timestamp to support cross diff time zones (#12239 ) * fix DS support cross time zone, use timestamp replace date	2 years ago
冯剑	779a0b9c75	[Improvement-#11608][task-plugin] New time variables are added to facilitate business development (#11667 ) Add new time expressions for users' convenience Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com> Co-authored-by: David <dailidong66@gmail.com>	2 years ago
zhuxt2015	e6832220c3	[Improvement][SQL Task]use default sql segment separator (#10869 )	2 years ago
rickchengx	08a4c7981f	[improve] Remove the spark version of spark task (#11860 )	2 years ago
Eric Gao	66958b91d7	[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center (#11708 ) * Add support for Alibaba Cloud OSS as storage of resource center * Add dependency licenses * Refactor code, add unit tests and related docs	2 years ago
insist777	5b384f3fab	[Feature-11473][Task]Support test task (#11670 ) * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * Update TaskExecuteThread.java * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update DataSource.java * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages_zh_CN.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages.properties * Update messages_en_US.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks	2 years ago
itzhang89	511149f644	[fix-10938]: use dot to replace source and make the default env work in shell (#11625 ) * [fix-10938]: use the dot to replace source and make the default env work in the sh Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>	2 years ago
Wenjun Ruan	d3a77c68e6	Make LogServiceClient Singleton (#11777 )	2 years ago
caishunfeng	0deafba12c	fix procedure task param pass (#11919 )	2 years ago
juzimao	5d9331f4ee	[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689 )	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
caishunfeng	f95cdd350a	reduce task dependencies (#11731 )	2 years ago
Wenjun Ruan	03e1e6fe45	[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701 ) * Fix kill job may cause worker oom	2 years ago
Wenjun Ruan	1b120e3a59	Refactor worker execute task process (#11540 ) * Refactor worker execute task process	2 years ago
Wenjun Ruan	b96d69701a	[Improvement-#11613] Add spi priority factory (#11614 ) * Add spi priority factory * Add doc * Add override log * Use lombok * Add comment	2 years ago
Wenjun Ruan	a41c6824fc	Add dependent task instance log (#11541 ) * Add dependent task instance log * Optimize log * Fix dependent task initialize failed will throw exception	2 years ago
kezhenxu94	13e4720aa2	Upgrade spring boot and swagger (#11574 )	2 years ago
kezhenxu94	f6ef628030	Support reading application properties from kubernetes config map (#11402 )	2 years ago
Kerwin	b79bad19e5	[Fix-11051][Task]Fix the process exitValue exception when the process times out and th… (#11099 )	2 years ago
Wenjun Ruan	5fa3e7b1ed	Add pause to task instance status (#11390 )	2 years ago
Stalary	6345a13cdc	[Fix-10392][SqlTask]: Fix list param error when use sql task (#11285 ) * FIX: fix list param in. * FIX: code bug * FIX: fix one value * FIX: header * FIX: ci * FIX: fix ci * MOD: for review * MOD: for review	2 years ago
caishunfeng	0464123c2b	[Feature-11223] support stream task (#11350 ) * add task execute type * update task definition list paging * update task instance list paging * stream task start * [Feature][UI] Some changes to execute task. * Set the connection edge to dashed line. * Add FLINK_STREAM task. * add stream task * flink savepoint and cancel * fix query bug * add stream task definition * add task instance for stream task * delete stream task definition state * update api for stream task definition edit * modify search for stream task instance * add language * delete task type search for stream task definition * change task type search for stream task instance * add jump button * add savepoint * add down log for stream task instance * ui test * stream task start * run DAG * [Fix][UI] Fix the stream task edgs not to be dashed when filling back. * [Feature][UI] Remove some fields for FLINK_STREAM. * add start modal * add dryRun column for stream task instance * fix duration * fix pon * fix build error * Add success tip * add auto sync for stream task instance * remove forgien key for task instance * license header * UT fix * modify locales * recover common config * fix UT * add doc Co-authored-by: Amy <amywang0104@163.com> Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Wenjun Ruan	8774415197	Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340 )	2 years ago
microeastcowboy	9a53c6ac34	fix work oom when task logs's size is very large (#11224 )	2 years ago
xuhhui	bfff3a7c5d	fix error (#11206 )	2 years ago
caishunfeng	818648df7d	[Bug-11071] fix local params (#11184 ) * fix local params * add CI case	2 years ago
Wenjun Ruan	052ceaacd0	Add is success in loop task status (#11169 )	2 years ago
Wenjun Ruan	c7789bf049	Add base loop task execotor and http template parser (#11137 ) * Add base loop task execotor and http template parser * Add JsonPathUtils	2 years ago
Wenjun Ruan	5e9c7dad23	Add dolphinscheduler-bom to manage the dependency version (#11025 )	2 years ago
Eric Gao	a38fa34d43	[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925 ) * [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)	2 years ago
chuxing	427c58546c	[fix][plugin]: fix spark sql use custom parma. (#10821 ) * [fix][plugin]: fix spark sql use custom parma. * [fix][plugin] roll back part of the code Co-authored-by: huaangcg <huangcg@getui.com>	2 years ago
WangJPLeo	8f621ff98b	[Optimization] Calculate global parameter and local parameter at master. (#10704 ) * Global parameter and local parameter calculation external expansion. * k8s task ut fix. * TimePlaceholderUtils import DateUtils fix * follow the review comments to fix. * follow the review comments to fix. * e2e rerun	2 years ago
Wenjun Ruan	66624c5c86	[Bug] [Master] Worker failover will cause task cannot be failover (#10631 ) * fix worker failover may lose event	2 years ago
Wenjun Ruan	db595b3eff	Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516 ) * Optimize master log, add workflow instance id and task instance id in log * Use MDC to set the workflow info in log4j * Add workflowInstanceId and taskInstanceId in MDC	2 years ago
guodong	2c227ab384	[Feature-10363][server] S3 Resource center supports bucket customization (#10433 ) * [Feature-10363][server] S3 Resource center supports bucket customization * Modify the configuration. Sort out HDFS and S3 configurations to distinguish them * Modify the configuration comment to clarify the configuration meaning * Modify official documents to add missing configuration descriptions and clarify configuration meanings and usage * Modify the configuration file in e2E to the correct definition, dolphinscheduler-e2e/dolphinscheduler-e2e-case/src/test/resources/docker/file-manage/common.properties * Modified code to support bucket customization * Check that the bucket on personal permission, Otherwise, the startup fails * S3 increase support resource. Storage. Upload. Base. The base path path * Change S3Utils implementation style to be consistent with HadoopUtils * [Feature-10363][server] S3 Resource center supports bucket customization * Modify code review comments	2 years ago
xiangzihao	bbba20d39a	change to common lang3 and fix checkstyle (#10380 )	2 years ago
xiangzihao	b1fb17119b	[Feature-6758][Task] Add limit resource usage for tasks base on cgroup (#10373 )	2 years ago
kezhenxu94	d80cf21456	Clean up unused dependencies and packaging issues (#9944 )	3 years ago
He Zhao	5bb1eb04fc	[Feature][plugin] Add k8s task in task plugin (#9425 ) * [Feature][plugin] Add k8s task in task plugin * [Feature][plugin] fix dos and code problems * [Feature][plugin] refactor some code based on sonar * [Feature][UI] front-end for k8s task plugin * [Feature][plugin] delete some front files * [Feature][plugin] update document * Update docs/docs/zh/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * Update docs/docs/en/guide/task/k8s.md * [Feature][UI] front-end change from review comments * [Feature][UI] replace get namespace list api * [Feature][plugin] change file name * Add kubernetes to zh task list Co-authored-by: hezhao2 <hezhao2@cisco.com> Co-authored-by: William Tong <weitong@cisco.com> Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	3 years ago

1 2

100 Commits (489e7fe4e2d980031c91eac2a4823b9f1713659a)