DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
Aaron Wang	08335b1032	[Improvement][Task] Improved way to collect yarn job's appIds (#12197 ) * Provide aop way as an optional way to collect yarn job's applicationId, and import new module `dolphinscheduler-aop` to place the aop code. * Add user property `appId.collect` for user to decide how to collect applicationId. * Add new environment configuration for each type of yarn tasks to support aop in `dolphinscheduler_env.sh` * Update docs to declare how to use aop way. * Update `LogUtils` to support fetch applicationId in different ways based on the user property. Co-authored-by: gabrywu <gabrywu@apache.com>	2 years ago
Yann Ann	ed209bdf82	[Refactor] Migrate all workergroup-related interface functions from ProcessServiceImpl (#12493 ) * Migrate all workergroup-related interface functions from ProcessServiceImpl	2 years ago
HanayoZz	489e7fe4e2	[Feature-10495][Resource Center] Resource Center Refactor (#12076 ) * resource center refactor - S3 services connection Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Yann Ann	04aa125ba2	[Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. (#12505 ) * migrate some task DAO to dao modules. * Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/repository/impl/ProcessInstanceMapDaoImpl.java Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
rickchengx	233bbdb09e	[Fix-12451][k8s] Read the kubeconfig from cluster conf (#12452 )	2 years ago
Wenjun Ruan	a0d37fc7ae	Set tenantDir permission (#12486 )	2 years ago
caishunfeng	dedff70f90	[Improvement] Merge spi.utils into common.utils (#12502 ) * improve JSONUtil * merge spi.utils into common.utils * split constants && remove some copy utils method * remove StringUtils	2 years ago
Yann Ann	b936b882bb	[Refactor] Migrate all command-related interface functions from ProcessServiceImpl (#12474 ) * migrate all command-related interface functions to CommonService	2 years ago
fuchanghai	f0a34cddec	[improvement-#12416] Use CollectionUtils.isEmpty judge the collection isEmpty to avoid NPE (#12449 )	2 years ago
Yann Ann	0eef2e3e10	[Improvement][Style] Fix code style of ProcessScheduleTask and ProcessServiceImpl (#12447 )	2 years ago
Eric Gao	d46e4659d9	[Improvement][Style] Fix remaining style errors and wildcard imports (#12412 ) * Fix remaining style errors and wildcard imports * Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link * Fix spotless matching scope of markdown files	2 years ago
rickchengx	97edc7d652	[Fix-12356][k8s] fix the null exception when submitting k8s task plugin (#12358 )	2 years ago
Kerwin	a8e23008ac	Fix timing scheduling trigger master service report to get command parameter null pointer exception (#12419 )	2 years ago
houshitao	934d6d21eb	[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. (#12384 )	2 years ago
Eric Gao	2f37da0dbc	[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311 ) * move mockito dependencies from sub-modules to root pom * Add check in CI to block the usage of powermock	2 years ago
Yann Ann	b357781df2	[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363 )	2 years ago
fuchanghai	22103f975e	[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328 ) * [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module Co-authored-by: Jackie <‘2875334588@qq.com’>	2 years ago
kezhenxu94	db1d319159	Reorganize some classes in common module, remove duplicate classes (#12321 )	2 years ago
Jiajie Zhong	0e1c8d8153	[Feature][API] New restful API task and task relation (#12116 )	2 years ago
rickchengx	05099bd8f7	[Improvement-12296][Test] Close static mock (#12300 )	2 years ago
Eric Gao	9ab79e064c	[Improvement][Test] Fully remove the usage of powermock from the whole project (#12244 ) * Fully remove the usage of powermock from the whole project * Upgrade org.reflections to 0.10.12	2 years ago
Yann Ann	c87f6d89a4	[fix#12195] Change date to timestamp to support cross diff time zones (#12239 ) * fix DS support cross time zone, use timestamp replace date	2 years ago
caishunfeng	40090d459e	[Improvement] remove log-server and server module (#12206 ) * remove log-server module * remove dolphinscheduler-server module	2 years ago
Wenjun Ruan	aacabc6ec7	Remove workerGroup in registry (#12217 )	2 years ago
fuchanghai	e27c79974d	[fix-#11753] send alert error alert data id (#11774 ) * [fix-#11753] send alert error alert data id Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>	2 years ago
Eric Gao	d1e409e9a2	[Improvement][Test] Remove powermock in service and server modules (#12164 ) * Remove powermock and refactor some related code in dolphinscheduler-service and dolphinscheduler-server modules * Remove redundant comments * Add null check	2 years ago
xuhhui	6466cc7c41	[Improvement][Master] Construct processInstance may NPE when master handling command (#12056 ) * [Improvement][Master] Construct processInstance may NPE when master handling command * use an enpty map Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>	2 years ago
Wenjun Ruan	fba5a8eaa0	Fix insert command error due to the id is not null (#12092 )	2 years ago
Wenjun Ruan	26dad5e2a8	Fix update TaskDefinition error (#12060 )	2 years ago
insist777	5b384f3fab	[Feature-11473][Task]Support test task (#11670 ) * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * [improve] support test tasks * Update TaskExecuteThread.java * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * try solve e2e q * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update DataSource.java * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages_zh_CN.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * Update messages.properties * Update messages_en_US.properties * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks * [Feature] support test tasks	2 years ago
Wenjun Ruan	d833a28b2e	Fix cannot save processDefinition (#11931 )	2 years ago
Wenjun Ruan	d3a77c68e6	Make LogServiceClient Singleton (#11777 )	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
caishunfeng	f8d46a26c1	[Feature-11530] add state history for process instance (#11757 ) * [Feature] add state history for process instance (#97) * add state history for process instance * upsertProcessInstance * remove unuse method * fix UT Co-authored-by: caishunfeng <534328519@qq.com>	2 years ago
Wenjun Ruan	67e7f88d8b	Refactor heart beat task, use json to serialize/deserialize (#11702 ) * Refactor heart beat task, use json to serialize/deserialize	2 years ago
Wenjun Ruan	03e1e6fe45	[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701 ) * Fix kill job may cause worker oom	2 years ago
Wenjun Ruan	b96d69701a	[Improvement-#11613] Add spi priority factory (#11614 ) * Add spi priority factory * Add doc * Add override log * Use lombok * Add comment	2 years ago
Wenjun Ruan	4d13a5104b	Fix kill task failed will cause the taskGroup cannot release and add taskGroup log (#11469 )	2 years ago
kezhenxu94	f6ef628030	Support reading application properties from kubernetes config map (#11402 )	2 years ago
JiPeng Wang	13d400ceb6	[Fix-11465] Serial first, the last executing instance will be stopped (#11466 ) * Serial first, the last executing instance will be stopped * ut fix	2 years ago
Wenjun Ruan	7ff34c3947	[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost (#11368 ) * Add waiting strategy to support master/worker can recover from registry lost * throw exception when zookeeper registry start failed due to interrupted	2 years ago
longtb	be66035dee	[Improvement] Avoid using search in for and start using testSaveTaskDefine (#11383 ) * [Improvement] Avoid using search in for and start using testSaveTaskDefine() * [Improvement] not import * Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>	2 years ago
Wenjun Ruan	5fa3e7b1ed	Add pause to task instance status (#11390 )	2 years ago
caishunfeng	0464123c2b	[Feature-11223] support stream task (#11350 ) * add task execute type * update task definition list paging * update task instance list paging * stream task start * [Feature][UI] Some changes to execute task. * Set the connection edge to dashed line. * Add FLINK_STREAM task. * add stream task * flink savepoint and cancel * fix query bug * add stream task definition * add task instance for stream task * delete stream task definition state * update api for stream task definition edit * modify search for stream task instance * add language * delete task type search for stream task definition * change task type search for stream task instance * add jump button * add savepoint * add down log for stream task instance * ui test * stream task start * run DAG * [Fix][UI] Fix the stream task edgs not to be dashed when filling back. * [Feature][UI] Remove some fields for FLINK_STREAM. * add start modal * add dryRun column for stream task instance * fix duration * fix pon * fix build error * Add success tip * add auto sync for stream task instance * remove forgien key for task instance * license header * UT fix * modify locales * recover common config * fix UT * add doc Co-authored-by: Amy <amywang0104@163.com> Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Wenjun Ruan	8774415197	Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340 )	2 years ago
Wenjun Ruan	acd3d3fab1	Fix TaskGroup cannot work and will cause master dead loop (#11254 ) * Fix TaskGroup cannot work and will cause master dead loop * Remove acquireTaskGroupAgain in ProcessServiceImpl	2 years ago
Wenjun Ruan	8e21c38c00	Write alert result into db (#11221 )	2 years ago
JinYong Li	e5cca0e79b	[Fix-11007] [Master] fix forced_success bug (#11088 ) * fix forced_success bug * add comments * add transactional * refactor code Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>	2 years ago
Wenjun Ruan	5e9c7dad23	Add dolphinscheduler-bom to manage the dependency version (#11025 )	2 years ago

1 2 3 4 5 ...

449 Commits (4f95f639c941cfae7ed97d5ef4efc3e740e7b96f)