houshitao
934d6d21eb
[Bug] [Service] Use MapUtils to judge globalParamsMap is empty. ( #12384 )
2 years ago
Eric Gao
2f37da0dbc
[Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom ( #12311 )
...
* move mockito dependencies from sub-modules to root pom
* Add check in CI to block the usage of powermock
2 years ago
Yann Ann
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules ( #12363 )
2 years ago
fuchanghai
22103f975e
[improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module ( #12328 )
...
* [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module
Co-authored-by: Jackie <‘2875334588@qq.com’>
2 years ago
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
Jiajie Zhong
0e1c8d8153
[Feature][API] New restful API task and task relation ( #12116 )
2 years ago
rickchengx
05099bd8f7
[Improvement-12296][Test] Close static mock ( #12300 )
2 years ago
Eric Gao
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project ( #12244 )
...
* Fully remove the usage of powermock from the whole project
* Upgrade org.reflections to 0.10.12
2 years ago
Yann Ann
c87f6d89a4
[fix#12195] Change date to timestamp to support cross diff time zones ( #12239 )
...
* fix DS support cross time zone, use timestamp replace date
2 years ago
caishunfeng
40090d459e
[Improvement] remove log-server and server module ( #12206 )
...
* remove log-server module
* remove dolphinscheduler-server module
2 years ago
Wenjun Ruan
aacabc6ec7
Remove workerGroup in registry ( #12217 )
2 years ago
fuchanghai
e27c79974d
[fix-#11753] send alert error alert data id ( #11774 )
...
* [fix-#11753] send alert error alert data id
Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>
2 years ago
Eric Gao
d1e409e9a2
[Improvement][Test] Remove powermock in service and server modules ( #12164 )
...
* Remove powermock and refactor some related code in dolphinscheduler-service and dolphinscheduler-server modules
* Remove redundant comments
* Add null check
2 years ago
xuhhui
6466cc7c41
[Improvement][Master] Construct processInstance may NPE when master handling command ( #12056 )
...
* [Improvement][Master] Construct processInstance may NPE when master handling command
* use an enpty map
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
Wenjun Ruan
fba5a8eaa0
Fix insert command error due to the id is not null ( #12092 )
2 years ago
Wenjun Ruan
26dad5e2a8
Fix update TaskDefinition error ( #12060 )
2 years ago
insist777
5b384f3fab
[Feature-11473][Task]Support test task ( #11670 )
...
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* [improve] support test tasks
* Update TaskExecuteThread.java
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* try solve e2e q
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update DataSource.java
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages_zh_CN.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* Update messages.properties
* Update messages_en_US.properties
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
* [Feature] support test tasks
2 years ago
Wenjun Ruan
d833a28b2e
Fix cannot save processDefinition ( #11931 )
2 years ago
Wenjun Ruan
d3a77c68e6
Make LogServiceClient Singleton ( #11777 )
2 years ago
caishunfeng
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2 years ago
kezhenxu94
efedc9a53c
Bump up dependencies to fix cves ( #11765 )
2 years ago
caishunfeng
f8d46a26c1
[Feature-11530] add state history for process instance ( #11757 )
...
* [Feature] add state history for process instance (#97 )
* add state history for process instance
* upsertProcessInstance
* remove unuse method
* fix UT
Co-authored-by: caishunfeng <534328519@qq.com>
2 years ago
Wenjun Ruan
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize ( #11702 )
...
* Refactor heart beat task, use json to serialize/deserialize
2 years ago
Wenjun Ruan
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11701 )
...
* Fix kill job may cause worker oom
2 years ago
Wenjun Ruan
b96d69701a
[Improvement-#11613] Add spi priority factory ( #11614 )
...
* Add spi priority factory
* Add doc
* Add override log
* Use lombok
* Add comment
2 years ago
Wenjun Ruan
4d13a5104b
Fix kill task failed will cause the taskGroup cannot release and add taskGroup log ( #11469 )
2 years ago
kezhenxu94
f6ef628030
Support reading application properties from kubernetes config map ( #11402 )
2 years ago
JiPeng Wang
13d400ceb6
[Fix-11465] Serial first, the last executing instance will be stopped ( #11466 )
...
* Serial first, the last executing instance will be stopped
* ut fix
2 years ago
Wenjun Ruan
7ff34c3947
[Feature-7024] Add waiting strategy to support master/worker can recover from registry lost ( #11368 )
...
* Add waiting strategy to support master/worker can recover from registry lost
* throw exception when zookeeper registry start failed due to interrupted
2 years ago
longtb
be66035dee
[Improvement] Avoid using search in for and start using testSaveTaskDefine ( #11383 )
...
* [Improvement] Avoid using search in for and start using testSaveTaskDefine()
* [Improvement] not import *
Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
2 years ago
Wenjun Ruan
5fa3e7b1ed
Add pause to task instance status ( #11390 )
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
Wenjun Ruan
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus ( #11340 )
2 years ago
Wenjun Ruan
acd3d3fab1
Fix TaskGroup cannot work and will cause master dead loop ( #11254 )
...
* Fix TaskGroup cannot work and will cause master dead loop
* Remove acquireTaskGroupAgain in ProcessServiceImpl
2 years ago
Wenjun Ruan
8e21c38c00
Write alert result into db ( #11221 )
2 years ago
JinYong Li
e5cca0e79b
[Fix-11007] [Master] fix forced_success bug ( #11088 )
...
* fix forced_success bug
* add comments
* add transactional
* refactor code
Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2 years ago
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
caishunfeng
65d2b8f14e
[Bug] fix task params pass ( #11053 )
2 years ago
Mr.An
d7df899909
[Fix-11003]Task group queue is not updated to final state ( #11004 )
...
* fix after the task group is forced to start the task. Task group status has not changed
2 years ago
Wenjun Ruan
083ab2b5c9
Remove dao in worker ( #10994 )
2 years ago
Wenjun Ruan
2be1d4bf0a
Fix worker cannot shutdown due to resource close failed or heart beat check failed ( #10979 )
...
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed
* Move heartbeat error threshold to applicaiton.yml
2 years ago
WangJPLeo
2397423eb6
Solve transaction problems under multi-threading ( #10917 )
2 years ago
Wenjun Ruan
2a67866718
Catch exception when check state in StateWheelExecuteThread ( #10908 )
...
* Catch exception when check state
2 years ago
Wenjun Ruan
f639a2eed4
[Fix-10854] Fix database restart may lost task instance status ( #10866 )
...
* Fix database update error doesn't rollback the task instance status
* Fix database error may cause workflow dead with running status
2 years ago
Wenjun Ruan
3f69ec8f28
[Fix-10842] Fix master/worker failover will cause status incorrect ( #10839 )
...
* Fix master failover will not update task instance status
* Add some failover log
* Fix worker failover will rerun task more than once
* Fix workflowInstance failover may rerun already success taskInstance
2 years ago
Wenjun Ruan
426567348e
Remove quartz in service ( #10748 )
...
* Remove quartz in service
2 years ago
Wenjun Ruan
67d14fb7b3
[Fix-10785] Fix state event handle error will not retry ( #10786 )
...
* Fix state event handle error will not retry
* Use state event handler to deal with the event
2 years ago
WangJPLeo
b7fbf6c4ad
[API] Do not specify rollback for ensure in case of any exception or error. ( #10793 )
2 years ago
zhuxt2015
182b9c9b26
[Feature][Master] Failover workflow instance base on priority ( #10754 )
...
* failover workflow instance base on priority
2 years ago
Wenjun Ruan
35a10d092f
[Fix-10666] Workflow submit failed will still in memory and never retry ( #10667 )
...
* Workflow submit failed will still in memory and never retry
2 years ago