zhuangchong
48ad9ff412
[maven-release-plugin] prepare for next development iteration
2 years ago
zhuangchong
efc0367999
[maven-release-plugin] prepare release 3.1.1
2 years ago
zhuangchong
145c5ac8cb
[maven-release-plugin] prepare for next development iteration
2 years ago
zhuangchong
525a6846ac
[maven-release-plugin] prepare release 3.1.1
2 years ago
Kerwin
94ef02e9de
cherry-pick [Improvement] Merge spi.utils into common.utils ( #12607 )
...
#12502
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
kezhenxu94
eb7b48596c
cherry-pick Reorganize some classes in common module, remove duplicate classes
...
#12321
2 years ago
sgw
d742994e62
[DS-12131][master] Optimize the log printing of the master module acc… ( #12152 )
...
* [DS-12131][master] Optimize the log printing of the master module according to the log specification.
2 years ago
Kerwin
f3277277f0
cherry-pick Refactor LogServiceClient Singleton to avoid repeat creation of NettyClient #11777 ( #12542 )
...
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
caishunfeng
7e39396a76
[maven-release-plugin] prepare for next development iteration
2 years ago
caishunfeng
ae33ba5947
[maven-release-plugin] prepare release 3.1.0
2 years ago
Wenjun Ruan
03e1e6fe45
[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11701 )
...
* Fix kill job may cause worker oom
2 years ago
Wenjun Ruan
5fa3e7b1ed
Add pause to task instance status ( #11390 )
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
Wenjun Ruan
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus ( #11340 )
2 years ago
zhuxt2015
3701a24d15
[Improvement][Task Log] Task status log print description instead of code ( #11009 )
...
* use execution status instead of status code
2 years ago
Wenjun Ruan
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
Wenjun Ruan
998e4d74dd
Kill task when we do master failover to avoid task lost ( #10997 )
2 years ago
Wenjun Ruan
cade66a9b6
[Fix-10827] Fix network error cause worker cannot send message to master ( #10886 )
...
* Fix network error cause worker cannot send message to master
2 years ago
caishunfeng
aa8b88a875
[Feature-10871] add workflow executing data query ( #10875 )
...
* add workflow executing data query
* fix sonar check for interrupted
2 years ago
Wenjun Ruan
f639a2eed4
[Fix-10854] Fix database restart may lost task instance status ( #10866 )
...
* Fix database update error doesn't rollback the task instance status
* Fix database error may cause workflow dead with running status
2 years ago
Wenjun Ruan
67d14fb7b3
[Fix-10785] Fix state event handle error will not retry ( #10786 )
...
* Fix state event handle error will not retry
* Use state event handler to deal with the event
2 years ago
Wenjun Ruan
66624c5c86
[Bug] [Master] Worker failover will cause task cannot be failover ( #10631 )
...
* fix worker failover may lose event
2 years ago
WangJPLeo
f46faa02c3
[Fix-10452] Serial wait for policy recovery ( #10453 )
...
* Serial wait for policy recovery
* processInstance state check null
* add sendresult(Host host, Command command) method and replace the original.
2 years ago
Wenjun Ruan
ad2646ff1f
Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe ( #10479 )
...
* Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe
2 years ago
Wenjun Ruan
b0d9d3f9ab
Add some warning log in master ( #10383 )
...
* Add some warn log in master
* fix may skip sleep
2 years ago
Wenjun Ruan
e21d7b1551
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
2 years ago
Wenjun Ruan
516757cc74
[Fix] [Worker] Fix worker will hang if fails to start ( #10342 )
...
* Fix worker will hang if fails to start
* Add .run to ignore
2 years ago
kezhenxu94
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
2 years ago
JinYong Li
49979c658e
[Fix-8828] [Master] Assign tasks to worker optimization ( #9919 )
...
* fix 9584
* master recall
* fix ut
* update logger
* update delay queue
* fix ut
* remove sleep
Co-authored-by: 进勇 <lijinyong@cai-inc.com>
Co-authored-by: JinyLeeChina <jiny.li@foxmail.com>
2 years ago
guoshupei
ca95d2f928
[Fix-9221] [alert-server] optimization and gracefully close ( #9246 )
...
* [Fix-9221] [alert-server] optimization and gracefully close
This closes #9221
* [Fix-9221] [alert-server] remove unused mock data
This closes #9221
* [Fix-9221] [alert-server] remove unused mock data
This closes #9221
* [Fix-9221] [alert-server] remove unnecessary Mockito stubbings
* [Fix-9221] [alert-server] init AlertPluginManager in AlertServer
* [Fix-9221] [alert-server] AlertServerTest add AlertPluginManager installPlugin
* [Fix-9221] [alert-server] replace @Eventlistener with @PostConstruct
* [Fix-9221] [alert-server] sonar check solution
* [Improvement-9221] [alert] update constructor injection and replace IStoppable with Closeable
Co-authored-by: guoshupei <guoshupei@lixiang.com>
3 years ago
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
3 years ago
caishunfeng
ddf1ff98fa
[Improvement-7697][Master/Worker] Change the task ack to runnning callback ( #8719 )
...
* rebase dev
* change task state to dispatch if dispatch success
* update task host when dispatch
* add dispatch task event
* test
* check tenant after enable auto create
* handle dispatch state
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kerwin
a1bef43981
[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module ( #8584 )
...
* Task plug-in optimization, task-related classes are migrated to the task plugin module
* remove tasktype enum class.
* fix code style.
* fix code style
* fix code style
* fix ProcessServiceTest.testUpdateResourceInfo test class
* fix code style
* fix test task plugin manager check parameters null
* fix test ut
* update aws license
* change TaskTimeoutStrategy class
3 years ago
wangyang
0d8079a816
[DS-7992][feat] Alert module judging strategy ( #8636 )
3 years ago
yimaixinchen
a72742b9de
remove unuse import jsonFormat ( #8548 )
3 years ago
caishunfeng
84f2cfec39
[Feature][Server] Custom timezone - Add timezone handler unified ( #8477 )
...
* date convert of timezone
* remove @JsonFormat
* add unit test
* fix time preview in scheduler
* optimization & add env config
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Wenjun Ruan
66dcf2376a
Optimize some code ( #8324 )
3 years ago
Wenjun Ruan
093815785b
Remove unused class ( #8299 )
3 years ago
Kerwin
103ccb01da
change version to 2.0.4-SNAPSHOT ( #8188 )
3 years ago
xuhhui
0cfb2043cf
Improvement: improve Pong.java mistake ( #7822 )
3 years ago
kezhenxu94
67cc260d52
Split the components into individual package, refactor configurations to use Spring properties ( #7160 )
...
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
3 years ago
wind
a80a7b3fcf
[Feature-6963][MasterServer] unified cache manager ( #7187 )
...
* unified cache
* reduce db select
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wangxj3
2b519f31e9
[Feature-#6422] task group queue ( #6722 )
...
* add task group
* modify task group
* pull dev
* add license header
* modify code style
* fix code style
* fix sql error
* fix error
* fix test
* fix test
* fix test
* fix test
* fix code style
* fix ut
* code style
* fix unit test
* test ut
* ut
* add unittest
* test ut
* modify back ut
* majorization code
* fix conflict
* fix ut
Co-authored-by: wangxj <wangxj31>
3 years ago
wind
8e93939121
[DS-6963][MasterServer]add cache manager for tenant and user ( #6974 )
...
* cache manager for tenant and user
* add test
* fix checkstyle
* add dependencies
* fix sonar check
* use spring boot cache configuration
* add license
* check style
* check style
* add license
* change proxy name to processor
* add license header
* check style
* add license file
* add license file
* add license
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lyq
c78fd24776
bug about dolphinscheduler-remote SendAsync ( #6972 )
...
* bug about SendAsync
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
wind
daca3baf66
[DS-6653][Server] fix netty create too many channels ( #6654 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
8850baff07
[DS-6640][WorkerServer] support process update host command type ( #6642 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kirs
67508d8d1b
update project version to 2.0.0-SNAPSHOT ( #6383 )
3 years ago