EricGao888
934e7f806c
[maven-release-plugin] prepare for next development iteration
2 years ago
EricGao888
d2ba3d4cfb
[maven-release-plugin] prepare release 3.0.2
2 years ago
EricGao888
ef3669fc3a
[maven-release-plugin] prepare for next development iteration
2 years ago
EricGao888
818a256952
[maven-release-plugin] prepare release 3.0.2
2 years ago
Wenjun Ruan
53449a06c4
Fix memory leak in worker due to message retry map ( #12878 ) ( #12887 )
...
(cherry picked from commit 403c6a6bb6
)
2 years ago
Eric Gao
f2cec3e259
Only expose necessary actuator endpoints ( #12571 ) ( #12794 )
...
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2 years ago
zhuangchong
5f85235462
[maven-release-plugin] prepare for next development iteration
2 years ago
zhuangchong
cb03ca8166
[maven-release-plugin] prepare release 3.0.1
2 years ago
zhuangchong
364cafe138
[maven-release-plugin] prepare for next development iteration
2 years ago
zhuangchong
17e36b7060
[maven-release-plugin] prepare release 3.0.1
2 years ago
Kerwin
c4c943277c
[3.0.1-prepare]cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task ( #11994 )
...
* cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task
Co-authored-by: Wenjun Ruan <wenjun@apache.org>
2 years ago
JinYong Li
ab8f878631
fix heartBeatTaskCount bug ( #12024 )
2 years ago
Eric Gao
3d69e9edb1
[Doc][Security] Update instructions on worker groups ( #11483 )
...
* Update instructions on worker groups
(cherry picked from commit 9330d6cfcd
)
2 years ago
Kerwin
d94797dfbc
Remove logger header in task log file ( #11555 ) ( #11968 )
2 years ago
Kerwin
2e64e1ca2f
cherry-pick [Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute /bin/spark-sql ( #11971 )
2 years ago
冯剑
81f2d6b293
[3.0.1-prepare]cherry-pick[Bug-#11650][worker] #11650 fix SQL type task, stop task does not take effect ( #11938 )
...
* [Bug-11650][worker] #11650 fix SQL type task, stop task does not take effect
Co-authored-by: 冯剑 Jian <jian.feng@jiduauto.com>
2 years ago
Jiajie Zhong
889fd580e3
[maven-release-plugin] prepare for next development iteration
2 years ago
Jiajie Zhong
9efd1ace78
[maven-release-plugin] prepare release 3.0.0
2 years ago
xiangzihao
a05d7cc8f4
fix_10514 ( #10568 )
...
(cherry picked from commit 0f38217b12
)
2 years ago
xiangzihao
5e129d478e
add datasource health check to the healthcheck endpoint ( #10588 )
...
(cherry picked from commit 1111371c9a
)
2 years ago
xuhhui
d550f9917e
fix error ( #11206 )
...
(cherry picked from commit bfff3a7c5d
)
2 years ago
caishunfeng
cec5e88319
[Bug-11071] Fix task local params NPE ( #11166 )
...
* fix local param NPE
* delete empty files
2 years ago
Wenjun Ruan
5a2ea0b76b
Fix compile error
2 years ago
Wenjun Ruan
f3250bf5fa
Fix worker cannot shutdown due to resource close failed or heart beat check failed ( #10979 )
...
* Use try-with-resource to close resource, and add heart error threshold to avoid worker cannot close due to heart beat check failed
* Move heartbeat error threshold to applicaiton.yml
(cherry picked from commit 2be1d4bf0a
)
2 years ago
Wenjun Ruan
9ee20cffef
[Fix-10827] Fix network error cause worker cannot send message to master ( #10886 )
...
* Fix network error cause worker cannot send message to master
(cherry picked from commit cade66a9b6
)
2 years ago
Wenjun Ruan
b259deb196
[Fix-10854] Fix database restart may lost task instance status ( #10866 )
...
* Fix database update error doesn't rollback the task instance status
* Fix database error may cause workflow dead with running status
(cherry picked from commit f639a2eed4
)
2 years ago
Wenjun Ruan
7500e99682
[Fix-10785] Fix state event handle error will not retry ( #10786 )
...
* Fix state event handle error will not retry
* Use state event handler to deal with the event
(cherry picked from commit 67d14fb7b3
)
2 years ago
Wenjun Ruan
4b224ae2e5
Validate master/worker config ( #10649 )
...
(cherry picked from commit 35b25da863
)
2 years ago
Wenjun Ruan
db31deb54f
[Bug] [Master] Worker failover will cause task cannot be failover ( #10631 )
...
* fix worker failover may lose event
(cherry picked from commit 66624c5c86
)
2 years ago
Wenjun Ruan
c488a9f828
Fix compile error
2 years ago
Wenjun Ruan
3ab9ee13fc
Optimize master log, use MDC to inject workflow instance id and task instance id in log ( #10516 )
...
* Optimize master log, add workflow instance id and task instance id in log
* Use MDC to set the workflow info in log4j
* Add workflowInstanceId and taskInstanceId in MDC
(cherry picked from commit db595b3eff
)
2 years ago
Wenjun Ruan
318a8e3ae0
[Feature][metrics] Add master, worker metrics ( #10326 )
...
* Add mater metrics
* fix UT
* Add url to mysql profile
* Add worker metrics
* Update grafana config
* Add system metrics doc
* Add process failover counter
* Add metrics image
* Change jpg to png
* Add command insert metrics
* Fix UT
* Revert UT
(cherry picked from commit e21d7b1551
)
2 years ago
Wenjun Ruan
4ceb420873
Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe ( #10479 )
...
* Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe
(cherry picked from commit ad2646ff1f
)
2 years ago
devosend
7ddaa2f47d
[maven-release-plugin] prepare for next development iteration
2 years ago
devosend
0a1b9bdd52
[maven-release-plugin] prepare release 3.0.0-beta-2
2 years ago
devosend
d68dcda2bb
[chore] pre-release change pom.xml
2 years ago
Jiajie Zhong
57ade38939
[maven-release-plugin] prepare release 3.0.0-beta-1
3 years ago
旺阳
e08b08efdd
[improve] Change Mysql Driver ( #10220 )
...
(cherry picked from commit aba5f8a40e
)
3 years ago
旺阳
5d8679fba9
[Fix-10103][k8s]Fix k8s Change DataSource Error ( #10128 )
...
(cherry picked from commit de5507fb19
)
3 years ago
Jiajie Zhong
a9fa6b33a4
[chore] Change release version to 3.0.0-beta-1 ( #9957 )
3 years ago
Paul Zhang
8562f6a878
[Feature][Log]Add timezone information in log output ( #9913 )
3 years ago
LongJGun
778018dcfb
[Bug] [worker] fix CommandType TASK_EXECUTE_RUNNING_ACK don't consumed ( #9849 ) ( #9850 )
3 years ago
Jiajie Zhong
de50f43de6
[common] Make dolphinscheduler_env.sh work when start server ( #9726 )
...
* [common] Make dolphinscheduler_env.sh work
* Change dist tarball `dolphinscheduler_env.sh` location
from `bin/` to `conf/`, which users could finish their
change configuration operation in one single directory.
and we only need to add `$DOLPHINSCHEDULER_HOME/conf`
when we start our sever instead of adding both
`$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin`
* Change the `start.sh`'s path of `dolphinscheduler_env.sh`
* Change the setting order of `dolphinscheduler_env.sh`
* `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh`
when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh`
* Change the related docs
3 years ago
caishunfeng
5657cb9aec
[Bug-9719][Master] fix failover fail because task plugins has not been loaded ( #9720 )
3 years ago
WangJPLeo
996790ce9e
[Improvement-9609][Worker]The resource download method is selected according to the configurati… ( #9636 )
...
* The resource download method is selected according to the configuration and the service startup verification is added.
* common check CI fix
* Startup check changed to running check
* code smell
* Coordinate resources to increase test coverage.
* Split resource download method.
* Unit Test Coverage
Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>
3 years ago
caishunfeng
239be31ab7
[Bug] cancel application when kill task ( #9624 )
...
* cancel application when kill task
* add warn log
* add cancel application
3 years ago
WangJPLeo
9964c4c1e1
[Fix-9593] Storage Management StorageOperate No Instance ( #9594 )
...
* Storage Management StorageOperate No Instance
* Add StorageOperateManager unit test
* Add license header
* Fix issues in SonarCloud code analysis
Co-authored-by: WangJPLeo <wangjipeng@whaleops.com>
3 years ago
caishunfeng
b4017d0afd
fix task kill ( #9578 )
3 years ago
caishunfeng
66d148872d
[Bug-9501][Worker] fix kill task error before running ( #9509 )
3 years ago
Eric Gao
fd6b43bc81
[Dev] Switch version in pom.xml to dev-SNAPSHOT ( #9223 ) ( #9299 )
3 years ago