zwZjut
255670fda9
[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 ( #7358 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
lenboo
54a89e9e24
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
ec0e57c53d
[maven-release-plugin] prepare release 2.0.1
3 years ago
BaoLiang
921f388077
[FIX-7338] set h2 for default DATABASE_TYPE for standalone-server ( #7339 )
...
* [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 )
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
* [BUG][SQL] fix the process list page load slowly. (#7166 )
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
* [2.0.1] remove unused foreign_key
* [2.0.1] add version in sql
* [2.0.1] change serial for postgre
* [2.0.1] set h2 for default DATABASE_TYPE for standalone-server
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
3 years ago
lenboo
14888518db
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
bef4fa8321
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
79ab27299e
[cherry-pick-2.0.1][Bug-7319][MasterServer] fix NPE when switch else branch is empty ( #7314 )
...
* fix taskNode NPE
* fix switch node NPE when no else branch
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
5dad635ff0
[cherry-pick-2.0.1][Bug-7307][MasterServer] timeout event was filtered ( #7303 )
...
* remove task filter when task timeout
* get lastest task instance info
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
87e091076a
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
8b239a0728
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
41c05b53c7
[cherry-pick-2.0.1][Bug][MasterServer] fix timeout event ( #7283 )
...
* fix timeout alert
* fix timeout
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
9a49077fdf
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
29a4323540
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
9a307dc71a
fix failover logic ( #7276 )
3 years ago
lenboo
a97bc2c756
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
c011f6487a
[maven-release-plugin] prepare release 2.0.1
3 years ago
kezhenxu94
a8edeac1e3
Fix env vars are not passed in from docker-compose ( #7240 )
3 years ago
wind
30848478bf
fix timeout ( #7224 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
c2d0acd713
fix timeout ( #7222 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kerwin
b4c422e977
fix waterdrop task plugin ( #7216 )
3 years ago
kezhenxu94
e9d27015c3
Add missing property for API and worker ( #7198 )
3 years ago
Jiajie Zhong
1e0757bd8e
Change default database from mysql to pg ( #7190 )
3 years ago
wind
0b376f7f90
[2.0.1-cherry-pick] fix bug : Tez state, complement data kill, dependent node ( #7188 )
...
* [Fix-7037][dolphincheduler-server] process instance can not be killed when complement data (#7140 )
* fix bug 7037
* update processComplementData
Co-authored-by: SbloodyS <sbloodys@qq.com>
* [Fix-5551][common] Fix ExecutionStatus for hive-on-Tez application (#6289 )
* add ENDED state
* Update HadoopUtils.java
* [Fix-7093][dolphincheduler-server] fix dependent node stuck in running (#7116 )
* fix bug 7093
* remove redundant else
Co-authored-by: SbloodyS <sbloodys@qq.com>
Co-authored-by: SbloodyS <460888207@qq.com>
Co-authored-by: SbloodyS <sbloodys@qq.com>
Co-authored-by: Manhua <kevinjmh@qq.com>
3 years ago
kezhenxu94
449c098aef
Fix quartz not work, worker / alert server should not listen or 8080 port ( #7159 )
3 years ago
Jiajie Zhong
423d7ea3a1
[deploy] Add export database type for before daemon file ( #7151 )
...
* [deploy] Use install_config.conf export datasource properties
Directly user install_config.conf to set spring datasource
properties, delete datasource.properties file for more clearly
* Remove unused properties
3 years ago
JinYong Li
e96a39f57c
[2.0.1-cherrypick][Feature][API] API operation optimization ( #7136 )
...
* pick-6863
* [Improvement][API][num-7] add task delete check (#6887 )
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
* [Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted (#6893 )
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
* [DS-6931][fix] swagger failed to start due to improper use of request param annotation (#6933 )
Co-authored-by: eye <eye.gu@aloudata.com>
* [fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT (#6888 )
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , add license
* fix : #6878 , code style
* fix : #6878 , code style
* fix : #6878 , fix Duplication
* fix : #6878
* fix : #6878 , fix style
* to #6878 : fix style
* to #6878 : fix style
* to #6878 : add buildTaskDefinition to overwrite equals and hashCode
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Improvement][API][num-6] TaskDefinition releaseTaskDefinition (#6965 )
* finished releaseTaskDefinition
* add releaseTaskDefinition unit test
* change import
* add import
* bug fix
* change import
Co-authored-by: 时光 <caizhedong@cai-inc.com>
* pick-6966
* update task_definition_log field typ (#6967 )
* update task_definition_log field typ
update task_definition_log field task_params type,modify text to longtext to be consistent with the main table
* update t_ds_task_definition_log field task_params
update t_ds_task_definition_log field task_params
* pick-6970
* pick-6977
* pick-6984
* add processDefinition releaseWorkflowAndSchedule (#7044 )
* [Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' (#7047 )
* [Improvement] save schedule when workflow is offline
* [Improvement] rollback transactional when creating/updating schedule failed.
* [Improvement] resolve merge conflict
* [Improvement] do not set projectName and processDefinitionName when saving schedule
* [Improvement] do not set projectName and processDefinitionName when saving schedule
Co-authored-by: edward-yang <yangjianh210@gmail.com>
* pick-7053
* pick-7098
* pick add 6772 relation code
* fix ut
Co-authored-by: Jeff Zhan <360400325@qq.com>
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
Co-authored-by: ououtt <734164350@qq.com>
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: 时光 <41109695+yikeshiguang@users.noreply.github.com>
Co-authored-by: 时光 <caizhedong@cai-inc.com>
Co-authored-by: zhang <60912722+boy-xiaozhang@users.noreply.github.com>
Co-authored-by: EdwardYang <yangjianh210@126.com>
Co-authored-by: edward-yang <yangjianh210@gmail.com>
3 years ago
wind
36fd0c83f5
[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. ( #7046 ) ( #7059 )
...
Co-authored-by: Hua Jiang <jianghuachinacom@163.com>
3 years ago
Kirs
2bf3b22d64
[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) ( #7041 )
...
* data source spi
* Fix datasource not work in tests and standalone server, and run all tests by default (#6743 )
* Refactor alert plugins and simplify its usage (#6723 )
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 ) (#6828 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
[Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* fix ut fail
* fix license
* fix license
* update package
* update package
* remove unused license
Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
wind
19cb1237b3
[cherry-pick][DS-7004][MasterServer]fix master still work when it lose zk connection ( #7058 )
3 years ago
Kirs
6821c7a9ac
[2.0.1-prepare#6712]Refactor registry plugin and simplify its usage ( #6999 )
...
* [2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6712 )
* upgrade version and fix dep err
* Clean up the utility codes (#6732 )
* remove code style check
* upgrade docker version
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
lenboo
8a27ae4593
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b31338b950
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
b7d2b11d56
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
549824a036
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
61e86b242b
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
80c4aaaea5
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
8585b48402
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
5582fedafa
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
d8398fe7fd
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
e755355bab
[maven-release-plugin] prepare release 2.0.0
3 years ago
OS
652b9230a7
[BUG][Master] process cannot finish and its status is always running ( #6886 )
...
* fix 6882: process cannot finish and its status is always running
* fix 6882: process cannot finish and its status is always running
3 years ago
lenboo
c5fdcaa12c
add is start check..
3 years ago
lenboo
604c224346
add is start check..
3 years ago
lenboo
446a4c5e38
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
9bd693b7ef
[maven-release-plugin] prepare release 2.0.0
3 years ago
JinYong Li
92347a73e0
fix complement data retry bug; issues: [Bug] [Master] A bug on task retry mechanism #6613 ( #6843 ) ( #6847 )
...
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
Co-authored-by: KyoYang <39785282+yangqiyu0306@users.noreply.github.com>
Co-authored-by: yangqiyu <yangqiyu@deepexi.com>
3 years ago
lenboo
4e812e97c3
unused import
3 years ago
wind
523357f574
[DS-6737][MasterServer] fix event handle twice ( #6738 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
OS
98b8d5424a
[Feature][Install] add upgrade 2.0 ddl ( #6648 )
...
* Optimizing SQL scripts
* add upgrade 2.0 ddl
# Conflicts:
# sql/upgrade/1.4.0_schema/mysql/dolphinscheduler_ddl.sql
3 years ago
Yao WANG
cb4b6f1d92
[Fix-#6641]fix npe when the LowerWeightHostManager can not get the workNodeInfo ( #6656 )
...
* change the return type of getHostWeight
Co-authored-by: ywang46 <ywang46@paypal.com>
3 years ago