9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27#7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe0601f18444fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
1693405383
[cherry-pick-2.0.2] #7556 #7530 #7506 ( #7570 )
...
* [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )
* [DS-7227][refactor] optimize alert plugin instance list order (#7506 )
[DS-7227][refactor] optimize alert plugin instance list order
query all alert plugin instance list order by update time desc
optimize `select *` sql in the AlterPluginInstanceMapper.xml
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: Tom <532066967@qq.com>
3 years ago
281cea8a64
fix 2.0.2 upgrade sql ( #7566 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 ( #7540 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27#7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe0601f18444fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7511
* to #7511
* to #7511
* to #7511
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
65a6b580ab
[Cherry-pick-2.0.2][Feature][Dolphinscheduler-api] cherry-pick from dev to 2.0.2 ( #7373 )
...
* [Feature-7110][dolphinscheduler-api] support grant project by code
* [Feature-7180][dolphinscheduler-api] Revoke project permission for specified user
* [Feature-7191][dolphinscheduler-api] support query authorized user list by project code
* [Feature-7301][dolphinscheduler-api] Support query access token for specified user
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
255670fda9
[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 ( #7358 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27#7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe0601f18444fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
54a89e9e24
[maven-release-plugin] prepare for next development iteration
3 years ago
ec0e57c53d
[maven-release-plugin] prepare release 2.0.1
3 years ago
14888518db
[maven-release-plugin] prepare for next development iteration
3 years ago
bef4fa8321
[maven-release-plugin] prepare release 2.0.1
3 years ago
b17fa26d61
[2.0.1][Fix-7284] [api] Fix the missing project information in the process instance timeout alarm ( #7309 )
...
* cherry pick
* Fix the missing project information in the process instance timeout alarm
3 years ago
79ab27299e
[cherry-pick-2.0.1][Bug-7319][MasterServer] fix NPE when switch else branch is empty ( #7314 )
...
* fix taskNode NPE
* fix switch node NPE when no else branch
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
87e091076a
[maven-release-plugin] prepare for next development iteration
3 years ago
8b239a0728
[maven-release-plugin] prepare release 2.0.1
3 years ago
9a49077fdf
[maven-release-plugin] prepare for next development iteration
3 years ago
29a4323540
[maven-release-plugin] prepare release 2.0.1
3 years ago
a97bc2c756
[maven-release-plugin] prepare for next development iteration
3 years ago
c011f6487a
[maven-release-plugin] prepare release 2.0.1
3 years ago
4e8507e6ca
[2.0.1] change postgre sql for serial int ( #7248 )
...
* [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 )
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
* [BUG][SQL] fix the process list page load slowly. (#7166 )
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
* [2.0.1] remove unused foreign_key
* [2.0.1] add version in sql
* [2.0.1] change serial for postgre
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
3 years ago
7ecf51597f
fix postgre upgrade ( #7231 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
98ab5219ff
Fix SQL create / upgrade scripts cannot run ( #7212 )
3 years ago
f54f2c1f91
[2.0.1-cherry-pick] fix the process list page load slowly. ( #7174 )
3 years ago
623d154a17
Fix alert plugin instance filter ( #7172 )
...
alert plugin could not filter by given
pattern, cause api server do not handle
parameter searchVal, This patch add parameter
`searchVal` for alert plugin.
3 years ago
659d2bb4b3
[Fix-7070][UI] Remedy the issue with no saving the timeout's strategy into the database. ( #7107 ) ( #7150 )
...
Co-authored-by: Hua Jiang <jianghuachinacom@163.com>
3 years ago
423d7ea3a1
[deploy] Add export database type for before daemon file ( #7151 )
...
* [deploy] Use install_config.conf export datasource properties
Directly user install_config.conf to set spring datasource
properties, delete datasource.properties file for more clearly
* Remove unused properties
3 years ago
e96a39f57c
[2.0.1-cherrypick][Feature][API] API operation optimization ( #7136 )
...
* pick-6863
* [Improvement][API][num-7] add task delete check (#6887 )
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
* [Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted (#6893 )
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
* [DS-6931][fix] swagger failed to start due to improper use of request param annotation (#6933 )
Co-authored-by: eye <eye.gu@aloudata.com>
* [fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT (#6888 )
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , add license
* fix : #6878 , code style
* fix : #6878 , code style
* fix : #6878 , fix Duplication
* fix : #6878
* fix : #6878 , fix style
* to #6878 : fix style
* to #6878 : fix style
* to #6878 : add buildTaskDefinition to overwrite equals and hashCode
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Improvement][API][num-6] TaskDefinition releaseTaskDefinition (#6965 )
* finished releaseTaskDefinition
* add releaseTaskDefinition unit test
* change import
* add import
* bug fix
* change import
Co-authored-by: 时光 <caizhedong@cai-inc.com>
* pick-6966
* update task_definition_log field typ (#6967 )
* update task_definition_log field typ
update task_definition_log field task_params type,modify text to longtext to be consistent with the main table
* update t_ds_task_definition_log field task_params
update t_ds_task_definition_log field task_params
* pick-6970
* pick-6977
* pick-6984
* add processDefinition releaseWorkflowAndSchedule (#7044 )
* [Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' (#7047 )
* [Improvement] save schedule when workflow is offline
* [Improvement] rollback transactional when creating/updating schedule failed.
* [Improvement] resolve merge conflict
* [Improvement] do not set projectName and processDefinitionName when saving schedule
* [Improvement] do not set projectName and processDefinitionName when saving schedule
Co-authored-by: edward-yang <yangjianh210@gmail.com>
* pick-7053
* pick-7098
* pick add 6772 relation code
* fix ut
Co-authored-by: Jeff Zhan <360400325@qq.com>
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
Co-authored-by: ououtt <734164350@qq.com>
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: 时光 <41109695+yikeshiguang@users.noreply.github.com>
Co-authored-by: 时光 <caizhedong@cai-inc.com>
Co-authored-by: zhang <60912722+boy-xiaozhang@users.noreply.github.com>
Co-authored-by: EdwardYang <yangjianh210@126.com>
Co-authored-by: edward-yang <yangjianh210@gmail.com>
3 years ago
5813d6bed3
fix some config miss ( #7133 )
3 years ago
b3e8704194
[2.0.0-chery-pick #7003 ]Fix shell tools for database schema cannot run ( #7087 )
...
PR #7003
ISSUE #6998
3 years ago
6955ba5a6f
[Upgrade][install] upgrade compatibility exception ( #7030 ) ( #7063 )
...
* upgrade compatibility exception
* upgrade compatibility exception
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
0eac3e8eae
[2.0.1-cherrypick]Fix-6941][API] Fix the failure of querying details of alert group ( #6942 ) ( #7066 )
...
* Fix the failure of querying details of alert group
* code cleanup
PR #6942
ISSUE #6941
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
3 years ago
36fd0c83f5
[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. ( #7046 ) ( #7059 )
...
Co-authored-by: Hua Jiang <jianghuachinacom@163.com>
3 years ago
2bf3b22d64
[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) ( #7041 )
...
* data source spi
* Fix datasource not work in tests and standalone server, and run all tests by default (#6743 )
* Refactor alert plugins and simplify its usage (#6723 )
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 ) (#6828 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
[Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* fix ut fail
* fix license
* fix license
* update package
* update package
* remove unused license
Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
6821c7a9ac
[2.0.1-prepare#6712]Refactor registry plugin and simplify its usage ( #6999 )
...
* [2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6712 )
* upgrade version and fix dep err
* Clean up the utility codes (#6732 )
* remove code style check
* upgrade docker version
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
8a27ae4593
[maven-release-plugin] prepare for next development iteration
3 years ago
b31338b950
[maven-release-plugin] prepare release 2.0.0
3 years ago
adaeb962ec
[cherry-pick][api] rewrite code generate,fix bit shift ( #6937 )
...
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
b7d2b11d56
[maven-release-plugin] prepare for next development iteration
3 years ago
549824a036
[maven-release-plugin] prepare release 2.0.0
3 years ago
61e86b242b
[maven-release-plugin] prepare for next development iteration
3 years ago
80c4aaaea5
[maven-release-plugin] prepare release 2.0.0
3 years ago
8585b48402
[maven-release-plugin] prepare for next development iteration
3 years ago
5582fedafa
[maven-release-plugin] prepare release 2.0.0
3 years ago
d8398fe7fd
[maven-release-plugin] prepare for next development iteration
3 years ago
e755355bab
[maven-release-plugin] prepare release 2.0.0
3 years ago
4015448441
fix bug of extra 'and' in ResourceMapper.xml ( #6876 )
...
Co-authored-by: ding <dingpf@helowin>
3 years ago
446a4c5e38
[maven-release-plugin] prepare for next development iteration
3 years ago
9bd693b7ef
[maven-release-plugin] prepare release 2.0.0
3 years ago
7f554a1ca8
[cherry-pick][Install] change sub process id to code ( #6848 )
...
* upgrade add sub_process (#6845 )
* cherry-pick 6846 change sub process id to code
* cherry-pick 6846 change sub process id to code
* ut fix
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
Jiajie Zhong
wind
zwZjut
ouyangyewei
lenboo
Kerwin
BaoLiang
kezhenxu94
JinYong Li
Kirs
DingPengfei