zwZjut
32fb3f84df
[Bug] [dolphinscheduler-server] memory leak of logger #7661 ( #7665 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
* to #7661
* to #7661
* to #7661:fix ut
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
Jiajie Zhong
f2aef53ad1
Fix bug in python example ( #7681 )
...
Fix example bug in switch and datax task type.
Fix misunderstanding for condition node
* [python] Fix switch example workflow name conflict to dependent
* [python] Fix task condition missing branch success and fail
* [python] Task datax add more detail example
3 years ago
JinYong Li
54525806df
fix workflow copy ( #7677 )
3 years ago
Jiajie Zhong
fa52022ccd
[Feature][Workflow Move] Display none workflow move btn. ( #7666 ) ( #7667 )
...
Co-authored-by: songjianet <1778651752@qq.com>
3 years ago
Jiajie Zhong
d23b3444bb
[python] Fix task condition set wrong deps ( #7650 ) ( #7655 )
...
After #7505 merged. we could use condition task type
but our dependent set in the wrong direction, all
the condition operators should be upstream of the
current task instead of downstream
fix : #7649
3 years ago
wind
affb2a3f0f
fix workflow copy ( #7659 ) ( #7663 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 ( #7641 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
wind
6033e98a2d
[cherry-pick-2.0.2][ApiServer] workflow copy ( #7657 )
...
* fix 7597 (#7598 )
* cherry-pick #7647
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
Jiajie Zhong
250e857c70
Fix python gateway will start each time others server start ( #7648 )
...
Add PythonGatewayServer to StandaloneServer
Change ComponentScan
Add log file and server start log
3 years ago
wind
744577f252
remove taskInstancnCacheManager ( #7636 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
wind
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
zwZjut
6c819ee16d
[Bug] [dolphinscheduler-server] workflow is always running when worker sendResult success but master not received ( #7610 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7609
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
BaoLiang
8fa61cf050
[FIX-7287] change description of 'master.exec.threads' ( #7588 )
...
* [2.0.2] #7287 change description of 'master.exec.threads'
* [2.0.2] #7287 change description of 'master.exec.threads'
3 years ago
wind
1693405383
[cherry-pick-2.0.2] #7556 #7530 #7506 ( #7570 )
...
* [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )
* [DS-7227][refactor] optimize alert plugin instance list order (#7506 )
[DS-7227][refactor] optimize alert plugin instance list order
query all alert plugin instance list order by update time desc
optimize `select *` sql in the AlterPluginInstanceMapper.xml
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: Tom <532066967@qq.com>
3 years ago
xiangzihao
5c297a594c
fix 7534 ( #7567 )
...
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
wind
281cea8a64
fix 2.0.2 upgrade sql ( #7566 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
SbloodyS
ab1467e622
cherry-pick bug_7537 ( #7555 )
3 years ago
zwZjut
c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 ( #7540 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7511
* to #7511
* to #7511
* to #7511
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
kezhenxu94
1657ce31a6
Adjust zookeeper log level ( #7468 )
3 years ago
SbloodyS
0b6f3fb0c3
[Cherry-pick-2.0.2[Feature-7460][]Feature-7451][Fix-7392] ( #7483 )
...
* remove date+1 when the data is supplemented (#7452 )
* resolve conflict
* [Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393 )
* fix bug_7392
* fix bug_7392
* fix bug_7392
Co-authored-by: SbloodyS <sbloodys@qq.com>
* cherry-pick-2.0.2
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
ouyangyewei
60001f807e
[Cherry-pick-2.0.2][Feature-7418][dolphinscheduler-api] Return domain object after UpdateXxx success ( #7421 )
...
* to feature 7418
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
895b0fa9b8
[Cherry-pick-2.0.2][Feature-7408][dolphinscheduler-api] Built GenerateToken into the UpdateToken API ( #7412 )
...
* to feature 7408
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
songjianet
49089d3dc1
[Fix][Project List UI] Fix the calling interface that keeps decreasing by one after manually setting the `pageNo` parameter. ( #7413 )
3 years ago
ouyangyewei
533a89c5e1
to feature 7401 ( #7406 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
3aa939eaa9
fix bug #7375 ( #7388 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
65a6b580ab
[Cherry-pick-2.0.2][Feature][Dolphinscheduler-api] cherry-pick from dev to 2.0.2 ( #7373 )
...
* [Feature-7110][dolphinscheduler-api] support grant project by code
* [Feature-7180][dolphinscheduler-api] Revoke project permission for specified user
* [Feature-7191][dolphinscheduler-api] support query authorized user list by project code
* [Feature-7301][dolphinscheduler-api] Support query access token for specified user
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
0a65854ee3
fix bug #6669 ( #7370 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
9fa239518c
to feature #7169 ( #7363 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
f6fd7f6540
return domain after creating success ( #7355 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
zwZjut
255670fda9
[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 ( #7358 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
lenboo
54a89e9e24
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
ec0e57c53d
[maven-release-plugin] prepare release 2.0.1
3 years ago
BaoLiang
921f388077
[FIX-7338] set h2 for default DATABASE_TYPE for standalone-server ( #7339 )
...
* [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 )
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
* [BUG][SQL] fix the process list page load slowly. (#7166 )
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
* [2.0.1] remove unused foreign_key
* [2.0.1] add version in sql
* [2.0.1] change serial for postgre
* [2.0.1] set h2 for default DATABASE_TYPE for standalone-server
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
3 years ago
lenboo
14888518db
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
bef4fa8321
[maven-release-plugin] prepare release 2.0.1
3 years ago
Kerwin
b17fa26d61
[2.0.1][Fix-7284] [api] Fix the missing project information in the process instance timeout alarm ( #7309 )
...
* cherry pick
* Fix the missing project information in the process instance timeout alarm
3 years ago
wind
79ab27299e
[cherry-pick-2.0.1][Bug-7319][MasterServer] fix NPE when switch else branch is empty ( #7314 )
...
* fix taskNode NPE
* fix switch node NPE when no else branch
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
5dad635ff0
[cherry-pick-2.0.1][Bug-7307][MasterServer] timeout event was filtered ( #7303 )
...
* remove task filter when task timeout
* get lastest task instance info
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kirs
7ec4cb9dc3
[2.0.1]Fix sql task send alert error ( #7300 )
3 years ago
lenboo
87e091076a
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
8b239a0728
[maven-release-plugin] prepare release 2.0.1
3 years ago
mask
5a8cd58ee5
[Fix-7291][datasource] support driverClassName default ( #7294 )
...
* [Fix-7291][datasource] Compatible with different versions of MySQL data source loading (#7291 )
* [Fix-7291][datasource] Compatible with different versions of MySQL data source loading (#7291 )
3 years ago
wind
41c05b53c7
[cherry-pick-2.0.1][Bug][MasterServer] fix timeout event ( #7283 )
...
* fix timeout alert
* fix timeout
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
mask
db5367ab68
[Fix-7277][datasource] Support Kerberos auto renewal ( #7277 ) ( #7280 )
3 years ago
lenboo
9a49077fdf
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
29a4323540
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
9a307dc71a
fix failover logic ( #7276 )
3 years ago
songjianet
fc233f06ff
[Feature][Datasource] Disabled kerberos. ( #7270 )
3 years ago