lenboo
f77a117803
[maven-release-plugin] prepare release 2.0.2
3 years ago
BaoLiang
b8f0bebadd
[cherry-pick][Fix-7485]Fix create hive datasource using ZooKee… ( #7710 )
...
* [Fix-7485][datasource-plugin] Fix create hive datasource using ZooKeeper way in 2.0.1 (#7489 )
# Conflicts:
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-api/src/test/java/org/apache/dolphinscheduler/plugin/datasource/api/provider/JdbcDataSourceProviderTest.java
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-hive/src/main/java/org/apache/dolphinscheduler/plugin/datasource/hive/HiveDataSourceClient.java
* update
Co-authored-by: wangbowen <419444275@qq.com>
3 years ago
wind
a262eebbce
fix sql split error ( #7709 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
ed0c233c1a
Hotfix python gateway server component filter ( #7708 )
3 years ago
lenboo
8f441b7776
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b36c1967b8
[maven-release-plugin] prepare release 2.0.2
3 years ago
lenboo
27795e695e
update docker version to 2.0.2
3 years ago
lenboo
720e0ad360
update sql 2.0.2
3 years ago
JinYong Li
890faffd22
[Bug][ApiServer] workflow copy ( #7694 )
...
* fix workflow copy
* fix copy
* fix copy
* code style
3 years ago
Jiajie Zhong
24747b3dae
[python] Fix task switch set global parameter ( #7693 )
...
* [python] Fix task switch set global parameter
* Change name
3 years ago
wind
85b3b2d29d
[DS-7686][Server]fix restart server after kill force ( #7689 )
...
* [DS-7686][Server]fix restart server after kill force
* update registry logic
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
BaoLiang
bcef5f5588
[cherry-pick][FIX-#6727] Fix procedure params bug ( #7680 ) ( #7692 )
...
* [FIX-#6727][worker-server] Fix procedure params bug (#7680 )
* fix Procedure param error
* code style
Co-authored-by: wangxj <wangxj31>
# Conflicts:
# dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractTaskExecutor.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-procedure/src/main/java/org/apache/dolphinscheduler/plugin/task/procedure/ProcedureTask.java
* update
Co-authored-by: wangxj3 <857234426@qq.com>
3 years ago
BaoLiang
5ede171140
[Fix-7654]Dependent node onChangeProjectCode error ( #7672 ) ( #7691 )
...
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* update ut
3 years ago
Jiajie Zhong
4f4cbba80d
[UI] Fix wrong dialogs for process definition's version info ( #7684 )
...
We should use process_definition.update_time instead of create time
to make more sence.
close : #7660
3 years ago
zwZjut
32fb3f84df
[Bug] [dolphinscheduler-server] memory leak of logger #7661 ( #7665 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
* to #7661
* to #7661
* to #7661:fix ut
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
Jiajie Zhong
f2aef53ad1
Fix bug in python example ( #7681 )
...
Fix example bug in switch and datax task type.
Fix misunderstanding for condition node
* [python] Fix switch example workflow name conflict to dependent
* [python] Fix task condition missing branch success and fail
* [python] Task datax add more detail example
3 years ago
JinYong Li
54525806df
fix workflow copy ( #7677 )
3 years ago
Jiajie Zhong
fa52022ccd
[Feature][Workflow Move] Display none workflow move btn. ( #7666 ) ( #7667 )
...
Co-authored-by: songjianet <1778651752@qq.com>
3 years ago
Jiajie Zhong
d23b3444bb
[python] Fix task condition set wrong deps ( #7650 ) ( #7655 )
...
After #7505 merged. we could use condition task type
but our dependent set in the wrong direction, all
the condition operators should be upstream of the
current task instead of downstream
fix : #7649
3 years ago
wind
affb2a3f0f
fix workflow copy ( #7659 ) ( #7663 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 ( #7641 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
wind
6033e98a2d
[cherry-pick-2.0.2][ApiServer] workflow copy ( #7657 )
...
* fix 7597 (#7598 )
* cherry-pick #7647
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
Jiajie Zhong
250e857c70
Fix python gateway will start each time others server start ( #7648 )
...
Add PythonGatewayServer to StandaloneServer
Change ComponentScan
Add log file and server start log
3 years ago
wind
744577f252
remove taskInstancnCacheManager ( #7636 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
wind
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
zwZjut
6c819ee16d
[Bug] [dolphinscheduler-server] workflow is always running when worker sendResult success but master not received ( #7610 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7609
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
BaoLiang
8fa61cf050
[FIX-7287] change description of 'master.exec.threads' ( #7588 )
...
* [2.0.2] #7287 change description of 'master.exec.threads'
* [2.0.2] #7287 change description of 'master.exec.threads'
3 years ago
wind
1693405383
[cherry-pick-2.0.2] #7556 #7530 #7506 ( #7570 )
...
* [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )
* [DS-7227][refactor] optimize alert plugin instance list order (#7506 )
[DS-7227][refactor] optimize alert plugin instance list order
query all alert plugin instance list order by update time desc
optimize `select *` sql in the AlterPluginInstanceMapper.xml
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: Tom <532066967@qq.com>
3 years ago
xiangzihao
5c297a594c
fix 7534 ( #7567 )
...
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
wind
281cea8a64
fix 2.0.2 upgrade sql ( #7566 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
SbloodyS
ab1467e622
cherry-pick bug_7537 ( #7555 )
3 years ago
zwZjut
c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 ( #7540 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7511
* to #7511
* to #7511
* to #7511
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
kezhenxu94
1657ce31a6
Adjust zookeeper log level ( #7468 )
3 years ago
SbloodyS
0b6f3fb0c3
[Cherry-pick-2.0.2[Feature-7460][]Feature-7451][Fix-7392] ( #7483 )
...
* remove date+1 when the data is supplemented (#7452 )
* resolve conflict
* [Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393 )
* fix bug_7392
* fix bug_7392
* fix bug_7392
Co-authored-by: SbloodyS <sbloodys@qq.com>
* cherry-pick-2.0.2
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
ouyangyewei
60001f807e
[Cherry-pick-2.0.2][Feature-7418][dolphinscheduler-api] Return domain object after UpdateXxx success ( #7421 )
...
* to feature 7418
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
895b0fa9b8
[Cherry-pick-2.0.2][Feature-7408][dolphinscheduler-api] Built GenerateToken into the UpdateToken API ( #7412 )
...
* to feature 7408
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
songjianet
49089d3dc1
[Fix][Project List UI] Fix the calling interface that keeps decreasing by one after manually setting the `pageNo` parameter. ( #7413 )
3 years ago
ouyangyewei
533a89c5e1
to feature 7401 ( #7406 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
3aa939eaa9
fix bug #7375 ( #7388 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
65a6b580ab
[Cherry-pick-2.0.2][Feature][Dolphinscheduler-api] cherry-pick from dev to 2.0.2 ( #7373 )
...
* [Feature-7110][dolphinscheduler-api] support grant project by code
* [Feature-7180][dolphinscheduler-api] Revoke project permission for specified user
* [Feature-7191][dolphinscheduler-api] support query authorized user list by project code
* [Feature-7301][dolphinscheduler-api] Support query access token for specified user
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
0a65854ee3
fix bug #6669 ( #7370 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
9fa239518c
to feature #7169 ( #7363 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
f6fd7f6540
return domain after creating success ( #7355 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
zwZjut
255670fda9
[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 ( #7358 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
lenboo
54a89e9e24
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
ec0e57c53d
[maven-release-plugin] prepare release 2.0.1
3 years ago
BaoLiang
921f388077
[FIX-7338] set h2 for default DATABASE_TYPE for standalone-server ( #7339 )
...
* [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 )
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
* [BUG][SQL] fix the process list page load slowly. (#7166 )
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
* [2.0.1] remove unused foreign_key
* [2.0.1] add version in sql
* [2.0.1] change serial for postgre
* [2.0.1] set h2 for default DATABASE_TYPE for standalone-server
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
3 years ago
lenboo
14888518db
[maven-release-plugin] prepare for next development iteration
3 years ago