wind
5592e7bb7b
[Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry ( #7808 ) ( #7866 )
...
* [Bug-7788] fix submit duplicate tasks sometimes when retry
* add exist check when add task to standby list
* update
* put queue contain judge first
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
1d3f77bedb
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
24ddd07493
[maven-release-plugin] prepare release 2.0.2
3 years ago
Jiajie Zhong
d1fcb0e821
[deployment] Drop support Ambari plugins in 2.0.2 ( #7749 )
...
Our ambari plugin is only support version before 2.0
and not work in currently version, so we just drop
Ambari directory
3 years ago
mask
a668c46e89
[fix-7750]Compatible historical version data source connection information( #7750 ) ( #7751 )
3 years ago
kezhenxu94
4d525536f6
Remove init script when gaining a new DB connection ( #7748 )
3 years ago
lenboo
c4eab17bd4
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
28cbaf05cb
[maven-release-plugin] prepare release 2.0.2
3 years ago
wind
35a1d732c6
[cherry-pick-2.0.2] fix depend task project 202 #7726 ( #7727 )
...
* [DS-7654][ApiServer]fix dependent node on change projectCode error
* test
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
kezhenxu94
6aaecdbd0b
Remove fast return for alert plugins due to bean initialization lifecycle is not determinged
...
Causing alert sender is not executed
3 years ago
lenboo
f5fd29a05d
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
f77a117803
[maven-release-plugin] prepare release 2.0.2
3 years ago
BaoLiang
b8f0bebadd
[cherry-pick][Fix-7485]Fix create hive datasource using ZooKee… ( #7710 )
...
* [Fix-7485][datasource-plugin] Fix create hive datasource using ZooKeeper way in 2.0.1 (#7489 )
# Conflicts:
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-api/src/test/java/org/apache/dolphinscheduler/plugin/datasource/api/provider/JdbcDataSourceProviderTest.java
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-hive/src/main/java/org/apache/dolphinscheduler/plugin/datasource/hive/HiveDataSourceClient.java
* update
Co-authored-by: wangbowen <419444275@qq.com>
3 years ago
wind
a262eebbce
fix sql split error ( #7709 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
ed0c233c1a
Hotfix python gateway server component filter ( #7708 )
3 years ago
lenboo
8f441b7776
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b36c1967b8
[maven-release-plugin] prepare release 2.0.2
3 years ago
lenboo
27795e695e
update docker version to 2.0.2
3 years ago
lenboo
720e0ad360
update sql 2.0.2
3 years ago
JinYong Li
890faffd22
[Bug][ApiServer] workflow copy ( #7694 )
...
* fix workflow copy
* fix copy
* fix copy
* code style
3 years ago
Jiajie Zhong
24747b3dae
[python] Fix task switch set global parameter ( #7693 )
...
* [python] Fix task switch set global parameter
* Change name
3 years ago
wind
85b3b2d29d
[DS-7686][Server]fix restart server after kill force ( #7689 )
...
* [DS-7686][Server]fix restart server after kill force
* update registry logic
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
BaoLiang
bcef5f5588
[cherry-pick][FIX-#6727] Fix procedure params bug ( #7680 ) ( #7692 )
...
* [FIX-#6727][worker-server] Fix procedure params bug (#7680 )
* fix Procedure param error
* code style
Co-authored-by: wangxj <wangxj31>
# Conflicts:
# dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractTaskExecutor.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-procedure/src/main/java/org/apache/dolphinscheduler/plugin/task/procedure/ProcedureTask.java
* update
Co-authored-by: wangxj3 <857234426@qq.com>
3 years ago
BaoLiang
5ede171140
[Fix-7654]Dependent node onChangeProjectCode error ( #7672 ) ( #7691 )
...
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* update ut
3 years ago
Jiajie Zhong
4f4cbba80d
[UI] Fix wrong dialogs for process definition's version info ( #7684 )
...
We should use process_definition.update_time instead of create time
to make more sence.
close : #7660
3 years ago
zwZjut
32fb3f84df
[Bug] [dolphinscheduler-server] memory leak of logger #7661 ( #7665 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
* to #7661
* to #7661
* to #7661:fix ut
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
Jiajie Zhong
f2aef53ad1
Fix bug in python example ( #7681 )
...
Fix example bug in switch and datax task type.
Fix misunderstanding for condition node
* [python] Fix switch example workflow name conflict to dependent
* [python] Fix task condition missing branch success and fail
* [python] Task datax add more detail example
3 years ago
JinYong Li
54525806df
fix workflow copy ( #7677 )
3 years ago
Jiajie Zhong
fa52022ccd
[Feature][Workflow Move] Display none workflow move btn. ( #7666 ) ( #7667 )
...
Co-authored-by: songjianet <1778651752@qq.com>
3 years ago
Jiajie Zhong
d23b3444bb
[python] Fix task condition set wrong deps ( #7650 ) ( #7655 )
...
After #7505 merged. we could use condition task type
but our dependent set in the wrong direction, all
the condition operators should be upstream of the
current task instead of downstream
fix : #7649
3 years ago
wind
affb2a3f0f
fix workflow copy ( #7659 ) ( #7663 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 ( #7641 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
wind
6033e98a2d
[cherry-pick-2.0.2][ApiServer] workflow copy ( #7657 )
...
* fix 7597 (#7598 )
* cherry-pick #7647
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
Jiajie Zhong
250e857c70
Fix python gateway will start each time others server start ( #7648 )
...
Add PythonGatewayServer to StandaloneServer
Change ComponentScan
Add log file and server start log
3 years ago
wind
744577f252
remove taskInstancnCacheManager ( #7636 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
wind
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
zwZjut
6c819ee16d
[Bug] [dolphinscheduler-server] workflow is always running when worker sendResult success but master not received ( #7610 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7609
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
BaoLiang
8fa61cf050
[FIX-7287] change description of 'master.exec.threads' ( #7588 )
...
* [2.0.2] #7287 change description of 'master.exec.threads'
* [2.0.2] #7287 change description of 'master.exec.threads'
3 years ago
wind
1693405383
[cherry-pick-2.0.2] #7556 #7530 #7506 ( #7570 )
...
* [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )
* [DS-7227][refactor] optimize alert plugin instance list order (#7506 )
[DS-7227][refactor] optimize alert plugin instance list order
query all alert plugin instance list order by update time desc
optimize `select *` sql in the AlterPluginInstanceMapper.xml
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: Tom <532066967@qq.com>
3 years ago
xiangzihao
5c297a594c
fix 7534 ( #7567 )
...
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
wind
281cea8a64
fix 2.0.2 upgrade sql ( #7566 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
SbloodyS
ab1467e622
cherry-pick bug_7537 ( #7555 )
3 years ago
zwZjut
c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 ( #7540 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7511
* to #7511
* to #7511
* to #7511
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
kezhenxu94
1657ce31a6
Adjust zookeeper log level ( #7468 )
3 years ago
SbloodyS
0b6f3fb0c3
[Cherry-pick-2.0.2[Feature-7460][]Feature-7451][Fix-7392] ( #7483 )
...
* remove date+1 when the data is supplemented (#7452 )
* resolve conflict
* [Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393 )
* fix bug_7392
* fix bug_7392
* fix bug_7392
Co-authored-by: SbloodyS <sbloodys@qq.com>
* cherry-pick-2.0.2
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
ouyangyewei
60001f807e
[Cherry-pick-2.0.2][Feature-7418][dolphinscheduler-api] Return domain object after UpdateXxx success ( #7421 )
...
* to feature 7418
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
ouyangyewei
895b0fa9b8
[Cherry-pick-2.0.2][Feature-7408][dolphinscheduler-api] Built GenerateToken into the UpdateToken API ( #7412 )
...
* to feature 7408
* trigger e2e test
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
songjianet
49089d3dc1
[Fix][Project List UI] Fix the calling interface that keeps decreasing by one after manually setting the `pageNo` parameter. ( #7413 )
3 years ago