Kerwin
ddd516cb96
Create or update users to add tenants cannot be empty verification. #7594 ( #7956 )
3 years ago
zwZjut
f02cde30b8
#7949 ( #7953 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wind
90a33e06eb
[cherry-pick-2.0.3] cache manager ( #7882 )
...
* cherry-pick [DS-6963][MasterServer]add cache manager for tenant and user
* [cherry-pick][Feature-6988][MasterServer] add cache manager for workflow
* [Feature][MasterServer] add cache for workGroup and schedule #6987 (#7161 )
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987 : @Param -> @Name
* to #6987 : fix Sonar
* to #6987 : fix Sonar
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [cherry-pick][Feature-6963][MasterServer] unified cache manager
* [cherry-pick][Bug-7292][ApiServer] fix cache error when standalone
* [cherry-pick][Fix-7245] [API] Fix spelEvaluationException: EL1008E: Property or field 'all' cannot be found
* bugfix
Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
46a5d17bf6
[cherry-pick-2.0.3][Improvement][TaskLog] Unified task log #7831 ( #7926 )
...
* [cherry-pick][Improvement][TaskLog] Unified task log #7831
* [cherry-pick][Improvement][TaskLog] Unified task log #7831
* fix thread name
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
8dc529d35f
[dolphinscheduler-server] process instance is always running ( #7914 )
...
* #7698
* #7698
* #7698
* fix workflow is always running
* fix workflow is always running
* fix workflow is always running
* #7700 #7698
* add license
* fix ut
* #7700 #7698
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
zwZjut
419f18f8b8
[Feature][dolphinscheduler-dao] expose hikari parameters when deploy on k8s #7910 ( #7911 )
...
* #7910
* #7910
* #7910
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
xiangzihao
6b2ae79d5f
[Fix-7902] The default registration plug-in is missing parameters ( #7903 )
...
* add exist check when add task to standby list
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
3 years ago
xiangzihao
be86eaf357
[Cherry-pick-2.0.3] 20220107 ( #7871 )
...
* cherry-pick
* fix bug_7629 (#7630 )
* fix bug_7564 (#7625 )
* fix bug_7512 (#7716 )
* [Fix-7459][Sqoop] running error in parallel (#7752 )
* fix bug_7459
* fix bug_7459
* fix bug_7459
* fix bug_7459
* fix bug_7459
Co-authored-by: SbloodyS <sbloodys@qq.com>
* [Feature-7576][Master] Optimize complement task's date (#7585 )
* feature_7576
* feature_7576
* feature 7576
* feature 7576
* [Fix-7767]Task instance is not deleted while deleting the process instance (#7768 )
* fix bug_7767
* fix bug_7767
* fix bug_7767
* fix bug_7767
* fix bug_7767
* [Feature-5951][Improvement][UI] When creating an alarm instance, the alarm instance name input box prompts optimization (#7770 )
* cherry-pick
* [Fix-7773][Api] malform batchDeleteProcessInstanceByIds log output (#7774 )
* bug_7773
* bug_7773
* bug_7773
* bug_7773
* bug_7773
* [Feature-7777][UI] process definition page add create username (#7778 )
* feature_7777
* fix bug_7499 (#7739 )
Co-authored-by: SbloodyS <sbloodys@qq.com>
* fix conflict
* fix conflict
* fix mapState never used error
* fix bug_7789 (#7790 )
Co-authored-by: SbloodyS <sbloodys@qq.com>
Co-authored-by: SbloodyS <sbloodys@qq.com>
Co-authored-by: wangyizhi <wangyizhi1_yewu@cmss.chinamobile.com>
3 years ago
wind
5592e7bb7b
[Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry ( #7808 ) ( #7866 )
...
* [Bug-7788] fix submit duplicate tasks sometimes when retry
* add exist check when add task to standby list
* update
* put queue contain judge first
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
1d3f77bedb
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
24ddd07493
[maven-release-plugin] prepare release 2.0.2
3 years ago
Jiajie Zhong
d1fcb0e821
[deployment] Drop support Ambari plugins in 2.0.2 ( #7749 )
...
Our ambari plugin is only support version before 2.0
and not work in currently version, so we just drop
Ambari directory
3 years ago
mask
a668c46e89
[fix-7750]Compatible historical version data source connection information( #7750 ) ( #7751 )
3 years ago
kezhenxu94
4d525536f6
Remove init script when gaining a new DB connection ( #7748 )
3 years ago
lenboo
c4eab17bd4
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
28cbaf05cb
[maven-release-plugin] prepare release 2.0.2
3 years ago
wind
35a1d732c6
[cherry-pick-2.0.2] fix depend task project 202 #7726 ( #7727 )
...
* [DS-7654][ApiServer]fix dependent node on change projectCode error
* test
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
kezhenxu94
6aaecdbd0b
Remove fast return for alert plugins due to bean initialization lifecycle is not determinged
...
Causing alert sender is not executed
3 years ago
lenboo
f5fd29a05d
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
f77a117803
[maven-release-plugin] prepare release 2.0.2
3 years ago
BaoLiang
b8f0bebadd
[cherry-pick][Fix-7485]Fix create hive datasource using ZooKee… ( #7710 )
...
* [Fix-7485][datasource-plugin] Fix create hive datasource using ZooKeeper way in 2.0.1 (#7489 )
# Conflicts:
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-api/src/test/java/org/apache/dolphinscheduler/plugin/datasource/api/provider/JdbcDataSourceProviderTest.java
# dolphinscheduler-datasource-plugin/dolphinscheduler-datasource-hive/src/main/java/org/apache/dolphinscheduler/plugin/datasource/hive/HiveDataSourceClient.java
* update
Co-authored-by: wangbowen <419444275@qq.com>
3 years ago
wind
a262eebbce
fix sql split error ( #7709 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
ed0c233c1a
Hotfix python gateway server component filter ( #7708 )
3 years ago
lenboo
8f441b7776
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b36c1967b8
[maven-release-plugin] prepare release 2.0.2
3 years ago
lenboo
27795e695e
update docker version to 2.0.2
3 years ago
lenboo
720e0ad360
update sql 2.0.2
3 years ago
JinYong Li
890faffd22
[Bug][ApiServer] workflow copy ( #7694 )
...
* fix workflow copy
* fix copy
* fix copy
* code style
3 years ago
Jiajie Zhong
24747b3dae
[python] Fix task switch set global parameter ( #7693 )
...
* [python] Fix task switch set global parameter
* Change name
3 years ago
wind
85b3b2d29d
[DS-7686][Server]fix restart server after kill force ( #7689 )
...
* [DS-7686][Server]fix restart server after kill force
* update registry logic
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
BaoLiang
bcef5f5588
[cherry-pick][FIX-#6727] Fix procedure params bug ( #7680 ) ( #7692 )
...
* [FIX-#6727][worker-server] Fix procedure params bug (#7680 )
* fix Procedure param error
* code style
Co-authored-by: wangxj <wangxj31>
# Conflicts:
# dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/AbstractTaskExecutor.java
# dolphinscheduler-task-plugin/dolphinscheduler-task-procedure/src/main/java/org/apache/dolphinscheduler/plugin/task/procedure/ProcedureTask.java
* update
Co-authored-by: wangxj3 <857234426@qq.com>
3 years ago
BaoLiang
5ede171140
[Fix-7654]Dependent node onChangeProjectCode error ( #7672 ) ( #7691 )
...
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* fix #7654 Dependent node onChangeProjectCode error
* update ut
3 years ago
Jiajie Zhong
4f4cbba80d
[UI] Fix wrong dialogs for process definition's version info ( #7684 )
...
We should use process_definition.update_time instead of create time
to make more sence.
close : #7660
3 years ago
zwZjut
32fb3f84df
[Bug] [dolphinscheduler-server] memory leak of logger #7661 ( #7665 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
* to #7661
* to #7661
* to #7661:fix ut
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
Jiajie Zhong
f2aef53ad1
Fix bug in python example ( #7681 )
...
Fix example bug in switch and datax task type.
Fix misunderstanding for condition node
* [python] Fix switch example workflow name conflict to dependent
* [python] Fix task condition missing branch success and fail
* [python] Task datax add more detail example
3 years ago
JinYong Li
54525806df
fix workflow copy ( #7677 )
3 years ago
Jiajie Zhong
fa52022ccd
[Feature][Workflow Move] Display none workflow move btn. ( #7666 ) ( #7667 )
...
Co-authored-by: songjianet <1778651752@qq.com>
3 years ago
Jiajie Zhong
d23b3444bb
[python] Fix task condition set wrong deps ( #7650 ) ( #7655 )
...
After #7505 merged. we could use condition task type
but our dependent set in the wrong direction, all
the condition operators should be upstream of the
current task instead of downstream
fix : #7649
3 years ago
wind
affb2a3f0f
fix workflow copy ( #7659 ) ( #7663 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 ( #7641 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
wind
6033e98a2d
[cherry-pick-2.0.2][ApiServer] workflow copy ( #7657 )
...
* fix 7597 (#7598 )
* cherry-pick #7647
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
Jiajie Zhong
250e857c70
Fix python gateway will start each time others server start ( #7648 )
...
Add PythonGatewayServer to StandaloneServer
Change ComponentScan
Add log file and server start log
3 years ago
wind
744577f252
remove taskInstancnCacheManager ( #7636 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
wind
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
zwZjut
6c819ee16d
[Bug] [dolphinscheduler-server] workflow is always running when worker sendResult success but master not received ( #7610 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7609
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
BaoLiang
8fa61cf050
[FIX-7287] change description of 'master.exec.threads' ( #7588 )
...
* [2.0.2] #7287 change description of 'master.exec.threads'
* [2.0.2] #7287 change description of 'master.exec.threads'
3 years ago
wind
1693405383
[cherry-pick-2.0.2] #7556 #7530 #7506 ( #7570 )
...
* [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530 )
* [DS-7227][refactor] optimize alert plugin instance list order (#7506 )
[DS-7227][refactor] optimize alert plugin instance list order
query all alert plugin instance list order by update time desc
optimize `select *` sql in the AlterPluginInstanceMapper.xml
Co-authored-by: lgcareer <18610854716@163.com>
Co-authored-by: Tom <532066967@qq.com>
3 years ago
xiangzihao
5c297a594c
fix 7534 ( #7567 )
...
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago