zhuangchong
f1a3c52a66
[maven-release-plugin] prepare release 2.0.3
3 years ago
zwZjut
d2bd95d453
[2.0.3][Bug] [dolphinscheduler-remote] process is always running: netty writeAndFlush without retry when failed leads to worker response to master failed ( #8081 )
...
* to #8046
* to #8046
* to #8046
* to #8046
* to #8046
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wind
2d3c50cbae
[Bug-7942][Config] update config of master and worker ( #7975 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
1f0aeabb92
[cherry-pick-2.0.3]Cherry pick to 2.0.3 ( #8041 )
...
* [cherry-pick-2.0.3]Correct typo in English README #7695
* Update NOTICE year (#7784 )
* [BUG] Repair JDBC connection of Oracle (#7883 )
* [cherry-pick-2.0.3][Fix-7538] [server] Fix when there is a forbidden node in dag, the execution flow is abnormal #7613
* [cherry-pick-2.0.3][Fix-7825] Remedy the value of create time and update time to be current time when importing a process json file. #7828
* [FIX-7732][fix] fix column 'is_directory' of table `t_ds_resources` type error in PG database (#7898 )
Fix column 'is_directory' of table t_ds_resources type error in PG database
This closes #7732
Co-authored-by: Brennan Fox <brnnnfx@users.noreply.github.com>
Co-authored-by: Kirs <acm_master@163.com>
Co-authored-by: X&Z <980813351@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: 天仇 <532066967@qq.com>
3 years ago
wind
99cfd4864a
fix zk root ( #7998 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
JinYong Li
ceae42721f
[cherry-pick-7930][Improvement]support instance to definition ( #7939 )
...
* Update ProcessDefinitionMapper.xml (#7931 )
Resolves process definition list issue(data duplication )
* pick 7930
* Update WorkflowExecuteThread.java
* fix pg_ddl
* fix pg_ddl
Co-authored-by: mazhong <316422240@qq.com>
Co-authored-by: BaoLiang <29528966+lenboo@users.noreply.github.com>
3 years ago
zwZjut
889274562e
to #7981 ( #7982 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wind
90a33e06eb
[cherry-pick-2.0.3] cache manager ( #7882 )
...
* cherry-pick [DS-6963][MasterServer]add cache manager for tenant and user
* [cherry-pick][Feature-6988][MasterServer] add cache manager for workflow
* [Feature][MasterServer] add cache for workGroup and schedule #6987 (#7161 )
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987 : @Param -> @Name
* to #6987 : fix Sonar
* to #6987 : fix Sonar
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [cherry-pick][Feature-6963][MasterServer] unified cache manager
* [cherry-pick][Bug-7292][ApiServer] fix cache error when standalone
* [cherry-pick][Fix-7245] [API] Fix spelEvaluationException: EL1008E: Property or field 'all' cannot be found
* bugfix
Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
46a5d17bf6
[cherry-pick-2.0.3][Improvement][TaskLog] Unified task log #7831 ( #7926 )
...
* [cherry-pick][Improvement][TaskLog] Unified task log #7831
* [cherry-pick][Improvement][TaskLog] Unified task log #7831
* fix thread name
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
8dc529d35f
[dolphinscheduler-server] process instance is always running ( #7914 )
...
* #7698
* #7698
* #7698
* fix workflow is always running
* fix workflow is always running
* fix workflow is always running
* #7700 #7698
* add license
* fix ut
* #7700 #7698
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wind
5592e7bb7b
[Bug-7788][MasterServer] fix submit duplicate tasks sometimes when retry ( #7808 ) ( #7866 )
...
* [Bug-7788] fix submit duplicate tasks sometimes when retry
* add exist check when add task to standby list
* update
* put queue contain judge first
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
1d3f77bedb
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
24ddd07493
[maven-release-plugin] prepare release 2.0.2
3 years ago
kezhenxu94
4d525536f6
Remove init script when gaining a new DB connection ( #7748 )
3 years ago
lenboo
c4eab17bd4
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
28cbaf05cb
[maven-release-plugin] prepare release 2.0.2
3 years ago
lenboo
f5fd29a05d
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
f77a117803
[maven-release-plugin] prepare release 2.0.2
3 years ago
lenboo
8f441b7776
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b36c1967b8
[maven-release-plugin] prepare release 2.0.2
3 years ago
wind
85b3b2d29d
[DS-7686][Server]fix restart server after kill force ( #7689 )
...
* [DS-7686][Server]fix restart server after kill force
* update registry logic
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
32fb3f84df
[Bug] [dolphinscheduler-server] memory leak of logger #7661 ( #7665 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
* to #7661
* to #7661
* to #7661:fix ut
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
df40cdc116
[Bug] [deploy on k8s] add default config of quartz and zookeeper in common configmap && pick #7562 fix to worker #7639 ( #7641 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* add conf && pick #7562 to worker
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
wind
744577f252
remove taskInstancnCacheManager ( #7636 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Jiajie Zhong
9e068d23e2
[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 ( #7608 )
...
* [cherry-pick][python] Make it work to 2.0.2
* Remove unused ProcessExecutionTypeEnum
* Add queryByName to project
* Add checkTenantExists to tenant
* Add queryByTenantCode to tenant
* Add queryQueueName to queue
* Add all content from dev branch
* Add gitignore
* Add pydolphinscheduler content
* Add ds-py to bin test
* Py merge to 202
* Fix version
* Fix missing variable
* Add py4j as known deps
* Fix core database bug
3 years ago
wind
8c5f364796
[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone ( #7621 )
...
* [cherry-pick][BUG-7554] Fix database lose data in standalone
* Fix thread starts too early
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
zwZjut
6c819ee16d
[Bug] [dolphinscheduler-server] workflow is always running when worker sendResult success but master not received ( #7610 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7609
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
f8942bf798
[Improvement][MasterServer] event response handle parallel ( #7560 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7450
* to #7450 : fix parallel bug
* add index
* expose config to user
* fix bug
* fix bug
* add delay delete
* fix bug
* add License
* fix ut
* fix ut
* fix name
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
BaoLiang
8fa61cf050
[FIX-7287] change description of 'master.exec.threads' ( #7588 )
...
* [2.0.2] #7287 change description of 'master.exec.threads'
* [2.0.2] #7287 change description of 'master.exec.threads'
3 years ago
xiangzihao
5c297a594c
fix 7534 ( #7567 )
...
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
SbloodyS
ab1467e622
cherry-pick bug_7537 ( #7555 )
3 years ago
zwZjut
c956185e00
[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 ( #7540 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
* to #7511
* to #7511
* to #7511
* to #7511
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
SbloodyS
0b6f3fb0c3
[Cherry-pick-2.0.2[Feature-7460][]Feature-7451][Fix-7392] ( #7483 )
...
* remove date+1 when the data is supplemented (#7452 )
* resolve conflict
* [Fix-7392][dolphinscheduler-datasource] Add hive datasource failed (#7393 )
* fix bug_7392
* fix bug_7392
* fix bug_7392
Co-authored-by: SbloodyS <sbloodys@qq.com>
* cherry-pick-2.0.2
Co-authored-by: SbloodyS <sbloodys@qq.com>
3 years ago
zwZjut
255670fda9
[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 ( #7358 )
...
* [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238 )
* to #7237
* rerun test
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 05aef27
and handle conflicts
* to #7065 : fix ExecutorService and schedulerService (#7072 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 )
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* chery-pick 8ebe060
and handle conflicts
* cherry-pick 1f18444
and handle conflicts
* fix #6807 : dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
* add default constructor (#6780 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* to #7108 (#7109 )
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
lenboo
54a89e9e24
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
ec0e57c53d
[maven-release-plugin] prepare release 2.0.1
3 years ago
BaoLiang
921f388077
[FIX-7338] set h2 for default DATABASE_TYPE for standalone-server ( #7339 )
...
* [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 )
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
* [BUG][SQL] fix the process list page load slowly. (#7166 )
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
* [2.0.1] remove unused foreign_key
* [2.0.1] add version in sql
* [2.0.1] change serial for postgre
* [2.0.1] set h2 for default DATABASE_TYPE for standalone-server
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
3 years ago
lenboo
14888518db
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
bef4fa8321
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
79ab27299e
[cherry-pick-2.0.1][Bug-7319][MasterServer] fix NPE when switch else branch is empty ( #7314 )
...
* fix taskNode NPE
* fix switch node NPE when no else branch
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
wind
5dad635ff0
[cherry-pick-2.0.1][Bug-7307][MasterServer] timeout event was filtered ( #7303 )
...
* remove task filter when task timeout
* get lastest task instance info
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
87e091076a
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
8b239a0728
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
41c05b53c7
[cherry-pick-2.0.1][Bug][MasterServer] fix timeout event ( #7283 )
...
* fix timeout alert
* fix timeout
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
lenboo
9a49077fdf
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
29a4323540
[maven-release-plugin] prepare release 2.0.1
3 years ago
wind
9a307dc71a
fix failover logic ( #7276 )
3 years ago
lenboo
a97bc2c756
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
c011f6487a
[maven-release-plugin] prepare release 2.0.1
3 years ago
kezhenxu94
a8edeac1e3
Fix env vars are not passed in from docker-compose ( #7240 )
3 years ago