zwZjut
af9ed35295
[Feature][MasterServer] add cache for workGroup and schedule #6987 ( #7161 )
...
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987
* to #6987 : @Param -> @Name
* to #6987 : fix Sonar
* to #6987 : fix Sonar
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
BaoLiang
0e75bd8008
[BUG][SQL] fix the process list page load slowly. ( #7166 )
...
* fix #7601 move ddl to 2.0.1
* fix #7601 move ddl to 2.0.1
3 years ago
GaoTianDuo
ed9fca6c97
[Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 ( #7139 )
...
1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。
2、modify index start_time_index in init script and upgrade scripts.
3 years ago
wind
ba2b2a67c2
[Feature-6988][MasterServer] add cache manager for workflow ( #7090 )
...
* add cache manager for workflow
* [DS-6988][MasterServer] add cache manager for workflow
* cache evict code optimization
* test
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
zwZjut
2bf73603bb
[Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 ( #7082 )
...
* to #7081
* fix #7081
* to #7081
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
zwZjut
8ebe060658
[Feature][dolphinscheduler-api] access control of processDefinition and processInstance in project #7073 ( #7080 )
...
* to #7073
* to #7073
* to #7073
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
wangxj3
2b519f31e9
[Feature-#6422] task group queue ( #6722 )
...
* add task group
* modify task group
* pull dev
* add license header
* modify code style
* fix code style
* fix sql error
* fix error
* fix test
* fix test
* fix test
* fix test
* fix code style
* fix ut
* code style
* fix unit test
* test ut
* ut
* add unittest
* test ut
* modify back ut
* majorization code
* fix conflict
* fix ut
Co-authored-by: wangxj <wangxj31>
3 years ago
JinYong Li
b265297fc8
[Improvement][API] fix 6772 new api bug ( #7098 )
...
* add processDefinition releaseWorkflowAndSchedule
* add ProcessTaskRelationServiceImpl.moveTaskProcessRelation
* add dependency and subprocess judgement
* fix api bug
* fix codestyle
3 years ago
Hua Jiang
d7eb7453e5
[Fix-7070][UI] Remedy the issue with no saving the timeout's strategy into the database. ( #7107 )
3 years ago
kezhenxu94
2ed3c0c3a7
Recover unit tests that have not been run for some time ( #7054 )
3 years ago
Hua Jiang
a0955a078a
[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. ( #7046 )
3 years ago
zwZjut
b815da6158
to #7001 : delete certain edge in processDefinition ( #7038 )
...
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : fix checkstyle
* to #7001 : delete edge by projectCode,processDefinitionCode,preTaskCode and postTaskCode
* to #7001 : add UT
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
JinYong Li
c5bde33ac0
[Upgrade][install] upgrade compatibility exception ( #7030 )
...
* upgrade compatibility exception
* upgrade compatibility exception
3 years ago
kezhenxu94
ef0cb46661
Fix shell tools for database schema cannot run ( #7003 )
3 years ago
JinYong Li
5a04b8d49a
update schdule api ( #6977 )
3 years ago
zwZjut
1edd2bd0f6
to #6957 implement interface deleteUpstreamRelation deleteDownstreamRelation ( #6966 )
...
* to #6957
* to #6957
* to #6957
* to #6957 : group by process definition code
* to #6957 : fix sonar
* to #6957 : fix sonar
* to #6957 : add ut , add preTaskVersion
* to #6957 : fix style
* to #6957 : use org.apache.dolphinscheduler.spi.utils.StringUtils
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
JinYong Li
e51a2a1642
[Improvement][API][num-8] add ProcessTaskRelationServiceImpl.createProcessTaskRelation ( #6970 )
...
* add ProcessTaskRelationServiceImpl.createProcessTaskRelation
* code style
3 years ago
zhang
abde2d7d28
update task_definition_log field typ ( #6967 )
...
* update task_definition_log field typ
update task_definition_log field task_params type,modify text to longtext to be consistent with the main table
* update t_ds_task_definition_log field task_params
update t_ds_task_definition_log field task_params
3 years ago
Kerwin
38b14410ab
[Fix-6941][API] Fix the failure of querying details of alert group ( #6942 )
...
* Fix the failure of querying details of alert group
* code cleanup
3 years ago
LinKai
ad33d43498
[Improvement][Dao] SQL optimization - limit one piece of data #5061 ( #6940 )
...
* [Feature][unittest] Recover UT in AlertPluginManagerTest.java #6619
* use throws exception instead of try-catch to catch exceptions in AlertPluginManagerTest.java
* change the assert result from assertNull to assertNotNull
* [Improvement][Dao] SQL optimization - limit one piece of data #5069
* Improve the code to A rate
Co-authored-by: linkai <linkai@bigo.sg>
3 years ago
zwZjut
199a84aa05
[ fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT ( #6888 )
...
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , add license
* fix : #6878 , code style
* fix : #6878 , code style
* fix : #6878 , fix Duplication
* fix : #6878
* fix : #6878 , fix style
* to #6878 : fix style
* to #6878 : fix style
* to #6878 : add buildTaskDefinition to overwrite equals and hashCode
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift ( #6914 )
...
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
3 years ago
JinYong Li
fc6a5116c4
[Improvement][API][num-7] add task delete check ( #6887 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
3 years ago
DingPengfei
842c3857c1
fix bug of extra 'and' in ResourceMapper.xml ( #6876 )
...
Co-authored-by: ding <dingpf@helowin>
3 years ago
OS
880c1d28ff
[Feature][master] change sub process id to code. ( #6846 )
...
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* code style
* fix ut process
* fix ut process
3 years ago
JinYong Li
7f3b999e5c
upgrade add sub_process ( #6845 )
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
3 years ago
Jiajie Zhong
6045728428
[ci] Add checkstyle prohibit rule System.out.println ( #6778 )
...
* [ci] Add checkstyle prohibit rule System.out.println
* Correct RegexpSingleline place
3 years ago
OS
d168a3cdf7
[feature][Install] 6597 add worker group when upgrading from version 1.x to 2.0 ( #6806 )
...
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0
* code style
* code style
* code style
* code style
* update postgre sql
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
JinYong Li
dfe4945b48
remove processDefinition resourceIds ( #6813 )
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
zhang
28f871e58b
[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version ( #6765 )
...
* [FIX:201106]fix issue#6657
* replacement version number
* update resource create error messag
Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
Co-authored-by: crane <zhangbq3306@163.com>
3 years ago
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
3 years ago
kezhenxu94
05bae0b226
Refactor alert plugins and simplify its usage ( #6723 )
3 years ago
kezhenxu94
02350ea37b
Fix datasource not work in tests and standalone server, and run all tests by default ( #6743 )
3 years ago
kezhenxu94
63602bf77c
Clean up the utility codes ( #6732 )
3 years ago
JinYong Li
bdea8d6ae4
[Upgrade][Install] fix upgrade 2.0 bug ( #6734 )
...
* add convert dependent/conditions
* fix upgrade 2.0 bug
* fix upgrade 2.0 bug
3 years ago
OS
24bd8a16e1
[Bug][Master] The task of dependent should use taskCode ( #6730 )
...
* fix #6682 The task of dependent should use taskCode
* fix #6682 The task of dependent should use taskCode
3 years ago
Wenjun Ruan
0afb780718
[Improvement-5807][Dao] Use h2 in UT ( #6500 )
...
* Use H2 in UT
* change scope
* Change profile name to h2
* Add datasource-h2.properties, datasource-postgresql.properties
* Fix UT
* Resolve conflict
* Remove startDatabase
3 years ago
wangxj3
d27c6ea8f0
fix bug ( #6728 )
...
Co-authored-by: wangxj <wangxj31>
3 years ago
小张
69f2d3b21b
[FIX:201106]fix issue#6657 ( #6717 )
...
Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
3 years ago
JinYong Li
1144360257
add convert dependent/conditions ( #6710 )
3 years ago
wangxj3
dc8b87e473
[Feature-#6268][server-master] Serial execte process ( #6185 )
...
* add serial processInstance
* fix bug
* add test
* fix code style
* fix style code
* add sql
* fix sql error
* add api
* add test
* fix code style
* modify api
* delete column , fix mapper
* fix unimport
* fix test
* fix bug of missing param for Python
* fix code style
* fix test
* fix test
Co-authored-by: wangxj <wangxj31>
3 years ago
JinYong Li
66fbcae9dd
[Upgrade][Install] add upgrade 2.0 code ( #6672 )
...
* Optimizing SQL scripts
* add upgrade 2.0 ddl
* add upgrade 2.0.0 code
* fix valid license header
* fix valid license header
* fix valid license header
* fix ut
* fix code style
* fix code style
3 years ago
chouc
900cf3a7e3
[Fix][DAS] Specify the catalog and schema when check table or column exists ( #6646 )
...
* Specify the catalog and schema when check table and column exsits
3 years ago
JinYong Li
f20444792c
[Feature][Install] add upgrade 2.0 ddl ( #6648 )
...
* Optimizing SQL scripts
* add upgrade 2.0 ddl
3 years ago
BenjaminWenqiYu
3a8b80971b
1. ResourceMapper rename the original 'existResource' function to 'existResourceByUser' ( #6409 )
...
2. ResourceMapper add existResource function without the userId condition
3. change the ResourceServiceImpl's private function 'checkResourceExists' without userId condition
3 years ago
Jiajie Zhong
dd6ed36f65
Add Python API implementation of workflows-as-code ( #6269 )
...
* Init DS python SDK pydolphinscheduler: python code definition
* Doc first
* Add quick start and developer doc
* Java documentation change
* Add LICENSE-py4j.txt
* Add py4j to release-docs/LICENSE
* Move dependency version to parent pom
* Remove outdated code
* Add tenant parameter to tutorial
3 years ago
mask
9b1984c244
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
3 years ago