Sunny Lei
0dcff1425a
[DS-5229][feat] Implement server port custom config ( #6947 )
...
* [DS-5229][fix] server port custom config
This closes #5229
* [DS-5229][feat] Implement server port custom config
This closes #5229
* [Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862 )
* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link
* [Bug] [readme] Error link to Docker and k8s in readme #6802
1、modify the error link in readme_zh_cn.md
* [DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852 )
Co-authored-by: caishunfeng <534328519@qq.com>
* [DS-5229][feat] Implement server port custom config
Modify review suggestion
This closes #5229
Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
ouyangyewei
7b20f4c239
return domain after creating success ( #7050 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
JinYong Li
6e55394783
[Improvement][API][num-9] add ProcessTaskRelationServiceImpl.moveTaskProcessRelation ( #7053 )
...
* add processDefinition releaseWorkflowAndSchedule
* add ProcessTaskRelationServiceImpl.moveTaskProcessRelation
* add dependency and subprocess judgement
3 years ago
wind
8e93939121
[DS-6963][MasterServer]add cache manager for tenant and user ( #6974 )
...
* cache manager for tenant and user
* add test
* fix checkstyle
* add dependencies
* fix sonar check
* use spring boot cache configuration
* add license
* check style
* check style
* add license
* change proxy name to processor
* add license header
* check style
* add license file
* add license file
* add license
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
EdwardYang
88cd37ff0f
[Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' ( #7047 )
...
* [Improvement] save schedule when workflow is offline
* [Improvement] rollback transactional when creating/updating schedule failed.
* [Improvement] resolve merge conflict
* [Improvement] do not set projectName and processDefinitionName when saving schedule
* [Improvement] do not set projectName and processDefinitionName when saving schedule
Co-authored-by: edward-yang <yangjianh210@gmail.com>
3 years ago
zwZjut
b815da6158
to #7001 : delete certain edge in processDefinition ( #7038 )
...
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : delete certain edge in processDefinition
* to #7001 : fix checkstyle
* to #7001 : delete edge by projectCode,processDefinitionCode,preTaskCode and postTaskCode
* to #7001 : add UT
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
JinYong Li
1e9973299f
add processDefinition releaseWorkflowAndSchedule ( #7044 )
3 years ago
zwZjut
f865c26322
to #7000 : implement deleteTaskProcessRelation ( #7043 )
...
* to #7000 : implement deleteTaskProcessRelation
* to #7000 : ! CollectionUtils.isEmpty -> CollectionUtils.isNotEmpty
* to #7000 : fix bug
* to #7000 : add UT
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
EdwardYang
f30ee5956e
[Improvement][API][num-1 & 2] Implement createEmptyProcessDefinition & updateProcessDefinitionBasicInfo ( #6984 )
...
* [feature] finish interface createEmptyProcessDefinition
* [feature] finish interface updateProcessDefinitionBasicInfo
* [feature] use class Schedule replace ScheduleDto and delete it.
* [feature] delete chinese comment.
* [Improvement] change '.*' to single form of import
Co-authored-by: 熠然 <yangjianhua@cai-inc.com>
Co-authored-by: edward-yang <yangjianh210@gmail.com>
3 years ago
JinYong Li
5a04b8d49a
update schdule api ( #6977 )
3 years ago
kezhenxu94
2de4a3cbb5
Add a demo docker-compose for testing the meter module ( #6938 )
3 years ago
zwZjut
1edd2bd0f6
to #6957 implement interface deleteUpstreamRelation deleteDownstreamRelation ( #6966 )
...
* to #6957
* to #6957
* to #6957
* to #6957 : group by process definition code
* to #6957 : fix sonar
* to #6957 : fix sonar
* to #6957 : add ut , add preTaskVersion
* to #6957 : fix style
* to #6957 : use org.apache.dolphinscheduler.spi.utils.StringUtils
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
JinYong Li
e51a2a1642
[Improvement][API][num-8] add ProcessTaskRelationServiceImpl.createProcessTaskRelation ( #6970 )
...
* add ProcessTaskRelationServiceImpl.createProcessTaskRelation
* code style
3 years ago
时光
360464e279
[Improvement][API][num-6] TaskDefinition releaseTaskDefinition ( #6965 )
...
* finished releaseTaskDefinition
* add releaseTaskDefinition unit test
* change import
* add import
* bug fix
* change import
Co-authored-by: 时光 <caizhedong@cai-inc.com>
3 years ago
Kerwin
38b14410ab
[Fix-6941][API] Fix the failure of querying details of alert group ( #6942 )
...
* Fix the failure of querying details of alert group
* code cleanup
3 years ago
zwZjut
199a84aa05
[ fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT ( #6888 )
...
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , add license
* fix : #6878 , code style
* fix : #6878 , code style
* fix : #6878 , fix Duplication
* fix : #6878
* fix : #6878 , fix style
* to #6878 : fix style
* to #6878 : fix style
* to #6878 : add buildTaskDefinition to overwrite equals and hashCode
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
ououtt
1fdbc3270c
[DS-6931][fix] swagger failed to start due to improper use of request param annotation ( #6933 )
...
Co-authored-by: eye <eye.gu@aloudata.com>
3 years ago
JinYong Li
4bec792160
[Fix][Common] rewrite code generate,fix bit shift ( #6914 )
...
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
3 years ago
Jeff Zhan
3101218c73
[Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted ( #6893 )
...
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
3 years ago
JinYong Li
fc6a5116c4
[Improvement][API][num-7] add task delete check ( #6887 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
3 years ago
JinYong Li
f5e7da3cf6
[Improvement][API] add interface method ( #6863 )
...
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
3 years ago
zwZjut
94352a4f5f
fix switchVersion error ( #6783 ) ( #6784 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
OS
880c1d28ff
[Feature][master] change sub process id to code. ( #6846 )
...
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* 6597 change sub process id to code.
* code style
* fix ut process
* fix ut process
3 years ago
kezhenxu94
4114cb07f6
Add actuator and enable metrics, add Grafana configs ( #6840 )
3 years ago
mask
a998415afe
[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP ( #6490 ) ( #6828 )
...
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
3 years ago
JinYong Li
dfe4945b48
remove processDefinition resourceIds ( #6813 )
3 years ago
mask
e36d18b588
[Fix-6792] resolve API and alert port conflicts ( #6792 ) ( #6815 )
...
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
3 years ago
JinYong Li
da2a044947
[Feature][API] add processDefinitionSimpleList api ( #6814 )
...
* add processDefinitionSimpleList api
* add processDefinitionSimpleList api
3 years ago
罗铭涛
975131e913
[Improvement#6655] [UI] remove registry monitor ( #6789 )
...
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
* [DS-6655][fix] remove zkmonitor
- delete zkmonitor ui
- Modify the actions.js comma
* [DS-6655][fix] remove zkmonitor
- remove all backend API
Co-authored-by: Kirs <acm_master@163.com>
3 years ago
zwZjut
088a5a4706
add default constructor ( #6780 )
...
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
3 years ago
kezhenxu94
11844415b0
Refactor datasource and task plugins and simplify its usage ( #6767 )
3 years ago
zhang
28f871e58b
[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version ( #6765 )
...
* [FIX:201106]fix issue#6657
* replacement version number
* update resource create error messag
Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>
Co-authored-by: crane <zhangbq3306@163.com>
3 years ago
mask
0aea5ae11a
[feature-6071][plugin] add datasource plugin. ( #6071 ) ( #6361 )
...
* [feature-6071][plugin] add datasource plugin. (#6071 )
* remove the dependency of datasource in common and task-plugin module.
* the new datasource-api module provides data source connection acquisition.
* add sqlserver data source plug-in.
* add ds license
* fix check style
* update spi pom
* frx conflict resolution
* fix check style
* fix datasource ut
* fix code check style
* fix code check style
* fix datasource ut
* add pg hive mysql oracle clickhouse db2 datasource
* fix datasource package
* update datasource pom
* update datasource pom
* update datasource pom
* update datasource pom
* update pom
* update pom dep
* update pom dep
* fix license
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* fix ut
* add oracle package
* modify comments
* conflict resolution
* rename log comment
* rename log comment
3 years ago
kezhenxu94
63602bf77c
Clean up the utility codes ( #6732 )
3 years ago
OS
24bd8a16e1
[Bug][Master] The task of dependent should use taskCode ( #6730 )
...
* fix #6682 The task of dependent should use taskCode
* fix #6682 The task of dependent should use taskCode
3 years ago
Wenjun Ruan
0afb780718
[Improvement-5807][Dao] Use h2 in UT ( #6500 )
...
* Use H2 in UT
* change scope
* Change profile name to h2
* Add datasource-h2.properties, datasource-postgresql.properties
* Fix UT
* Resolve conflict
* Remove startDatabase
3 years ago
kezhenxu94
5400abc74f
Refactor registry plugin and simplify its usage ( #6712 )
3 years ago
ReonYu
d4d59b0627
[FIX 6701] [API] Fix paging error when worker group number more than 10 ( #6704 )
3 years ago
wangxj3
dc8b87e473
[Feature-#6268][server-master] Serial execte process ( #6185 )
...
* add serial processInstance
* fix bug
* add test
* fix code style
* fix style code
* add sql
* fix sql error
* add api
* add test
* fix code style
* modify api
* delete column , fix mapper
* fix unimport
* fix test
* fix bug of missing param for Python
* fix code style
* fix test
* fix test
Co-authored-by: wangxj <wangxj31>
3 years ago
Maxwell
0b93fd577d
fix REGISTER_PATH_PATTERN ( #6669 )
...
Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>
3 years ago
BenjaminWenqiYu
3a8b80971b
1. ResourceMapper rename the original 'existResource' function to 'existResourceByUser' ( #6409 )
...
2. ResourceMapper add existResource function without the userId condition
3. change the ResourceServiceImpl's private function 'checkResourceExists' without userId condition
3 years ago
Jiajie Zhong
dd6ed36f65
Add Python API implementation of workflows-as-code ( #6269 )
...
* Init DS python SDK pydolphinscheduler: python code definition
* Doc first
* Add quick start and developer doc
* Java documentation change
* Add LICENSE-py4j.txt
* Add py4j to release-docs/LICENSE
* Move dependency version to parent pom
* Remove outdated code
* Add tenant parameter to tutorial
3 years ago
wind
0d26724455
[DS-6591][API] fix process definition import ( #6592 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
mask
9b1984c244
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
3 years ago
JinYong Li
095e2e206a
fix import processDefinition error ( #6573 )
3 years ago
OS
db04a5b04d
[Feature-6471]Cache Process definition in master ( #6485 )
...
* feature-6471 Cache Process definition in master
3 years ago
Kerwin
88690462b4
[Fix-6478] [Server] Fix the lack of scheduling time in complement parallelism mode ( #6491 )
...
* fix missing history data
* update code style
* update ExecutorServiceTest test class.
3 years ago
Hua Jiang
fac6b4afd3
[Fix-5875][API] When I saved the task that had the same name task in another flow ,the service would throw DuplicateKeyException ( #6430 )
...
* using the task code in the dag
3 years ago
Shukun Zhang
6e453de241
[Feature] workflow level task dry run ( #6104 )
...
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
3 years ago
Jiajie Zhong
3e8fe68128
Remove unused parameter in function genTaskCodeList ( #6395 )
3 years ago