kezhenxu94
449c098aef
Fix quartz not work, worker / alert server should not listen or 8080 port ( #7159 )
3 years ago
Jiajie Zhong
423d7ea3a1
[deploy] Add export database type for before daemon file ( #7151 )
...
* [deploy] Use install_config.conf export datasource properties
Directly user install_config.conf to set spring datasource
properties, delete datasource.properties file for more clearly
* Remove unused properties
3 years ago
JinYong Li
e96a39f57c
[2.0.1-cherrypick][Feature][API] API operation optimization ( #7136 )
...
* pick-6863
* [Improvement][API][num-7] add task delete check (#6887 )
* upgrade add sub_process
* add interface method
* add interface method
* fix ut
* add task delete check
* add task delete check
* [Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted (#6893 )
* feature:deleteProcessDefinitionVersion
* pref:delete duplicate enum definition
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
* [DS-6931][fix] swagger failed to start due to improper use of request param annotation (#6933 )
Co-authored-by: eye <eye.gu@aloudata.com>
* [fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT (#6888 )
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , implement interface queryUpstreamRelation queryDownstreamRelation and add UT
* fix : #6878 , add license
* fix : #6878 , code style
* fix : #6878 , code style
* fix : #6878 , fix Duplication
* fix : #6878
* fix : #6878 , fix style
* to #6878 : fix style
* to #6878 : fix style
* to #6878 : add buildTaskDefinition to overwrite equals and hashCode
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
* [Improvement][API][num-6] TaskDefinition releaseTaskDefinition (#6965 )
* finished releaseTaskDefinition
* add releaseTaskDefinition unit test
* change import
* add import
* bug fix
* change import
Co-authored-by: 时光 <caizhedong@cai-inc.com>
* pick-6966
* update task_definition_log field typ (#6967 )
* update task_definition_log field typ
update task_definition_log field task_params type,modify text to longtext to be consistent with the main table
* update t_ds_task_definition_log field task_params
update t_ds_task_definition_log field task_params
* pick-6970
* pick-6977
* pick-6984
* add processDefinition releaseWorkflowAndSchedule (#7044 )
* [Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' (#7047 )
* [Improvement] save schedule when workflow is offline
* [Improvement] rollback transactional when creating/updating schedule failed.
* [Improvement] resolve merge conflict
* [Improvement] do not set projectName and processDefinitionName when saving schedule
* [Improvement] do not set projectName and processDefinitionName when saving schedule
Co-authored-by: edward-yang <yangjianh210@gmail.com>
* pick-7053
* pick-7098
* pick add 6772 relation code
* fix ut
Co-authored-by: Jeff Zhan <360400325@qq.com>
Co-authored-by: 北笙 <“zhanqian@cai-inc.com”>
Co-authored-by: ououtt <734164350@qq.com>
Co-authored-by: eye <eye.gu@aloudata.com>
Co-authored-by: zwZjut <zw15068835817@163.com>
Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>
Co-authored-by: 时光 <41109695+yikeshiguang@users.noreply.github.com>
Co-authored-by: 时光 <caizhedong@cai-inc.com>
Co-authored-by: zhang <60912722+boy-xiaozhang@users.noreply.github.com>
Co-authored-by: EdwardYang <yangjianh210@126.com>
Co-authored-by: edward-yang <yangjianh210@gmail.com>
3 years ago
wind
40e00585aa
[cherry-pick][DS-6849] add delete command check ( #7074 )
...
* delete command with check
* add test
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Kirs
2bf3b22d64
[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) ( #7041 )
...
* data source spi
* Fix datasource not work in tests and standalone server, and run all tests by default (#6743 )
* Refactor alert plugins and simplify its usage (#6723 )
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
* [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 ) (#6828 )
* [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 )
* fix pom dep scope
* filter alert
* filter alert
* filter alert
* fix checkstyle
* remove hikaricp version
* update pom
* add properties
* add properties
* rename properties
* fix e2e fail
* rename properties
* [Fix-6792] resolve API and alert port conflicts (#6792 ) (#6815 )
[Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792 )
* fix ut fail
* fix license
* fix license
* update package
* update package
* remove unused license
Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
Kirs
6821c7a9ac
[2.0.1-prepare#6712]Refactor registry plugin and simplify its usage ( #6999 )
...
* [2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6712 )
* upgrade version and fix dep err
* Clean up the utility codes (#6732 )
* remove code style check
* upgrade docker version
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
3 years ago
lenboo
8a27ae4593
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b31338b950
[maven-release-plugin] prepare release 2.0.0
3 years ago
OS
adaeb962ec
[cherry-pick][api] rewrite code generate,fix bit shift ( #6937 )
...
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
* [Fix][Common] rewrite code generate,fix bit shift (#6914 )
* rewrite code generate,fix bit shift
* fix ut
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* add algorithm from licenses file
* fix ut
# Conflicts:
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java
# dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java
# dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java
# dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java
# dolphinscheduler-dist/release-docs/LICENSE
# dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java
# dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
lenboo
b7d2b11d56
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
549824a036
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
61e86b242b
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
80c4aaaea5
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
8585b48402
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
5582fedafa
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
d8398fe7fd
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
e755355bab
[maven-release-plugin] prepare release 2.0.0
3 years ago
lenboo
446a4c5e38
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
9bd693b7ef
[maven-release-plugin] prepare release 2.0.0
3 years ago
OS
03e62dc434
[Feature][Master] change sub process id to code ( #6858 ) ( #6859 )
...
* feature 6597 change sub process id to code
* feature 6597 change sub process id to code
3 years ago
OS
7f554a1ca8
[cherry-pick][Install] change sub process id to code ( #6848 )
...
* upgrade add sub_process (#6845 )
* cherry-pick 6846 change sub process id to code
* cherry-pick 6846 change sub process id to code
* ut fix
Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>
3 years ago
OS
98b8d5424a
[Feature][Install] add upgrade 2.0 ddl ( #6648 )
...
* Optimizing SQL scripts
* add upgrade 2.0 ddl
# Conflicts:
# sql/upgrade/1.4.0_schema/mysql/dolphinscheduler_ddl.sql
3 years ago
wind
855c4b7561
[DS-6660][Improvement] Change the registry default timeout ( #6663 )
...
* [DS-6660][Improvement] Change the registry default timeout
* [DS-6660][Improvement] Change the registry default timeout
* fix Double to Integer
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Hua Jiang
d13652dd81
[Fix-5875][API] When I saved the task that had the same name task in another flow ,the service would throw DuplicateKeyException ( #6430 )
...
* using the task code in the dag
# Conflicts:
# sql/upgrade/1.4.0_schema/postgresql/dolphinscheduler_ddl.sql
3 years ago
lenboo
b9e0079023
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
8fa1e8817d
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
58d03d632e
change version to '2.0.0-alpha-SNAPSHOT'
3 years ago
lenboo
fcfcedea0a
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
c82d908690
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
c644f8608f
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
Kirs
38fb2b4413
[fix-6570][task] add sql task udf resource load ( #6570 ) ( #6571 ) ( #6579 )
...
* [fix-6570][task] add sql task udf resource load (#6570 )
-add sql task udf resource load
-Fix UdfFuncRequest serialization
* fix checkstyle
* add defaultFS in sqlTaskContext
* fix checkstyle
Co-authored-by: mask <39329477+Narcasserun@users.noreply.github.com>
3 years ago
lenboo
f77efc551f
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
d6b32fecb7
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
d1ef024db1
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
2ab404e25b
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
a729c82974
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
1ac362463e
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
lenboo
81b13533a6
[maven-release-plugin] prepare for next development iteration
3 years ago
lenboo
b94735c3b7
[maven-release-plugin] prepare release 2.0.0-alpha
3 years ago
OS
6fe27389d9
[BUG-6543][Master] process instance state is always running when failure task ( #6547 ) ( #6548 )
...
* fix-6543: process instance state is always running when failure task exists
* code style
* code style
3 years ago
Kirs
07119bc17f
6471: cache process definition in master ( #6511 ) ( #6519 )
...
Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>
3 years ago
Kirs
1fd12a59b1
[DS-6499][WorkerServer] report busy state when worker is overload ( #6512 ) ( #6518 )
...
* [DS-6499][WorkerServer] report busy state when worker is overload
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
3 years ago
OS
6ffd019683
[cherry-pick][6471-6502]cherry-pick 6471 && 6502 to 2.0-prepare ( #6508 )
3 years ago
Kirs
9942d73db6
[Fix-6478] [Server] Fix the lack of scheduling time in complement parallelism mode ( #6491 ) ( #6498 )
...
* Fix the lack of scheduling time in complement parallelism mode
3 years ago
Kirs
cbc457b1a7
[Improvement-6474] [MasterServer] schedule time for process instance optimization ( #6477 ) ( #6496 )
...
* [DS-6474][MasterServer] change to handle schedule time for process instance in WorkflowExecuteThread
* delete all the valid tasks when complement data if id is not null
* checkstyle
Co-authored-by: caishunfeng <534328519@qq.com>
Co-authored-by: wind <caishunfeng@users.noreply.github.com>
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
OS
f8b68dccd7
fix bug: complement data error ( #6460 )
3 years ago
OS
c99ad738c0
[Bug-6455][Master]fix bug 6455: cannot stop sub-task ( #6458 )
...
* fix bug: cannot stop the task.
* fix bug: cannot stop the task.
* remove the check thread number
3 years ago
Kirs
ea2a8d26a0
[Improvement#6438][Worker]remove meaningless DB query ( #6440 )
...
org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread
In the process of task kill, it will query the DB to obtain the task instance object, but this judgment does not make any sense. In fact, the relevant context is already clear, so there is no need to query from DB.
3 years ago
wind
6dd0e050ce
[DS-6433][Improvement] find one command optimize without mybatis-plus ( #6434 )
...
Co-authored-by: caishunfeng <534328519@qq.com>
3 years ago
Shukun Zhang
6e453de241
[Feature] workflow level task dry run ( #6104 )
...
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
* feat workflow level task dry run
3 years ago