DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
lenboo	720e0ad360	update sql 2.0.2	3 years ago
Jiajie Zhong	9e068d23e2	[cherry-pick][python] Make dolphinscheduler python API works to 2.0.2 (#7608 ) * [cherry-pick][python] Make it work to 2.0.2 * Remove unused ProcessExecutionTypeEnum * Add queryByName to project * Add checkTenantExists to tenant * Add queryByTenantCode to tenant * Add queryQueueName to queue * Add all content from dev branch * Add gitignore * Add pydolphinscheduler content * Add ds-py to bin test * Py merge to 202 * Fix version * Fix missing variable * Add py4j as known deps * Fix core database bug	3 years ago
wind	8c5f364796	[cherry-pick-2.0.2][BUG-7554] Fix database lose data in standalone (#7621 ) * [cherry-pick][BUG-7554] Fix database lose data in standalone * Fix thread starts too early Co-authored-by: caishunfeng <534328519@qq.com> Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	3 years ago
zwZjut	f8942bf798	[Improvement][MasterServer] event response handle parallel (#7560 ) * [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238) * to #7237 * rerun test Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `05aef27` and handle conflicts * to #7065: fix ExecutorService and schedulerService (#7072) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082) * to #7081 * fix #7081 * to #7081 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `8ebe060` and handle conflicts * cherry-pick `1f18444` and handle conflicts * fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com> * add default constructor (#6780) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * to #7108 (#7109) * to #7450 * to #7450: fix parallel bug * add index * expose config to user * fix bug * fix bug * add delay delete * fix bug * add License * fix ut * fix ut * fix name Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com>	3 years ago
wind	1693405383	[cherry-pick-2.0.2] #7556 #7530 #7506 (#7570 ) * [Improvement-#7529][tools] Init DB schema from the full sql file. (#7530) * [DS-7227][refactor] optimize alert plugin instance list order (#7506) [DS-7227][refactor] optimize alert plugin instance list order query all alert plugin instance list order by update time desc optimize `select *` sql in the AlterPluginInstanceMapper.xml Co-authored-by: lgcareer <18610854716@163.com> Co-authored-by: Tom <532066967@qq.com>	3 years ago
wind	281cea8a64	fix 2.0.2 upgrade sql (#7566 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
zwZjut	c956185e00	[Feature] 2.0.2-prepare bug fix of Pressure tests #7511 (#7540 ) * [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238) * to #7237 * rerun test Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `05aef27` and handle conflicts * to #7065: fix ExecutorService and schedulerService (#7072) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082) * to #7081 * fix #7081 * to #7081 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `8ebe060` and handle conflicts * cherry-pick `1f18444` and handle conflicts * fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com> * add default constructor (#6780) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * to #7108 (#7109) * to #7511 * to #7511 * to #7511 * to #7511 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com>	3 years ago
ouyangyewei	65a6b580ab	[Cherry-pick-2.0.2][Feature][Dolphinscheduler-api] cherry-pick from dev to 2.0.2 (#7373 ) * [Feature-7110][dolphinscheduler-api] support grant project by code * [Feature-7180][dolphinscheduler-api] Revoke project permission for specified user * [Feature-7191][dolphinscheduler-api] support query authorized user list by project code * [Feature-7301][dolphinscheduler-api] Support query access token for specified user Co-authored-by: ouyangyewei <yewei.oyyw@alibaba-inc.com>	3 years ago
zwZjut	255670fda9	[Feature][dev-2.0.2-prepare] cherry-pick pull requests from dev to 2.0.2-prepare #7357 (#7358 ) * [Feature][dolphinscheduler-api] parse traceId in http header for Cross system delivery to #7237 (#7238) * to #7237 * rerun test Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `05aef27` and handle conflicts * to #7065: fix ExecutorService and schedulerService (#7072) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * [Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082) * to #7081 * fix #7081 * to #7081 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * chery-pick `8ebe060` and handle conflicts * cherry-pick `1f18444` and handle conflicts * fix #6807: dolphinscheduler.zookeeper.env_vars - > dolphinscheduler.registry.env_vars (#6808) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com> * add default constructor (#6780) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * to #7108 (#7109) Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: Kirs <acm_master@163.com>	3 years ago
lenboo	54a89e9e24	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	ec0e57c53d	[maven-release-plugin] prepare release 2.0.1	3 years ago
lenboo	14888518db	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	bef4fa8321	[maven-release-plugin] prepare release 2.0.1	3 years ago
Kerwin	b17fa26d61	[2.0.1][Fix-7284] [api] Fix the missing project information in the process instance timeout alarm (#7309 ) * cherry pick * Fix the missing project information in the process instance timeout alarm	3 years ago
wind	79ab27299e	[cherry-pick-2.0.1][Bug-7319][MasterServer] fix NPE when switch else branch is empty (#7314 ) * fix taskNode NPE * fix switch node NPE when no else branch Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
lenboo	87e091076a	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	8b239a0728	[maven-release-plugin] prepare release 2.0.1	3 years ago
lenboo	9a49077fdf	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	29a4323540	[maven-release-plugin] prepare release 2.0.1	3 years ago
lenboo	a97bc2c756	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	c011f6487a	[maven-release-plugin] prepare release 2.0.1	3 years ago
BaoLiang	4e8507e6ca	[2.0.1] change postgre sql for serial int (#7248 ) * [Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139) 1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。 2、modify index start_time_index in init script and upgrade scripts. * [BUG][SQL] fix the process list page load slowly. (#7166) * fix #7601 move ddl to 2.0.1 * fix #7601 move ddl to 2.0.1 * [2.0.1] remove unused foreign_key * [2.0.1] add version in sql * [2.0.1] change serial for postgre Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com>	3 years ago
wind	7ecf51597f	fix postgre upgrade (#7231 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
kezhenxu94	98ab5219ff	Fix SQL create / upgrade scripts cannot run (#7212 )	3 years ago
BaoLiang	f54f2c1f91	[2.0.1-cherry-pick] fix the process list page load slowly. (#7174 )	3 years ago
Jiajie Zhong	623d154a17	Fix alert plugin instance filter (#7172 ) alert plugin could not filter by given pattern, cause api server do not handle parameter searchVal, This patch add parameter `searchVal` for alert plugin.	3 years ago
wind	659d2bb4b3	[Fix-7070][UI] Remedy the issue with no saving the timeout's strategy into the database. (#7107 ) (#7150 ) Co-authored-by: Hua Jiang <jianghuachinacom@163.com>	3 years ago
Jiajie Zhong	423d7ea3a1	[deploy] Add export database type for before daemon file (#7151 ) * [deploy] Use install_config.conf export datasource properties Directly user install_config.conf to set spring datasource properties, delete datasource.properties file for more clearly * Remove unused properties	3 years ago
JinYong Li	e96a39f57c	[2.0.1-cherrypick][Feature][API] API operation optimization (#7136 ) * pick-6863 * [Improvement][API][num-7] add task delete check (#6887) * upgrade add sub_process * add interface method * add interface method * fix ut * add task delete check * add task delete check * [Improvement][API][num-5] The workflow of the main table version is not allowed to be deleted (#6893) * feature:deleteProcessDefinitionVersion * pref:delete duplicate enum definition Co-authored-by: 北笙 <“zhanqian@cai-inc.com”> * [DS-6931][fix] swagger failed to start due to improper use of request param annotation (#6933) Co-authored-by: eye <eye.gu@aloudata.com> * [fix #6878] implement interface queryUpstreamRelation queryDownstreamRelation and add UT (#6888) * fix: #6878, implement interface queryUpstreamRelation queryDownstreamRelation and add UT * fix: #6878, implement interface queryUpstreamRelation queryDownstreamRelation and add UT * fix: #6878, add license * fix: #6878, code style * fix: #6878, code style * fix: #6878, fix Duplication * fix: #6878 * fix: #6878 , fix style * to #6878: fix style * to #6878: fix style * to #6878: add buildTaskDefinition to overwrite equals and hashCode Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> * [Improvement][API][num-6] TaskDefinition releaseTaskDefinition (#6965) * finished releaseTaskDefinition * add releaseTaskDefinition unit test * change import * add import * bug fix * change import Co-authored-by: 时光 <caizhedong@cai-inc.com> * pick-6966 * update task_definition_log field typ (#6967) * update task_definition_log field typ update task_definition_log field task_params type,modify text to longtext to be consistent with the main table * update t_ds_task_definition_log field task_params update t_ds_task_definition_log field task_params * pick-6970 * pick-6977 * pick-6984 * add processDefinition releaseWorkflowAndSchedule (#7044) * [Improvement][API][num-1] save schedule when workflow is offline in interface 'createEmptyProcessDefinition' (#7047) * [Improvement] save schedule when workflow is offline * [Improvement] rollback transactional when creating/updating schedule failed. * [Improvement] resolve merge conflict * [Improvement] do not set projectName and processDefinitionName when saving schedule * [Improvement] do not set projectName and processDefinitionName when saving schedule Co-authored-by: edward-yang <yangjianh210@gmail.com> * pick-7053 * pick-7098 * pick add 6772 relation code * fix ut Co-authored-by: Jeff Zhan <360400325@qq.com> Co-authored-by: 北笙 <“zhanqian@cai-inc.com”> Co-authored-by: ououtt <734164350@qq.com> Co-authored-by: eye <eye.gu@aloudata.com> Co-authored-by: zwZjut <zw15068835817@163.com> Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com> Co-authored-by: 时光 <41109695+yikeshiguang@users.noreply.github.com> Co-authored-by: 时光 <caizhedong@cai-inc.com> Co-authored-by: zhang <60912722+boy-xiaozhang@users.noreply.github.com> Co-authored-by: EdwardYang <yangjianh210@126.com> Co-authored-by: edward-yang <yangjianh210@gmail.com>	3 years ago
Kirs	5813d6bed3	fix some config miss (#7133 )	3 years ago
Kirs	b3e8704194	[2.0.0-chery-pick #7003 ]Fix shell tools for database schema cannot run (#7087 ) PR #7003 ISSUE #6998	3 years ago
Kirs	6955ba5a6f	[Upgrade][install] upgrade compatibility exception (#7030 ) (#7063 ) * upgrade compatibility exception * upgrade compatibility exception Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>	3 years ago
Kirs	0eac3e8eae	[2.0.1-cherrypick]Fix-6941][API] Fix the failure of querying details of alert group (#6942 ) (#7066 ) * Fix the failure of querying details of alert group * code cleanup PR #6942 ISSUE #6941 Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>	3 years ago
wind	36fd0c83f5	[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. (#7046 ) (#7059 ) Co-authored-by: Hua Jiang <jianghuachinacom@163.com>	3 years ago
Kirs	2bf3b22d64	[2.0.1-cherrypick] SPI(Task ,Alert ,DataSource) (#7041 ) * data source spi * Fix datasource not work in tests and standalone server, and run all tests by default (#6743) * Refactor alert plugins and simplify its usage (#6723) * [Fix-6792] resolve API and alert port conflicts (#6792) (#6815) * [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792) * [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828) * [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) * fix pom dep scope * filter alert * filter alert * filter alert * fix checkstyle * remove hikaricp version * update pom * add properties * add properties * rename properties * fix e2e fail * rename properties * [Fix-6792] resolve API and alert port conflicts (#6792) (#6815) [Fix-6792]Multiple ApplicationRunners on classpath make SpringApplication.run only run one (#6792) * fix ut fail * fix license * fix license * update package * update package * remove unused license Co-authored-by: mask <39329477+narcasserun@users.noreply.github.com> Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	3 years ago
Kirs	6821c7a9ac	[2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6999 ) * [2.0.1-prepare#6712]Refactor registry plugin and simplify its usage (#6712) * upgrade version and fix dep err * Clean up the utility codes (#6732) * remove code style check * upgrade docker version Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	3 years ago
lenboo	8a27ae4593	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	b31338b950	[maven-release-plugin] prepare release 2.0.0	3 years ago
OS	adaeb962ec	[cherry-pick][api] rewrite code generate,fix bit shift (#6937 ) * [Fix][Common] rewrite code generate,fix bit shift (#6914) * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut # Conflicts: # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java # dolphinscheduler-dist/release-docs/LICENSE # dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java * [Fix][Common] rewrite code generate,fix bit shift (#6914) * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut # Conflicts: # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java # dolphinscheduler-dist/release-docs/LICENSE # dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java * [Fix][Common] rewrite code generate,fix bit shift (#6914) * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut # Conflicts: # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java # dolphinscheduler-dist/release-docs/LICENSE # dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java * [Fix][Common] rewrite code generate,fix bit shift (#6914) * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut # Conflicts: # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/EnvironmentServiceImpl.java # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/service/impl/TaskDefinitionServiceImpl.java # dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/CodeGenerateUtilsTest.java # dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/upgrade/UpgradeDao.java # dolphinscheduler-dist/release-docs/LICENSE # dolphinscheduler-python/src/main/java/org/apache/dolphinscheduler/server/PythonGatewayServer.java # dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/process/ProcessService.java Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>	3 years ago
lenboo	b7d2b11d56	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	549824a036	[maven-release-plugin] prepare release 2.0.0	3 years ago
lenboo	61e86b242b	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	80c4aaaea5	[maven-release-plugin] prepare release 2.0.0	3 years ago
lenboo	8585b48402	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	5582fedafa	[maven-release-plugin] prepare release 2.0.0	3 years ago
lenboo	d8398fe7fd	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	e755355bab	[maven-release-plugin] prepare release 2.0.0	3 years ago
DingPengfei	4015448441	fix bug of extra 'and' in ResourceMapper.xml (#6876 ) Co-authored-by: ding <dingpf@helowin>	3 years ago
lenboo	446a4c5e38	[maven-release-plugin] prepare for next development iteration	3 years ago
lenboo	9bd693b7ef	[maven-release-plugin] prepare release 2.0.0	3 years ago

1 2 3 4 5 ...

591 Commits (720e0ad36059fef4581a4ba228c3a0f56f09e437)