DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
GaoTianDuo	ed9fca6c97	[Bug] [dolphinscheduler-api] The pages of project management, workflow instance and task instance are accessed slowly #7061 (#7139 ) 1、I found that the SQL behind this interface is very slow. The main table is large, but there is no index to use. By add the index, the all mode in the query plan can be changed into a more efficient ref mode. If this optimization still fails to meet the requirements, please contact me and I will continue to optimize。 2、modify index start_time_index in init script and upgrade scripts.	3 years ago
wind	ba2b2a67c2	[Feature-6988][MasterServer] add cache manager for workflow (#7090 ) * add cache manager for workflow * [DS-6988][MasterServer] add cache manager for workflow * cache evict code optimization * test Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
zwZjut	2bf73603bb	[Feature][dolphinscheduler-api] access control of taskDefinition and taskInstance in project to #7081 (#7082 ) * to #7081 * fix #7081 * to #7081 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
zwZjut	8ebe060658	[Feature][dolphinscheduler-api] access control of processDefinition and processInstance in project #7073 (#7080 ) * to #7073 * to #7073 * to #7073 Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
wangxj3	2b519f31e9	[Feature-#6422] task group queue (#6722 ) * add task group * modify task group * pull dev * add license header * modify code style * fix code style * fix sql error * fix error * fix test * fix test * fix test * fix test * fix code style * fix ut * code style * fix unit test * test ut * ut * add unittest * test ut * modify back ut * majorization code * fix conflict * fix ut Co-authored-by: wangxj <wangxj31>	3 years ago
JinYong Li	b265297fc8	[Improvement][API] fix 6772 new api bug (#7098 ) * add processDefinition releaseWorkflowAndSchedule * add ProcessTaskRelationServiceImpl.moveTaskProcessRelation * add dependency and subprocess judgement * fix api bug * fix codestyle	3 years ago
Hua Jiang	d7eb7453e5	[Fix-7070][UI] Remedy the issue with no saving the timeout's strategy into the database. (#7107 )	3 years ago
kezhenxu94	2ed3c0c3a7	Recover unit tests that have not been run for some time (#7054 )	3 years ago
Hua Jiang	a0955a078a	[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. (#7046 )	3 years ago
zwZjut	b815da6158	to #7001 : delete certain edge in processDefinition (#7038 ) * to #7001: delete certain edge in processDefinition * to #7001: delete certain edge in processDefinition * to #7001: delete certain edge in processDefinition * to #7001: delete certain edge in processDefinition * to #7001: fix checkstyle * to #7001: delete edge by projectCode,processDefinitionCode,preTaskCode and postTaskCode * to #7001: add UT Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
JinYong Li	c5bde33ac0	[Upgrade][install] upgrade compatibility exception (#7030 ) * upgrade compatibility exception * upgrade compatibility exception	3 years ago
kezhenxu94	ef0cb46661	Fix shell tools for database schema cannot run (#7003 )	3 years ago
JinYong Li	5a04b8d49a	update schdule api (#6977 )	3 years ago
zwZjut	1edd2bd0f6	to #6957 implement interface deleteUpstreamRelation deleteDownstreamRelation (#6966 ) * to #6957 * to #6957 * to #6957 * to #6957: group by process definition code * to #6957: fix sonar * to #6957: fix sonar * to #6957: add ut , add preTaskVersion * to #6957: fix style * to #6957: use org.apache.dolphinscheduler.spi.utils.StringUtils Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
JinYong Li	e51a2a1642	[Improvement][API][num-8] add ProcessTaskRelationServiceImpl.createProcessTaskRelation (#6970 ) * add ProcessTaskRelationServiceImpl.createProcessTaskRelation * code style	3 years ago
zhang	abde2d7d28	update task_definition_log field typ (#6967 ) * update task_definition_log field typ update task_definition_log field task_params type,modify text to longtext to be consistent with the main table * update t_ds_task_definition_log field task_params update t_ds_task_definition_log field task_params	3 years ago
Kerwin	38b14410ab	[Fix-6941][API] Fix the failure of querying details of alert group (#6942 ) * Fix the failure of querying details of alert group * code cleanup	3 years ago
LinKai	ad33d43498	[Improvement][Dao] SQL optimization - limit one piece of data #5061 (#6940 ) * [Feature][unittest] Recover UT in AlertPluginManagerTest.java #6619 * use throws exception instead of try-catch to catch exceptions in AlertPluginManagerTest.java * change the assert result from assertNull to assertNotNull * [Improvement][Dao] SQL optimization - limit one piece of data #5069 * Improve the code to A rate Co-authored-by: linkai <linkai@bigo.sg>	3 years ago
zwZjut	199a84aa05	[fix #6878 ] implement interface queryUpstreamRelation queryDownstreamRelation and add UT (#6888 ) * fix: #6878, implement interface queryUpstreamRelation queryDownstreamRelation and add UT * fix: #6878, implement interface queryUpstreamRelation queryDownstreamRelation and add UT * fix: #6878, add license * fix: #6878, code style * fix: #6878, code style * fix: #6878, fix Duplication * fix: #6878 * fix: #6878 , fix style * to #6878: fix style * to #6878: fix style * to #6878: add buildTaskDefinition to overwrite equals and hashCode Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
JinYong Li	4bec792160	[Fix][Common] rewrite code generate,fix bit shift (#6914 ) * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut	3 years ago
JinYong Li	fc6a5116c4	[Improvement][API][num-7] add task delete check (#6887 ) * upgrade add sub_process * add interface method * add interface method * fix ut * add task delete check * add task delete check	3 years ago
DingPengfei	842c3857c1	fix bug of extra 'and' in ResourceMapper.xml (#6876 ) Co-authored-by: ding <dingpf@helowin>	3 years ago
OS	880c1d28ff	[Feature][master] change sub process id to code. (#6846 ) * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * code style * fix ut process * fix ut process	3 years ago
JinYong Li	7f3b999e5c	upgrade add sub_process (#6845 )	3 years ago
kezhenxu94	4114cb07f6	Add actuator and enable metrics, add Grafana configs (#6840 )	3 years ago
mask	a998415afe	[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490 ) (#6828 ) * [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) * fix pom dep scope * filter alert * filter alert * filter alert * fix checkstyle * remove hikaricp version * update pom * add properties * add properties * rename properties * fix e2e fail * rename properties	3 years ago
Jiajie Zhong	6045728428	[ci] Add checkstyle prohibit rule System.out.println (#6778 ) * [ci] Add checkstyle prohibit rule System.out.println * Correct RegexpSingleline place	3 years ago
OS	d168a3cdf7	[feature][Install] 6597 add worker group when upgrading from version 1.x to 2.0 (#6806 ) * feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0 * feature 6597 add worker group. Upgrade dolphinscheduler version 1. X to version 2.0 * code style * code style * code style * code style * update postgre sql Co-authored-by: JinYong Li <42576980+JinyLeeChina@users.noreply.github.com>	3 years ago
JinYong Li	dfe4945b48	remove processDefinition resourceIds (#6813 )	3 years ago
kezhenxu94	11844415b0	Refactor datasource and task plugins and simplify its usage (#6767 )	3 years ago
zhang	28f871e58b	[Fix-6764]modifying prompt messages and modify dolphinscheduler_mysql.sql dolphinscheduler version (#6765 ) * [FIX:201106]fix issue#6657 * replacement version number * update resource create error messag Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com> Co-authored-by: crane <zhangbq3306@163.com>	3 years ago
mask	0aea5ae11a	[feature-6071][plugin] add datasource plugin. (#6071 ) (#6361 ) * [feature-6071][plugin] add datasource plugin. (#6071) * remove the dependency of datasource in common and task-plugin module. * the new datasource-api module provides data source connection acquisition. * add sqlserver data source plug-in. * add ds license * fix check style * update spi pom * frx conflict resolution * fix check style * fix datasource ut * fix code check style * fix code check style * fix datasource ut * add pg hive mysql oracle clickhouse db2 datasource * fix datasource package * update datasource pom * update datasource pom * update datasource pom * update datasource pom * update pom * update pom dep * update pom dep * fix license * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * add oracle package * modify comments * conflict resolution * rename log comment * rename log comment	3 years ago
kezhenxu94	05bae0b226	Refactor alert plugins and simplify its usage (#6723 )	3 years ago
kezhenxu94	02350ea37b	Fix datasource not work in tests and standalone server, and run all tests by default (#6743 )	3 years ago
kezhenxu94	63602bf77c	Clean up the utility codes (#6732 )	3 years ago
JinYong Li	bdea8d6ae4	[Upgrade][Install] fix upgrade 2.0 bug (#6734 ) * add convert dependent/conditions * fix upgrade 2.0 bug * fix upgrade 2.0 bug	3 years ago
OS	24bd8a16e1	[Bug][Master] The task of dependent should use taskCode (#6730 ) * fix #6682 The task of dependent should use taskCode * fix #6682 The task of dependent should use taskCode	3 years ago
Wenjun Ruan	0afb780718	[Improvement-5807][Dao] Use h2 in UT (#6500 ) * Use H2 in UT * change scope * Change profile name to h2 * Add datasource-h2.properties, datasource-postgresql.properties * Fix UT * Resolve conflict * Remove startDatabase	3 years ago
wangxj3	d27c6ea8f0	fix bug (#6728 ) Co-authored-by: wangxj <wangxj31>	3 years ago
小张	69f2d3b21b	[FIX:201106]fix issue#6657 (#6717 ) Co-authored-by: 张柏强 <zhangbaiqiang@lvshou.com>	3 years ago
JinYong Li	1144360257	add convert dependent/conditions (#6710 )	3 years ago
wangxj3	dc8b87e473	[Feature-#6268][server-master] Serial execte process (#6185 ) * add serial processInstance * fix bug * add test * fix code style * fix style code * add sql * fix sql error * add api * add test * fix code style * modify api * delete column , fix mapper * fix unimport * fix test * fix bug of missing param for Python * fix code style * fix test * fix test Co-authored-by: wangxj <wangxj31>	3 years ago
JinYong Li	66fbcae9dd	[Upgrade][Install] add upgrade 2.0 code (#6672 ) * Optimizing SQL scripts * add upgrade 2.0 ddl * add upgrade 2.0.0 code * fix valid license header * fix valid license header * fix valid license header * fix ut * fix code style * fix code style	3 years ago
chouc	900cf3a7e3	[Fix][DAS] Specify the catalog and schema when check table or column exists (#6646 ) * Specify the catalog and schema when check table and column exsits	3 years ago
JinYong Li	f20444792c	[Feature][Install] add upgrade 2.0 ddl (#6648 ) * Optimizing SQL scripts * add upgrade 2.0 ddl	3 years ago
BenjaminWenqiYu	3a8b80971b	1. ResourceMapper rename the original 'existResource' function to 'existResourceByUser' (#6409 ) 2. ResourceMapper add existResource function without the userId condition 3. change the ResourceServiceImpl's private function 'checkResourceExists' without userId condition	3 years ago
Jiajie Zhong	dd6ed36f65	Add Python API implementation of workflows-as-code (#6269 ) * Init DS python SDK pydolphinscheduler: python code definition * Doc first * Add quick start and developer doc * Java documentation change * Add LICENSE-py4j.txt * Add py4j to release-docs/LICENSE * Move dependency version to parent pom * Remove outdated code * Add tenant parameter to tutorial	3 years ago
mask	9b1984c244	[fix-6570][task] add sql task udf resource load (#6570 ) (#6571 ) * [fix-6570][task] add sql task udf resource load (#6570) -add sql task udf resource load -Fix UdfFuncRequest serialization * fix checkstyle * add defaultFS in sqlTaskContext * fix checkstyle	3 years ago
wind	18b324e4d5	fix sql exception in pgsql (#6576 ) Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
OS	52a550b6ae	[BUG-6543][Master] process instance state is always running when failure task (#6547 ) * fix-6543: process instance state is always running when failure task exists * code style * code style	3 years ago

1 2 3 4 5 ...

665 Commits (8fab224e0de98eb46380b72b8115c695fd4c3bec)