DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
JieguangZhou	66e20271ad	[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks (#13194 ) * Supports task instance cache operation * add task plugin cache * use SHA-256 to generate key * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql Co-authored-by: Jay Chung <zhongjiajie955@gmail.com> * Optimizing database Scripts * Optimize clear cache operation Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>	2 years ago
youzipi	042ec74a24	[refactor] cache compiled regex pattern (#13208 ) * [refactor] cache compiled regex pattern * [refactor] cache compiled regex pattern * [refactor] cache compiled regex pattern	2 years ago
insist777	0e3a924a37	move v2folder (#13192 )	2 years ago
insist777	ca5af013ae	[Fix] openapi version inconsistency when updating workflows, tasks and relationship (#13094 ) Co-authored-by: xiangzihao <460888207@qq.com>	2 years ago
insist777	631e3a81d1	[Feature][API] New restful API for taskInstance (#13070 )	2 years ago
JieguangZhou	e4b9b67255	Allow execute task in workflow instance (#13103 )	2 years ago
xuhhui	0db1bb6ba8	[Improvement][ApiServer]Task defination list paging sorted by updateTime not effect (#12622 )	2 years ago
Wenjun Ruan	ab96a3d0c0	Fix datasource jdbc url param doesn't work (#13098 )	2 years ago
Wenjun Ruan	f5801a0e1c	Fix task group might be rob by multiple task (#13115 )	2 years ago
Yann Ann	6ef74073cc	[Improve-13001]migrate commons-collections -> commons-collections4 (#13002 )	2 years ago
J·Y	f9cf9331a6	Throws the correct exception for the updateResource interface (#13120 ) Co-authored-by: rqyin <rqyin@easipass.com>	2 years ago
jackfanwan	cb8d125e0f	[Improvement] optimization task definition & fix in the task definition list, if one task have more pre task, the task list can't show all task (#13106 ) * fix in the task definition list, if one task have more pre task, the task list can't show all task * modify code style * in the task definition, delete search workflow name filter, and fix in the task definition list, if one task have more pre task, the task list can't show all task * modify code style * modify code style * delete useless select sql * add annotation Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>	2 years ago
Wenjun Ruan	8a152aebc7	Fix task log file might not be clear (#13102 )	2 years ago
Wenjun Ruan	fed1e85fb8	Fix the invalidate task instance never be deleted (#13091 )	2 years ago
Wenjun Ruan	169168ef34	Add plugin-all module (#13079 )	2 years ago
Jay Chung	1192720ddc	[ci] Update skywalking-eye and fix block CI (#13076 )	2 years ago
Jay Chung	f5a59982b3	[fix] Python gateway can not upload to resource center (#13042 ) in #12076 we refactor our resource center, remove the resource table, it is a good refactor but it failed python api upload, this patch try to fix python api upload function ref: #12076	2 years ago
insist777	1064680ded	[feat][API] New restful API for workflow state (#13031 )	2 years ago
Eric Gao	c2ae76c0bd	Expand all static imports and add CI check to block wildcard static imports (#13067 )	2 years ago
Wenjun Ruan	ffc9fb280a	Add gc timestampt (#13059 )	2 years ago
insist777	a0eb45b9e4	[Feature][API] New restful API for workflowInstance (#12990 )	2 years ago
rickchengx	7336afaa65	[Fix-12916] Add permission check when query or download log (#12917 )	2 years ago
rickchengx	d09e02e5a9	[Improvement-12804][UT] Remove the unused method in DataAnalysisControllerTest (#12805 )	2 years ago
rickchengx	20518682bb	[Improvement-12853][UT] Improve the ut of ResourcePermissionCheckServiceTest (#12854 )	2 years ago
insist777	528f45acc5	[improve]Source skip check (#12900 ) * Source skip check	2 years ago
Assert	2dbc79693e	[feature][task plugin] Add new task plugin for apache linkis (#12693 )	2 years ago
Jay Chung	f20c9b3102	[chore][python] Change name from process definition to workflow (#12918 ) only change its name in python gateway server code, incluing * Function name: all related to process definition * Parameter name and comment related ref: apache/dolphinscheduler-sdk-python#22	2 years ago
Zzih	0186413a9f	[Feature][Api] Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController (#11747 ) * Feature ：Refactor org.apache.dolphinscheduler.api.controller.TaskInstanceController	2 years ago
Jay Chung	6d8befa075	[fix] Add token as authentication for python gateway (#12893 ) separate from #6407. Authentication, add secret to ensure only trusted people could connect to gateway. fix: #8255	2 years ago
Tq	d324cce6f1	[Feature-12526][Api] add dynamic task function: shell task (#12840 ) * submit dynamic task code * submit shell.json * add dynamic-task-type-config.yaml to standalone server	2 years ago
rickchengx	813c44b22b	[Improvement-12838][UT] Improve the ut of datasource (#12839 )	2 years ago
Kerwin	e3cf72cbcd	[Fix-12832][API] Fix update worker group exception group name already exists. (#12874 )	2 years ago
Jay Chung	87a88e3662	[feat] Support set execute type to pydolphinscheduler (#12871 ) Up to now, we can only submit workflow with parallel mode. this patch give users ability specific execute type to workflow	2 years ago
JieguangZhou	229c554912	[feature][task] Add Kubeflow task plugin for MLOps scenario (#12843 )	2 years ago
Jay Chung	1347a8f94c	[chore] Separate Python API into another repository (#12779 ) Currently, our Python API code is a module in apache/dolphinscheduler codebase, each time users change Python API code, they need to run all requests CI check for dolphinscheduler and Python API, But if the user does only change Python code, it could be merged if Python API CI pass and do not dependent on others CI. Besides, we release Python API as the same version of dolphinscheduler. It is easy for user to match Python API version. But when Python API does not change any code, but dolphinscheduler release a bugfix version, Python API has to release the new version to match dolphinscheduler. This happened when we released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and Python API does not change any code, so the PyPI package is the same. Separate Python API also makes our code more sense, we will have more distinguished code in dolphinscheduler and Python API new repository. Have separate issue tracker and changelog for information to users. ref PR in other repository: apache/dolphinscheduler-sdk-python#1 see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo	2 years ago
jackfanwan	641a2559ea	[fix-12687]when timeout_notify_strategy is null, modify timeout_notify_strategy (#12689 ) * According to timeoutFlag, assign timeoutNotifyStrategy value Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>	2 years ago
houshitao	04c6b5e413	[Bug][Api] Added param description. (#12813 ) Co-authored-by: houshitao <shitaohou@163.com>	2 years ago
jackfanwan	23ead4f0e8	[Bug] [dolphinscheduler-api] in the task define list, when edit task, should show pre node list (#12695 ) * backend : add pre node list * resolve workflow error Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>	2 years ago
Eric Gao	6d79414491	Add instructions on how to configure logging level for debugging purpose (#12699 )	2 years ago
JiPeng Wang	606a5aeee5	[Bug] Resource default auth function disabled false. (#12467 ) * resource function disable check fix Co-authored-by: Kerwin <37063904+zhuangchong@users.noreply.github.com>	2 years ago
jackfanwan	f249f2b257	[fix-12675]edit workflow related task, workflow's task version change (#12692 ) * edit workflow related task, workflow's task version change * Update dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/enums/Status.java Co-authored-by: fanwanlong <fanwanlong@kezaihui.com> Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Aaron Wang	04e23ed88f	Update Status.java (#12724 )	2 years ago
jackfanwan	7d0e2cbbb9	when delete workflow, delete related task (#12681 ) * when delete workflow, delete related task Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>	2 years ago
JieguangZhou	a47b4d0672	[Feature][Task] Transfer files between tasks (#12552 ) * add data transfer between tasks * add delete DATA_TRANSFER API * convert Result to DeleteDataTransferResponse * add api UT * fix final * fix doc	2 years ago
rickchengx	c69376e74c	[Improvement-12658][Permission] Improve the readability of setPerm() in grantProjectbyCode() (#12660 )	2 years ago
rickchengx	44e0935f56	[Improvement-12650][Permission] Improve the check of resourcePermissionCheck() (#12652 )	2 years ago
rickchengx	3ff328c961	[Improvement-12623][Permission]Remove the unused projectIds in operationPermissionCheck() (#12624 )	2 years ago
calvin	d84f1ef269	[Improvement][UI] Support to view the process variables on the page of DAG. (#12609 )	2 years ago
旺阳	fb9761f27a	Fix alert status spelling error (#12592 ) * fix alert status spelling error * fix-ut	2 years ago
kezhenxu94	065d5caccc	Only expose necessary actuator endpoints (#12571 )	2 years ago

1 2 3 4 5 ...

1222 Commits (f0dd4f081fcd65015d4043f59f1bba6f5f94f82e)