DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
chenrj	e1ac0e2605	[python] Add new resource plugin: gitlab, OSS and S3 (#12025 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
Jiajie Zhong	d3f087e29b	[feat][ci] Add pre-commit for easy spotless config (#12192 ) * Use pre-commit to handle spotless check * Migrate exists python pre-commit-config into dir root one * Change related document	2 years ago
Chris	7ed52c3ecb	[improve][python] Validate version of Python API at launch (#11626 )	2 years ago
Jiajie Zhong	a86f4e2693	[fix][python] Task switch branch not show in webui (#12120 ) when create task switch in python api, switch branch not show correctly, due to we add some unnecessary attribute to switch task, this patch we add `_task_ignore_attr` in class `Task` to ignore those unnecessary attribute from `_task_default_attr`	2 years ago
chenrj	b1b57c8fb7	[feat][python] new resource plugin GitHub and gitlab (#11831 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com> Co-authored-by: JieguangZhou <jieguang_zhou@163.com> Co-authored-by: Devosend <devosend@gmail.com> Co-authored-by: juzimao <578961953@qq.com>	2 years ago
Lyle Shaw	cc492c3e13	[Feature] Add CURD to the project/tenant/user section of the python-DS (#11162 ) - Add CURD in project - Add CURD in tenant - Add CURD in user - Add test in user Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
rickchengx	08a4c7981f	[improve] Remove the spark version of spark task (#11860 )	2 years ago
JieguangZhou	cf522e2fc0	[improve] Optimize MLFlow task plugin for easy of use (#12071 ) optimize code	2 years ago
JieguangZhou	ad683c3c42	[feat][python] Support MLflow task in python api (#11962 )	2 years ago
JieguangZhou	bbc228e93f	[Feature][PyDolphinScheduler] Support DVC task in pyds #11922 (#11941 ) * add dvc task in pyds * add BaseDVC class	2 years ago
JieguangZhou	e50a32d9cc	[feat][python] Support OpenMLDB task in python api (#11944 ) Using the whole word zookeeper instead of short cut zk Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
Eric Gao	a44817fc46	[Doc][Style] Fix doc format once for all (#12006 )	2 years ago
JieguangZhou	e05f14ba23	[feat][python] Add sagemaker yaml example (#11925 )	2 years ago
JieguangZhou	5202e5cfc6	[feat][python] Support Pytorch task in python api (#11975 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
JieguangZhou	c41fa5a8b1	fix pydolphin yaml doc link (#11817 )	2 years ago
chenrj	6d460a3ca2	[DSIP-13][python] New mechanism file plugins to Python API (#11360 )	2 years ago
JieguangZhou	38ee91fb1e	[DSIP-11][python] create workflows from YAML configuration (#11611 )	2 years ago
JieguangZhou	8988492c43	[Feat][python] Add parameter environment to task (#11763 )	2 years ago
Jiajie Zhong	4dca488cd5	[python] Auto location when create process definition (#11681 ) * Add auto format when submit process definition from python api * add UPDATING.md close: #8254	2 years ago
JieguangZhou	635fde1981	[bug][python] Fix task switch error when default branch not defined last (#11606 ) Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>	2 years ago
陈家名	564a815d21	[fix][python] Sql pattern add truncate. (#11666 )	2 years ago
Kerwin	c59a8503f4	update PyDolphinScheduler documentation link. (#11474 )	2 years ago
Jiajie Zhong	4d427ee215	[python] Add support interpreter version 310 and 311-dev (#11170 ) * Change version of package * Fix tox error * Change dev status to beta * py4j not work on py{10,11} OS Windows	2 years ago
Jiajie Zhong	26afd655cb	[python] Add multiple version of document (#11391 ) * Using sphinx-multiversion to support multiple version of python api document * change python api sidebar link * fix whitelist_externals deprecated and add git close: #8227	2 years ago
陈家名	26a21566bf	[python] Add local dev mod runing python integate tests (#11362 )	2 years ago
xiangzihao	983f9b41bf	[Doc] Add tools/libs to the init database steps (#11345 )	2 years ago
陈家名	3061bbc5c4	[Python] Combine gateway.entry_point call in python api side (#11330 )	2 years ago
陈家名	aef2fbf36c	[Python] Migrate exists method call in PythonGateway to corresponding service (#11188 ) Migrate all exists method call in PythonGateway to corresponding service	2 years ago
Jiajie Zhong	9e692f919a	[python] Add directly install without clone source code (#11179 ) Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>	2 years ago
Jiajie Zhong	7a766cbcf2	[python] Refactor structure to avoid cycle import (#11167 ) Currently, our core and side module dependent on each others. and will cause cycle import in our codebase, especially in issue #10905, we try to refactor to solve this problem. This patch do the following change: * Rename module `side` to `models` * Move `core/base` and `core/sidebase` to dir `modules` * Move `configuration` and `default_config.yaml` to the root of pydolphinscheduler	2 years ago
JieguangZhou	764a24384f	[python] add import SageMaker task (#11121 )	2 years ago
JieguangZhou	952aee80e7	[fix] py sagemaker doc (#11109 )	2 years ago
JieguangZhou	cc088e0f54	[python] Support SageMaker task type (#11002 )	2 years ago
Jiajie Zhong	81930e5420	[python] Fix tasks with multiple upstream and workflow query error (#10941 ) * when task with more than one upstreams, mapper TaskDefinitionMapper method queryByName will return more than one record, and failed the mybatis result type, so we have to add `limit 1` to it to * add multiple runs of example in integrate test * Change from subprocess.Popen to subprocess.call_check in integrating test which will raise an error when failed	2 years ago
陈家名	59cd86157f	[Python] Supports creating or editing resources. (#10823 )	2 years ago
Jiajie Zhong	113a67122f	[python] fix doc build error (#10810 )	2 years ago
Jiajie Zhong	b4eee7edb6	[python] Correct some docs for python api (#10772 ) * Remove add leading `$` from command * Add copy button from code block * Using `python -m pip` to install package avoid error	2 years ago
陈家名	7970573365	[python] Support using full-name definitions for resources (#10551 )	2 years ago
陈家名	f512e3c31f	[fix][python] Correct variable type of SQL type (#10464 )	2 years ago
陈家名	b86dc53ad1	[fix][Python] Support same task name in project defferent process definition (#10428 ) close: #10431	2 years ago
Jiajie Zhong	56e0ea802d	[python] Fix process definition attr release state not work (#10151 ) This patch fix the error release state not work when it set to offline and submit it to Java gateway, it error because we do not pass the attribute to Java gateway function `createOrUpdateProcessDefinition` close: #9779	3 years ago
Jiajie Zhong	bf4b8ff0d9	[python] Change distribute name avoid confusion with main pkg (#10134 ) rename them and add `python` suffix in the end close: #9121	3 years ago
陈家名	a2cd2a99e6	[python] Fix pre_submit_check error when local params in tasks (#10032 )	3 years ago
陈家名	828034f8b9	[improve][python] Specify warning group when deploy process-definition (#9773 )	3 years ago
陈家名	8a8b63cd96	[Improve][python] Support create table syntax and custom sql type param (#9673 )	3 years ago
Kerwin	9d11be447a	[Python] Make detached signature during release (#9607 )	3 years ago
Jiajie Zhong	1f48601c75	[python] Add task decorator for python function (#9496 ) * [python] Add task decorator for python function * Add decorator `@task` * Add a tutorial about it * Change tutorial doc and combine into traditional docs * Add sphinx-inline-tab for better view * revert not need change * Correct python function indent * Correct integration test	3 years ago
Jiajie Zhong	59a026d897	[python] Support read config in env variable (#9517 ) Add a new method to get config from environment variables and for now, we have three ways to get config and the priority is `env-var > custom-config-file > built-in-config-file`. Environment config setting does not work in CLI, because it will confuse users when they get config value is `var-env` but value in the configuration file is `var-in-file`, they may not find the way how to change it * Add documentation * Add it to UPDATING.md close: #8344	3 years ago
Jiajie Zhong	3d78859fe5	[python] Recover python release properties (#9444 ) This patch recovers the properties `python.sign.skip=false` when the combined profile `release,python` is used. also close: #9433	3 years ago
Jiajie Zhong	aaf2042ec4	[python] Add missing doc about config and connect remote server (#9443 ) which includes `configuration`, `run example` `how to connect remote server` close: #9286, #9284, #8917	3 years ago

1 2 3

120 Commits (db1d31915944d2c599593c8a17a0fabd39819f8e)