DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
limaiwang	25b78a8003	[Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute ${SPARK_HOME2}/bin/spark-sql (#11721 ) select different versions of spark-sql to execute different versions of spark-sql	2 years ago
kezhenxu94	147e0ae8d7	Remove duplicate Spring version management (#11899 )	2 years ago
W.XING	1164cb776d	Add chunjun in dolphinscheduler-task-all/pom.xml (#11375 )	2 years ago
juzimao	5d9331f4ee	[Feature-10683][Task Plugin] Add Java Task Plugin. (#10689 )	2 years ago
fuchanghai	e101a5cb2c	[fix-#11815] fix ck column names contain special characters (#11818 ) Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>	2 years ago
caishunfeng	2e61c76c22	[Improvement] Add remote task model (#11767 )	2 years ago
kezhenxu94	efedc9a53c	Bump up dependencies to fix cves (#11765 )	2 years ago
Kengo Seki	444c7e6eb7	[Improvement] Replace commons-lang 2 function invocations with commons-lang3 (#11810 ) * [Improvement] Replace commons-lang 2 function invocations with commons-lang3	2 years ago
fuchanghai	f8b9aad239	[feature-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames (#11696 )	2 years ago
caishunfeng	f95cdd350a	reduce task dependencies (#11731 )	2 years ago
Wenjun Ruan	03e1e6fe45	[Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11701 ) * Fix kill job may cause worker oom	2 years ago
Eric Gao	4a37345436	[Feature][Task Plugin] Support hive cli task plugin (#11651 ) * Add hive cli task plugin * Add docs for hive-cli task plugin * Fix hive-cli task related front-end nits and checkstyle * Fix exception handling logic	2 years ago
Wenjun Ruan	1b120e3a59	Refactor worker execute task process (#11540 ) * Refactor worker execute task process	2 years ago
Wenjun Ruan	b96d69701a	[Improvement-#11613] Add spi priority factory (#11614 ) * Add spi priority factory * Add doc * Add override log * Use lombok * Add comment	2 years ago
Wenjun Ruan	a41c6824fc	Add dependent task instance log (#11541 ) * Add dependent task instance log * Optimize log * Fix dependent task initialize failed will throw exception	2 years ago
kezhenxu94	13e4720aa2	Upgrade spring boot and swagger (#11574 )	2 years ago
fuchanghai	d8d5d392a7	[feature-11408] add hive option (#11493 )	2 years ago
JieguangZhou	a974ba74ab	[Feature] New task plugin Pytorch (#11498 ) Co-authored-by: Eric Gao <ericgao.apache@gmail.com>	2 years ago
FangYin Cheng	11d74fd7e8	[test-11432][HttpTask] Add unit tests to http task (#11453 ) * [test][HttpTask] Add unit tests to http task * [test][HttpTask] fix http task test code format problem * [test][HttpTask] fix http task test code replace http code to constants	2 years ago
lugela	e5d06c40a5	[Feature-10182][task-datax] (#11387 ) In the process of realizing datax synchronization, use custom json for better connection to enable kerberos-authenticated clusters, such as using plug-ins such as hdfs and hbase	2 years ago
kezhenxu94	f6ef628030	Support reading application properties from kubernetes config map (#11402 )	2 years ago
Eric Gao	896fef6c98	[Feature][Style] Enable spotless to manage imports (#11458 )	2 years ago
Kerwin	b79bad19e5	[Fix-11051][Task]Fix the process exitValue exception when the process times out and th… (#11099 )	2 years ago
Wenjun Ruan	5fa3e7b1ed	Add pause to task instance status (#11390 )	2 years ago
Stalary	6345a13cdc	[Fix-10392][SqlTask]: Fix list param error when use sql task (#11285 ) * FIX: fix list param in. * FIX: code bug * FIX: fix one value * FIX: header * FIX: ci * FIX: fix ci * MOD: for review * MOD: for review	2 years ago
caishunfeng	0464123c2b	[Feature-11223] support stream task (#11350 ) * add task execute type * update task definition list paging * update task instance list paging * stream task start * [Feature][UI] Some changes to execute task. * Set the connection edge to dashed line. * Add FLINK_STREAM task. * add stream task * flink savepoint and cancel * fix query bug * add stream task definition * add task instance for stream task * delete stream task definition state * update api for stream task definition edit * modify search for stream task instance * add language * delete task type search for stream task definition * change task type search for stream task instance * add jump button * add savepoint * add down log for stream task instance * ui test * stream task start * run DAG * [Fix][UI] Fix the stream task edgs not to be dashed when filling back. * [Feature][UI] Remove some fields for FLINK_STREAM. * add start modal * add dryRun column for stream task instance * fix duration * fix pon * fix build error * Add success tip * add auto sync for stream task instance * remove forgien key for task instance * license header * UT fix * modify locales * recover common config * fix UT * add doc Co-authored-by: Amy <amywang0104@163.com> Co-authored-by: devosend <devosend@gmail.com>	2 years ago
Assert	b3919d30e7	[Improvement-11394][Task Plugin] Remove Passed Parameter --queue in Seatunnel Task Plugin (#11395 )	2 years ago
Assert	03582f2e70	[Fix-11376][task plugin]Seatunnel Task cannot save successfully when … (#11377 )	2 years ago
Wenjun Ruan	8774415197	Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus (#11340 )	2 years ago
Eric Gao	6a02870926	[Feature][style] Add spotless maven plugin for automatic style fix. (#11272 ) * [Feature][style] Add spotless maven plugin for automatic style fix (#10963) * Fix spotless ratchet configuration * Remove license-check and decrease line length threshold value * Update related docs * Remove checkstyle and add pre-commit hook * Test updated pre-commit hook * Replace checkstyle with spotless in CI * Remove reviewdog	2 years ago
microeastcowboy	9a53c6ac34	fix work oom when task logs's size is very large (#11224 )	2 years ago
xuhhui	bfff3a7c5d	fix error (#11206 )	2 years ago
xuhhui	513f336015	[Feature] Add new task type chunjun (#10937 )	2 years ago
caishunfeng	818648df7d	[Bug-11071] fix local params (#11184 ) * fix local params * add CI case	2 years ago
Wenjun Ruan	052ceaacd0	Add is success in loop task status (#11169 )	2 years ago
Assert	cdfe115247	[Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter (#10960 ) * [Feature-10837][Task Plugin] Sqoop Task Add --split-by Parameter * checkstyle	2 years ago
Wenjun Ruan	c7789bf049	Add base loop task execotor and http template parser (#11137 ) * Add base loop task execotor and http template parser * Add JsonPathUtils	2 years ago
JieguangZhou	af7b359333	[Feature][Task Plugin] Add SageMaker Pipeline task plugin for MLOps scenario (#10826 ) (#10935 ) * add sagemaker pipeline task plugin [DOC] add Sagemaker task plugin document change license and fix dependencies * [fix] Optimize the code * Update dolphinscheduler-task-plugin/dolphinscheduler-task-sagemaker/src/main/java/org/apache/dolphinscheduler/plugin/task/sagemaker/SagemakerParameters.java Optimization parameter judgment Co-authored-by: caishunfeng <caishunfeng2021@gmail.com> * [fix] nips Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>	2 years ago
Eric Gao	f689220290	[Feature][Task Plugin] Increase zeppelin task stability in production (#11010 ) * [Feature][Task Plugin] Increase zeppelin task stability in production (#10584) * Add front-end and update docs for the production mode of zeppelin task * Fix minor front-end bug of zeppelin task plugin * Refactor ZeppelinParameters with lombok * Fix formatting * Replace @Data with @Getter, @Setter, @ToString to avoid decrease in test coverage	2 years ago
xuhhui	35f32cd16e	[Improvement][Task]Improve seatunnel task command log (#11027 )	2 years ago
Eric Gao	2f0d907bcb	[Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11045 ) * [Improvement][Task Plugin]Refactor JupyterParameters.java with lombok (#11040)	2 years ago
Wenjun Ruan	5e9c7dad23	Add dolphinscheduler-bom to manage the dependency version (#11025 )	2 years ago
JieguangZhou	11a354927d	[fix] [MLflow Task plugin] Sometimes errors are reported using preset algorithms (#10986 ) (#10987 ) * Optimize the download method of preset project * fix checkstyle	2 years ago
zhuxt2015	7196b125d9	[Feature][Datax Task]Datax task plugin support custom parameters (#10950 ) * datax task plugin support custom parameters	2 years ago
Eric Gao	a38fa34d43	[Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#10925 ) * [Feature][Task Plugin] Enable users to switch endpoints in zeppelin tasks (#9814)	2 years ago
chuxing	427c58546c	[fix][plugin]: fix spark sql use custom parma. (#10821 ) * [fix][plugin]: fix spark sql use custom parma. * [fix][plugin] roll back part of the code Co-authored-by: huaangcg <huangcg@getui.com>	2 years ago
JieguangZhou	02b2de2a1e	[fix] mlflow project success status (#10897 ) close: #10902	2 years ago
Tq	499e5b1307	[bug][task-plugins]fix switch class name and add param check to the switch task plugin (#10894 ) * fix switch class name and add param check to the switch task plugin	2 years ago
ZhaoGuodong	8eaf5a2309	[Feature-10219][EMR] EMR supports use <add-Steps> to add steps to an existing cluster (#10657 ) * Add the ProgramType parameter to distinguish task types * EmrAddStepsTask supports Add-Steps * UI supports Add-Steps * EmrTask modify the name of the class to EmrJobFlowTask * add ERM Task abstract base class AbstractEmrTask * add testcase for EmrAddStepsTask * Modifying help Documents	2 years ago
Eric Gao	71f0168510	[Feature] Enable users to create python env from requirements.txt (#10658 )	2 years ago

1 2 3 4

164 Commits (009cb68011f6f36f586d120f8d5b2ac5e92ea694)