DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
zhuangchong	5f85235462	[maven-release-plugin] prepare for next development iteration	2 years ago
zhuangchong	cb03ca8166	[maven-release-plugin] prepare release 3.0.1	2 years ago
zhuangchong	364cafe138	[maven-release-plugin] prepare for next development iteration	2 years ago
zhuangchong	17e36b7060	[maven-release-plugin] prepare release 3.0.1	2 years ago
Kerwin	827eb60dbf	cherry-pick S3 Resource center supports bucket customization (#12022 ) Co-authored-by: guodong <guodongym@163.com>	2 years ago
Kerwin	c4c943277c	[3.0.1-prepare]cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task (#11994 ) * cherry-pick [Bug] [Worker] Optimize the getAppId method to avoid worker OOM when kill task Co-authored-by: Wenjun Ruan <wenjun@apache.org>	2 years ago
caishunfeng	5df86d0b7e	[Cherry-pick-3.0.1] #11697 #11400 #11696 (#12023 ) * [Cherry-pick-3.0.1][fix-#11691] Add lz4-java in clickhouse datasource. #11697 * [Cherry-pick-3.0.1][fix-#11689] change replaceAll to replace in method of tryExecuteSqlResolveColumnNames #11696 * [fix-11378] fix API-Server release response message typo (#11400) * [fix-11295] remove duplicate classes * [fix-11378] fix response message error Co-authored-by: fuchanghai <changhai.fu@marketingforce.com> Co-authored-by: fuchanghai <33984497+fuchanghai@users.noreply.github.com> Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>	2 years ago
Wenjun Ruan	8fefb9ecfd	Add dependent task instance log (#11541 ) (#12014 ) * Add dependent task instance log * Optimize log * Fix dependent task initialize failed will throw exception (cherry picked from commit `a41c6824fc`)	2 years ago
Kerwin	ea8b00fa89	[Fix-11051][Task]Fix the process exitValue exception when the process times out and th… (#11099 ) (#11983 )	2 years ago
Kerwin	2e64e1ca2f	cherry-pick [Bug] [spark-sql] In spark-sql, select both SPARK1 and SPARK2 versions and execute /bin/spark-sql (#11971 )	2 years ago
fuchanghai	15506a8785	[fix-#11815] fix ck column names contain special characters (#11973 ) Co-authored-by: fuchanghai <changhai.fu@marketingforce.com>	2 years ago
Kerwin	350a3632d3	cherry-pick [fix-10938]: use dot to replace source and make the default env work in shell (#11937 )	2 years ago
Jiajie Zhong	889fd580e3	[maven-release-plugin] prepare for next development iteration	2 years ago
Jiajie Zhong	9efd1ace78	[maven-release-plugin] prepare release 3.0.0	2 years ago
xuhhui	d550f9917e	fix error (#11206 ) (cherry picked from commit `bfff3a7c5d`)	2 years ago
caishunfeng	a8b1b61bd2	[Bug-11071] fix local params (#11184 ) * fix local params * add CI case (cherry picked from commit `818648df7d`)	2 years ago
caishunfeng	cec5e88319	[Bug-11071] Fix task local params NPE (#11166 ) * fix local param NPE * delete empty files	2 years ago
Wenjun Ruan	db31deb54f	[Bug] [Master] Worker failover will cause task cannot be failover (#10631 ) * fix worker failover may lose event (cherry picked from commit `66624c5c86`)	2 years ago
Wenjun Ruan	3ab9ee13fc	Optimize master log, use MDC to inject workflow instance id and task instance id in log (#10516 ) * Optimize master log, add workflow instance id and task instance id in log * Use MDC to set the workflow info in log4j * Add workflowInstanceId and taskInstanceId in MDC (cherry picked from commit `db595b3eff`)	2 years ago
Wenjun Ruan	4ceb420873	Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (#10479 ) * Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe (cherry picked from commit `ad2646ff1f`)	2 years ago
Tq	1543cdd1b5	[bug][task-plugins]fix switch class name and add param check to the switch task plugin (#10894 ) * fix switch class name and add param check to the switch task plugin	2 years ago
zhuxt2015	cb14726bdd	[Bug] [Task] SQL task no exception stack trace in task log (#10656 )	2 years ago
devosend	7ddaa2f47d	[maven-release-plugin] prepare for next development iteration	2 years ago
devosend	0a1b9bdd52	[maven-release-plugin] prepare release 3.0.0-beta-2	2 years ago
devosend	d68dcda2bb	[chore] pre-release change pom.xml	2 years ago
Jiajie Zhong	57ade38939	[maven-release-plugin] prepare release 3.0.0-beta-1	3 years ago
Dannila	d74aa47196	[Fix-10039] Flink run command when perfecting Python jobs (#10042 ) * [fix] flink task * [fix] flink task (cherry picked from commit `d643e1c1cf`)	3 years ago
zixi0825	25538aaf67	[dataquality] Fix task commnd null bug (#9974 ) (cherry picked from commit `359cbe2a1e`)	3 years ago
chuxing	44c6a053e7	[fix-9991][worker]fix statement is closed before resultSet.getMetaData() (#10014 ) (cherry picked from commit `df04c4aef0`)	3 years ago
Jiajie Zhong	a9fa6b33a4	[chore] Change release version to 3.0.0-beta-1 (#9957 )	3 years ago
Dannila	2d36449444	[Feature- 9837][plugin/ui] support FlinkSQL Task (#9840 ) * flink_sql * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * '[refactor]flinksql' * [refactor] flinksql * '[refactor]flinksql' * [refactor] dolphinscheduler flinksql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * [refactor] flink sql * Update docs/docs/en/guide/task/flink.md * Update docs/docs/zh/guide/task/flink.md * prettier front-end code Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com> Co-authored-by: devosend <devosend@gmail.com>	3 years ago
Kerwin	0e7c98d465	[Feature-9177][Task] The sql task supports configuring segmentation notation to provide execution of multiple statements (#9917 ) * Support sql segmentation to execute multiple functions.	3 years ago
sq-q	ed425d2d2d	[Feature-9772][plugin/ui] support SparkSQL Task (#9790 ) * [refactor] Dolphinscheduler sparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Dolphinscheduler SparkSQL * [refactor] Refactor ui code and add sparksql test cases * [refactor] refactor dolphinscheduler SparkSQL * [refactor] refactor dolphinscheduler plugin-sparkSQL * [refactor] refactor dolphinscheduler plugin-SparkSQL * [refactor] dolphinscheduler plugin-SparkTaskTest * [refactor] dolphinscheduler plugin-SparkTask * [refactor] dolphinscheduler plugin-Spark * [refactor] dolphinscheduler plugin-SparkTask-SparkSQL * [refactor] dolphinscheduler plugin-spark-SparkTask * [refactor] dolphinscheduler plugin-spark-SparkTask redefine code	3 years ago
zhuxt2015	206b7c1c51	[Fix-9352][datasource-api]data source client uses a cache with an expiration time (#9353 ) * datasource client cache with expiration time * remove unused import * fixed unit test * fix * fix * fix * fix * fix * fix * fix	3 years ago
exmy	36f01155b5	[Improvement][server] varPool support syntax #{setValue(key=value)} (#9586 )	3 years ago
Tq	c5b7e5adff	[Bug] [API-9558]fix homepage task instance count method to use submit time to recount (#9559 ) * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method to use submit time to recount * fix homepage task instance count method JUNIT * fix homepage task instance count method JUNIT * fix homepage task instance count method JUNIT	3 years ago
Eric Gao	a5bbf7852d	[Feature][Task-Plugin]Add zeppelin task-plugin to support Apache Zeppelin (#9327 )	3 years ago
xiangzihao	7f41a96fc1	[Fix-9525] [Worker] Environment did not work as expected (#9527 ) * fix #9525 * change to ${PYTHON_HOME} * remove import * fix ut error	3 years ago
Tq	04d4e4e0c4	fix the OUT direct param could pass to the current script (#9463 )	3 years ago
caishunfeng	b285ccf930	[Future-9396]Support output parameters transfer from parent workflow to child work flow (#9410 ) * [Future-9396]Support output parameters transfer from parent workflow to child work flow * fix note	3 years ago
Kerwin	923f3f38e3	[Fix-9316] [Task] Configure DB2 data source SQL script execution report ResultSet has been closed exception in SQL task (#9317 ) * fix db2 error in the sql task * update limit in sql task	3 years ago
nobolity	037692517a	[Fix-9251] [WORKER] reslove the sql task about of add the udf resource failed (#9319 ) * feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser) * fix(server): fix the udf serialize * fix(master task): update the udfTest to update the json string * fix(test): update the udfFuncTest * fix(common): syn the common.properties * fix(udfTest): upgrade the udfTest * fix(common): revent the common.properties	3 years ago
Tq	2a4fa9cdb1	[BUG][WORKER-9349]fix param priority (#9379 ) * fix param priority * fix params priority code logic	3 years ago
Eric Gao	fd6b43bc81	[Dev] Switch version in pom.xml to dev-SNAPSHOT (#9223 ) (#9299 )	3 years ago
caishunfeng	ddf1ff98fa	[Improvement-7697][Master/Worker] Change the task ack to runnning callback (#8719 ) * rebase dev * change task state to dispatch if dispatch success * update task host when dispatch * add dispatch task event * test * check tenant after enable auto create * handle dispatch state Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
Kerwin	d7d756e7b0	Fix DataX and Sqoop Task execute NullPointerException (#9192 )	3 years ago
nobolity	0e3cafec1d	[Feature-8612][RESOURCE] extend s3 to the storage of ds (#8637 ) * feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser)	3 years ago
Kerwin	25fc1dcb5f	Fix the exception of task getting external resource data during execution (#9134 )	3 years ago
caishunfeng	852597c9bf	[Bug-9070][Server]fix taskExecutionContext json convert error (#9072 ) * [Bug-9070][Server]fix taskExecutionContext json convert error * test * add license header Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
zixi0825	63a10037a6	fix package bug (#9051 )	3 years ago

1 2 3

115 Commits (3.0.1-release)