DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
wen-hemin	9ae2266cd4	fix: Remove unused class (#5833 ) Co-authored-by: wen-hemin <wenhemin@apache.com>	3 years ago
wen-hemin	596821a5b6	[Improvement][Api Module] refactor registry client, remove spring annotation (#5814 ) * fix: refactor registry client, remove spring annotation * fix UT * fix UT * fix checkstyle * fix UT * fix UT * fix UT * fix: Rename RegistryCenterUtils method name Co-authored-by: wen-hemin <wenhemin@apache.com>	3 years ago
wen-hemin	e78344df2e	fix: Remove duplicate "registryClient.close" method calls (#5805 ) Co-authored-by: wen-hemin <wenhemin@apache.com>	3 years ago
傅双波	1e3ff41928	fix (#5803 ) Co-authored-by: shuangbofu <fusb@tuya.com>	3 years ago
kyoty	7bffe0ac85	[Fix-5795][Improvement][Server] The starttime field in the HttpTask log is not displayed as expected. (#5796 ) * improve timestamp format make the startime in the log of httptask to be easier to read. * fix bad code smell and update the note.	3 years ago
Wenjun Ruan	30af55b82a	[Improvement][Worker] Task log may be lost #5775 (#5783 )	3 years ago
kyoty	626c47399a	[FIX-5786][Improvement][Server] When the Worker turns down, the MasterServer cannot handle the Remove event correctly and throws NPE	3 years ago
Hua Jiang	9fd5145b66	[Improvement-5773][server] need to support two parameters related to task (#5774 ) * add some new parameter for task * restore official properties * improve imports * modify a variable's name Co-authored-by: jiang hua <jiang.hua@zhaopin.com.cn>	3 years ago
Tanvi Moharir	ab527a5e5a	[Improvement#5741][Worker] Improve task process status log (#5776 )	3 years ago
wangxj3	7a18adae52	[FIX-#5721][master-server] Global params parameter missing (#5757 ) Co-authored-by: wangxj <wangxj31>	3 years ago
wangxj3	6df58e8d78	[Feature-#5565][Master Worker-Server] Global Param passed by sense dependencies (#5603 ) * add globalParams new plan with varPool * add unit test * add python task varPoolParams Co-authored-by: wangxj <wangxj31>	3 years ago
ji04xiaogang	3b80760c42	Improved shell task execution result log information, adding process.waitFor() and process.exitValue() information to the original log (#5691 ) Co-authored-by: shenglm <shenglm840722@126.com>	3 years ago
Kirs	f508788689	[BUG-#5678][Registry]fix registry init node miss (#5686 )	3 years ago
Shiwen Cheng	93f1d4df7d	[Improvement-5405][Docker/K8s] Adapt to registry SPI (#5681 )	3 years ago
Squidyu	664206cb81	wrong word: 'WAITTING' ->'WAITING' (#5682 ) * Add:Name verification remove the first and last spaces. * Update: wrong word: 'WAITTING' ->'WAITING' Co-authored-by: Squid <2824638304@qq.com>	3 years ago
kyoty	75813e7866	[bug fix] Some password attributes can be viewd directly in the log (#5638 ) * fix the password display incorrectly * update * update * fic code style fic code style * Update SensitiveDataConverterTest.java * Update SensitiveDataConverter.java * Update SensitiveDataConverter.java * Update SensitiveDataConverterTest.java * Update pom.xml	3 years ago
justoy	0d7c32a1e8	Update TaskInstanceCacheManagerImpl.java (#5656 )	3 years ago
zhuangchong	3026f04d85	[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI (#5453 ) * flink task support submit a PyFlink job via the CLI. * optimize attribute name. * Modify pyflink parameter judgment logic	3 years ago
LOUKHNATI Mohamed Khalil	86ffc1f3f2	[Bug][WorkerServer] SqlTask NullPointerException (#5556 ) * [Bug][WorkerServer] add null checks to sqlParamsMap and sqlParamsMap.get(i), Add test to verify it * Change Test Name * Fix Code style issues, Modify checking null for Sql params in sqlParamsMap with clearer logging.	3 years ago
kyoty	67711442d5	[Improvement][SQL] Query return number In SQL should be configurable (#5632 ) * [Improvement][SQL] Query return number should be configurable #5580 * Update SqlTaskTest.java * Update sql.vue	3 years ago
zhuangchong	e2d6265e26	[Improvement][registry-plugin] Optimize registry plugin loading and initial installation #5635	3 years ago
Shiwen Cheng	8bf042ae6e	[Fix-5596][Python] Fix conflict between python_home and datax_home configuration in dolphinscheduler_env.sh (#5612 )	4 years ago
blackberrier	79eb2e85d7	[Improvement-5539][Master] Check status of taskInstance from cache (#5572 ) * improvement:check status of taskInstance from cache * issue5572 use timer instead of while&sleep; consider concurrent modification * use computeifpresent instead of lock * simplify getByTaskInstanceId function * add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl * add Apache license header;add test class in root pom	4 years ago
Kirs	e2243d63be	[Feature-#3961][Registry]Registry-SPI (#5562 ) [Feature#3961]Registry SPI All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD The registry supports distributed locks. todo: The specific information about the registration center of the API module needs to be adjusted.	4 years ago
Chouc	75be09735a	[DS-5559][fix][Master Server] Master Server was shutdown but the process still in system (#5588 ) * Close spring context to destory beans that has running thread	4 years ago
Shiwen Cheng	a5a0c7c5f8	[Fix-5570][Worker] Fix worker.groups in worker.properties is still commented and improve install scripts and configurations (#5571 )	4 years ago
geosmart	56273319a2	[Bug][Master] remove check with executePath when kill yarn job (#5552 ) * [Bug][Master] remove check with executePath when kill yarn job * [Bug][Master] init execute path if not exist * [Bug][Master] move createWorkDirIfAbsent out side of executePath calculate part Co-authored-by: wanggang <wanggy01@servyou.com.cn>	4 years ago
ruanwenjun	842c5400e6	[Improvement][Server] Must restart master if Zk reconnect (#5210 ) (#5211 )	4 years ago
ruanwenjun	9d0c816cee	[Bug][worker] task throw ConcurrentModifiedException #5528 (#5530 ) * [Bug][worker] task throw ConcurrentModifiedException #5528 * fix code smell	4 years ago
Shiwen Cheng	b537f4eb26	[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393 ) * [Improvement][Docker] Support more configurations and improve image for python * [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations * [Improvement][Python] Improve the compatibility of python home * [Improvement][Install] Fix install config and install.sh * [Improvement][Install] Fix workflow ut * [Improvement][Docker] Optimize docker-swarm/check script * [Improvement][DB] Update default username and password of database * Update comments in master/worker.properties * Specify version for all images * [Improvement][Docker] Optimize PS1 and WORKDIR * [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh * [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS	4 years ago
zhuangchong	1b7dcea610	[Improvement-5440][Maven] Project module maven dependency optimization (#5441 ) * Optimize dependencies between modules. * update module-alert dependency. * add repository in the pom xml. * update Central Repository in the pom.xml.	4 years ago
Yao WANG	bc22ae7c91	[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492 ) * remove the depreated data quality module * fix lint Co-authored-by: Yao <ywang46@paypal.com>	4 years ago
baoliang	dd80f98196	update sleep exception	4 years ago
baoliang	7aa8b518ac	Merge remote-tracking branch 'upstream/dev' into json_split # Conflicts: # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java	4 years ago
baoliang	2dd0d936fb	Merge remote-tracking branch 'upstream/dev' into json_split # Conflicts: # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/utils/DependentExecute.java	4 years ago
JinyLeeChina	515fa4912e	[Feature][JsonSplit] Fix ProcessService ut (#5435 ) * Fix ProcessService ut * codeStyle * Fix AlertPlugin ut * Fix AlertPlugin ut * Fix server module ut * Fix server module ut * Fix api ut * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
zhuangchong	9c77faa8ac	[Improvement-5058][Master] The master-server creates the DB data source twice (#5139 ) * reduce the number of data sources created twice by master server. * update ProcessAlertManagerTest test class to increase coverage. * add DolphinSchedulerPluginLoaderTest test ignore. Co-authored-by: zhuang chong	4 years ago
baoliang	c850b85484	Merge remote-tracking branch 'upstream/dev' into json_split # Conflicts: # dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessDefinitionController.java # dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/procedure/ProcedureTask.java	4 years ago
zhuangchong	88a07f7b55	[Feature-4093][server] Support for stored procedures and stored function calls and data source supports DB2 (#4094 ) * Support for stored procedures and stored function calls and data source supports DB2. Co-authored-by: zhuangchong <zhuangchong8@163.com>	4 years ago
JinyLeeChina	c3558965c1	update taskParams/add task delayTime/fix conditionType bug (#5385 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
ruanwenjun	e6d8da484f	[Improvement][API] Create Datasource #5083 (#5116 ) * [Improvement][API] Create Datasource #5083 * Refact create/ update datasource API * fix Code Smells * fix code smell * resolve code smell * use ConnectionParam to replace BaseDatasource * solve license * add ut * code check * add ut * fix ut coverage * fix ut	4 years ago
bao liang	75d1ad645c	fix bug: 5349, work flow would running if task is killed by manual. (#5362 ) Co-authored-by: baoliang <baoliang@analysys.com.cn>	4 years ago
JinyLeeChina	862565a7c7	[Feature][JsonSplit] Fix dependTask bug (#5360 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path * Fix dependTask bug Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
Wenjun	abdd2337b1	[Bug][worker] Fix sql task query result is empty (#5322 ) (#5324 ) * [Bug][worker] Fix sql task query result is empty (#5322) * add ut * remove duplicate * add ut	4 years ago
luoyuan	e57ee658e8	[Improvement] Optimized close of IO (#5336 ) * [improvement]modify all methods that refer to LogClientService in the code. * delete unused code * [Improvement] Optimized close of IO	4 years ago
JinyLeeChina	feffd972b5	[Feature][JsonSplit] Fix task logger path (#5331 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
JinyLeeChina	49b234609a	update SnowFlake (#5321 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago
luoyuan	513eb76919	[Improvement-5147][Service]This judgment always returns true (#5156 ) * this expression which always evaluates "true" * delete unused variables * LogClientService add AutoCloseable * reformat code * reformat code * reformat code * add log in ProcessService * reformat code * Optimize the code * Optimize the code * [improvement]modify all methods that refer to LogClientService in the code. * delete unused code	4 years ago
Shiwen Cheng	83519bdfc3	[Improvement][Server] Optimize log display (#5311 )	4 years ago
JinyLeeChina	f7a06a033d	[Feature][JsonSplit] Fix master/worker about shellTask (#5300 ) * Fix quoted bug about processDefineId of processInstance * Fix master/worker about shellTask * codeStyle * codeStyle * update taskType * codeStyle * update timeoutNotifyStrategy * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	4 years ago

1 2 3 4 5 ...

598 Commits (5e343d3fd21ceb2bf141e7b70524b5b3eb5fb87b)