DolphinScheduler

Commit Graph

Author	SHA1	Message	Date
kyoty	75813e7866	[bug fix] Some password attributes can be viewd directly in the log (#5638 ) * fix the password display incorrectly * update * update * fic code style fic code style * Update SensitiveDataConverterTest.java * Update SensitiveDataConverter.java * Update SensitiveDataConverter.java * Update SensitiveDataConverterTest.java * Update pom.xml	3 years ago
zhuangchong	3026f04d85	[Improvement-5452][Task] ds flink task support submit a PyFlink job via the CLI (#5453 ) * flink task support submit a PyFlink job via the CLI. * optimize attribute name. * Modify pyflink parameter judgment logic	3 years ago
kyoty	67711442d5	[Improvement][SQL] Query return number In SQL should be configurable (#5632 ) * [Improvement][SQL] Query return number should be configurable #5580 * Update SqlTaskTest.java * Update sql.vue	3 years ago
kyoty	0d5037e7c3	[Fix-5483] [Bug][API] Can't view variables in the page of Process Instance (#5631 )	3 years ago
blackberrier	79eb2e85d7	[Improvement-5539][Master] Check status of taskInstance from cache (#5572 ) * improvement:check status of taskInstance from cache * issue5572 use timer instead of while&sleep; consider concurrent modification * use computeifpresent instead of lock * simplify getByTaskInstanceId function * add ut for TaskInstanceCacheManagerImpl; fix bug in TaskInstanceCacheManagerImpl * add Apache license header;add test class in root pom	3 years ago
Kirs	e2243d63be	[Feature-#3961][Registry]Registry-SPI (#5562 ) [Feature#3961]Registry SPI All the logical structure of the registry must be converted into a tree structure within the system, so some plug-ins must be converted internally, such as ETCD The registry supports distributed locks. todo: The specific information about the registration center of the API module needs to be adjusted.	3 years ago
Shiwen Cheng	281b5aea6b	[Fix-5468][Common] Fix obtaining IP is incorrect (#5594 )	3 years ago
Shiwen Cheng	b537f4eb26	[Improvement][Docker/K8s] Support more configurations and service accesses, reduce the duplication configurations, improve image for python and the compatibility of python home (#5393 ) * [Improvement][Docker] Support more configurations and improve image for python * [Improvement][K8s] Support more configurations, more service accesses, and reduce the duplication configurations * [Improvement][Python] Improve the compatibility of python home * [Improvement][Install] Fix install config and install.sh * [Improvement][Install] Fix workflow ut * [Improvement][Docker] Optimize docker-swarm/check script * [Improvement][DB] Update default username and password of database * Update comments in master/worker.properties * Specify version for all images * [Improvement][Docker] Optimize PS1 and WORKDIR * [Improvement][SQL] Reduce heap size to 64m in create-dolphinscheduler.sh and upgrade-dolphinscheduler.sh * [Fix-5431][K8s] Fix master and worker cannot get the right address with custom DNS	3 years ago
zhuangchong	9ba4ffbe48	[Improvement-5527][api-server] failed find any kerberos (#5533 ) * fix failed find any kerberos. * increase code coverage. * update common utils test. * update common utils test. * update common utils test. * fix exception type.	3 years ago
QuakeWang	46660b58ed	[Test] Add SparkParameters test (#5478 ) * Create SparkparametersTest.java Add a test case * Update and rename SparkparametersTest.java to SparkParametersTest.java * Update pom.xml add SparkParametersTest.java in pom file	3 years ago
zhuangchong	1b7dcea610	[Improvement-5440][Maven] Project module maven dependency optimization (#5441 ) * Optimize dependencies between modules. * update module-alert dependency. * add repository in the pom xml. * update Central Repository in the pom.xml.	3 years ago
Yao WANG	bc22ae7c91	[Improvement][Task] Remove deprecated TaskRecordDao and simply the after() method in the AbstractTask class (#5492 ) * remove the depreated data quality module * fix lint Co-authored-by: Yao <ywang46@paypal.com>	3 years ago
ruanwenjun	a925f64571	[Feature][api] schedule add timezone support #5259 (#5465 ) * [Feature][api] schedule add timezone support #5259 * import moment-timezone * fix code smell	3 years ago
ruanwenjun	68301db6b9	[Improvement][Api] Upload resource to remote failed, the local tmp file need to be cleared #5475 (#5476 )	3 years ago
lcdrs	d04f4b6053	[Implement][Common] Modify the plug-in loading log to print messages Co-authored-by: caoping <caoping@staff.weibo.com>	3 years ago
zhuangchong	9c77faa8ac	[Improvement-5058][Master] The master-server creates the DB data source twice (#5139 ) * reduce the number of data sources created twice by master server. * update ProcessAlertManagerTest test class to increase coverage. * add DolphinSchedulerPluginLoaderTest test ignore. Co-authored-by: zhuang chong	3 years ago
JinyLeeChina	f7b71fb9ca	[Feature][JsonSplit] Fix codeStyle for json_split (#5432 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev * fix process lineage bug * fix codeStyle for json_split Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
baoliang	1646188027	fix code style	3 years ago
bao liang	86dcddb32b	[Feature-4417]fix code style (#5395 ) * fix code style * fix ut * remove unused ut * remove unused ut Co-authored-by: baoliang <baoliang@analysys.com.cn>	3 years ago
JinyLeeChina	2a44cb9de6	[Feature][JsonSplit] update codeStyle for merge to dev (#5392 ) * update taskParams/add task delayTime/fix conditionType bug * update codeStyle for merge to dev Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
JinyLeeChina	c3558965c1	update taskParams/add task delayTime/fix conditionType bug (#5385 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
ruanwenjun	e6d8da484f	[Improvement][API] Create Datasource #5083 (#5116 ) * [Improvement][API] Create Datasource #5083 * Refact create/ update datasource API * fix Code Smells * fix code smell * resolve code smell * use ConnectionParam to replace BaseDatasource * solve license * add ut * code check * add ut * fix ut coverage * fix ut	3 years ago
bao liang	75d1ad645c	fix bug: 5349, work flow would running if task is killed by manual. (#5362 ) Co-authored-by: baoliang <baoliang@analysys.com.cn>	3 years ago
luoyuan	e57ee658e8	[Improvement] Optimized close of IO (#5336 ) * [improvement]modify all methods that refer to LogClientService in the code. * delete unused code * [Improvement] Optimized close of IO	3 years ago
JinyLeeChina	feffd972b5	[Feature][JsonSplit] Fix task logger path (#5331 ) * update SnowFlake * update processDefinite from processInstance * update processDefinite from processInstance * Fix task logger path Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
Wenjun	5f1fc462c9	[Bug][server-api] copy the node ,the preTasks is error #5261 (#5264 )	3 years ago
JinyLeeChina	49b234609a	update SnowFlake (#5321 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
roi	837c9ba2cc	fix bug:when shell task raw script has $[${day} - 1],throw java.lang.IllegalArgumentException::Pattern includes reserved character:'{' (#5313 )	3 years ago
Shiwen Cheng	83519bdfc3	[Improvement][Server] Optimize log display (#5311 )	3 years ago
Shiwen Cheng	e92e29ef9a	[Fix-5309][Common] Fix the wrong memory (#5312 ) * [Fix-5309][Common] Fix the wrong memory * [Fix-5309][Common] Fix unit test and remove unused code	3 years ago
JinyLeeChina	f7a06a033d	[Feature][JsonSplit] Fix master/worker about shellTask (#5300 ) * Fix quoted bug about processDefineId of processInstance * Fix master/worker about shellTask * codeStyle * codeStyle * update taskType * codeStyle * update timeoutNotifyStrategy * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
wenjun	f3dfaacca2	[Improvement][Service] Optimize query log (#5205 ) * [Improvement][Service] Optimize query log * remove IPUtils	3 years ago
Shiwen Cheng	1c1f6663a6	[Improvement][WorkerGroup] Optimize and reduce database and zookeeper queries and replace worker address input with multiple-select (#5182 ) * [Improvement][Server] Optimize and reduce database and ZooKeeper query * [Improvement][WorkerGroup] Replace worker address input with multiple-select * [Improvement][WorkerGroup] Fix unit test * [Improvement][API&UI] Optimize long host to short host and long host display in k8s	3 years ago
didiaode18	0eb8c0c234	[Improvement][common]Task status error	3 years ago
JinyLeeChina	73f5a8e0a7	[Feature][JsonSplit] Fix master/worker server (#5253 ) * Fix dependency failure * Fix taskInstance * task instance list page * code review * fix logger path * Fix master/worker server Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
JinyLeeChina	31188ffca0	[Feature][JsonSplit] Fix taskInstance (#5246 ) * Fix dependency failure * Fix taskInstance * task instance list page * code review * fix logger path Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
zhuangchong	73e917d3c1	Clean up useless files. (#5252 )	3 years ago
JinyLeeChina	8c88bfa222	Fix dependency failure (#5239 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
xiaoyu	2f1f193ba8	Update common.properties (#5223 )	3 years ago
bao liang	86ce8f133a	[JsonSplit-4417][master/worker/api]json split- remove json in task instance. (#5160 ) * [json split] refactor json in task instance * add task_pramas in task_instance * feature #4417 refactor json split in task instance * code style * code style * code style * code style * code style * update * update * update unit test * update	3 years ago
JinyLeeChina	dd36da8d1f	[Feature][JsonSplit] fix process bug (#5193 ) * transform taskCode from long to string * fix process bug * code review * code review * code review Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
zhuangchong	e53369318b	[Fix-4721][worker]The shell background starts the YARN task scenario, and the kill function is abnormal (#4722 ) * fix the shell starts the yarn task in the background * update StringUtils code style. * solve code smell. * add method comment in StringUtils class. * update AlertGroupMapper code style. * update AlertGroupMapperTest * update sql script test.	3 years ago
JinyLeeChina	689106d114	transform taskCode from long to string (#5174 ) Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
JinyLeeChina	a467fffd7b	[Feature][JsonSplit] fix taskId in json (#5165 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" * fix taskId in processDefinitionJson * fix json taskId * codeStyle Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
guohaozhang	a6a1b94df4	[Feature-#5128]Support turning off sudo permissions (#5129 ) * [Feature-#5128]Support turning off sudo permissions * [Feature-#5128] without sudo permission do not create tenant user	3 years ago
Shiwen Cheng	492b318bd3	[Fix][Server] Fix clear task execute path is related to master (#5123 )	3 years ago
Simon	cd19507271	[feature][jsonsplit]fix copy/export/import processDefinition bugs (#5146 ) * Modify Project and ProjectUser Mapper * Modify Project and ProjectUser Mapper * project_code is bigint(20) * modify ERROR name * modify saveProcessDefine, remove the duplicate code with createTaskAndRelation * modify import/export processdefinition, add genProcessData * fix ut and bug * code style * repalce project_id with code * conflicts solve * conflicts solve * conflicts solve * bugfix * modify listResources mothod and remove getResourceIds mothod * 1 * conflicts solve * modify listResources mothod and remove getResourceIds mothod * modify listResources mothod and remove getResourceIds mothod * replace processDefinitionVersion with processDefinitionLog * codestyle * codestyle * add mapper module ut * codestyle * fix ProcessInstanceMapperTest * codestyle * conflicts solve * conflicts solve * conflicts solve * conflicts solve * conflicts solve * fix ProcessInstanceMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix ProjectMapperTest/ProjectUserMapperTest/ScheduleMapperTest * fix TaskInstanceMapperTest * add TaskDefinitionLogMapperTest/TaskDefinitionMapperTest and bugfix * codestyle * codestyle * Refactor process lineage * Refactor process lineage * codestyle * codestyle * Refactor process lineage * Refactor process lineage * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add WorkFlowLineageMapperTest/WorkFlowLineageServiceTest * add ProcessServiceTest * 1 * 1 * fix copy/export/import processDefinition bugs * 1 * codestyle	3 years ago
JinyLeeChina	1eaf1f6234	[Feature][JsonSplit] fix taskId in processDefinitionJson (#5136 ) * modify checkDAGRing and ProcessService method * merge * modify dagRing * modify process instance for project home page * fix save process bug * codeStyle * Fix logical bug in saving process definition * codeSytle * Fix bug in interface of queryProcessDefinitionList * codeSytle * Fix api bug" * fix taskId in processDefinitionJson Co-authored-by: JinyLeeChina <297062848@qq.com>	3 years ago
wenjun	5d264c9f20	[Improvement][Api] Optimize query processInstanceList #5134 (#5135 ) * Batch query user rather than several query	3 years ago
Shiwen Cheng	0d065c0712	[Feature-5062][] Create/Edit/Delete Worker Group in Web UI (#5113 ) [Improvement][Server] Rename MASTER_PREFIX to MASTER_TYPE and WORKER_PREFIX to WORKER_TYPE * [Feature][Api&Dao] Support api and dao of worker group * [Feature][UI] Support to create, edit and delete worker group * [Feature][API&UI] Support work groups from database and zookeeper to display together in worker group management * [Feature][API&Dao] Support long ip list and check request parameters when saving worker group * [Feature][] Refactor ipList to addrList [Feature][Server] Support host manager to select worker host by worker group in database * [Improvement][Server] Improve the config of master and worker * [Improvement][] Rename zkRegistered to systemDefault [Improvement][Test] Fix unit test and improve ui * [Improvement][Server] Improve getServerMaps Co-authored-by: dailidong <dailidong66@gmail.com>	3 years ago

1 2 3 4 5 ...

562 Commits (f7e551282ace5850783bdb57004dae15e044f4a2)