Simon
d8a165ac6f
fix #2450 ( #2493 )
...
* fix #1441
* support custom datax config
* support datax custom config
* support datax custom config
* support datax custom config
* fix #2450
Co-authored-by: 张世鸣 <zhangshiming@cvte.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
zhangchunyang
ff4200b19e
resolve #2475 Ambari plugin development for the dolphin scheduler in version 2.0.0 … ( #2488 )
...
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete
* Update the Ambari plugin of DS usage documentation
* delete readme whic is not completed
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
4 years ago
break60
a76d0719a9
delete img
4 years ago
dailidong
88bdb20a91
Update HttpUtils.java
4 years ago
qiaozhanwei
3c650a0339
send mail error, #2466 bug fix ( #2470 )
...
* dispatch task fail will set task status failed
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
zhangchunyang
0c1ee3c3b9
resolve #2474 ( #2477 )
...
* In the dev branch, in order to the RPM package which is printed under the dist module contain configuration files: master.properties, worker.properties
* Restore files deleted by mistake
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
4 years ago
break60
5f69b82c6a
Change the background color of the disabled state of the radio button when the workflow goes online
4 years ago
Rubik-W
759b671596
fix: Gantt chart bug
4 years ago
songgg
b06c118af6
[optimization]:prevent repeated database updates ( #2396 )
...
* sqlTask failed to run
* prevent repeated database updates
* prevent repeated database updates
* prevent repeated database updates
Co-authored-by: songqh <songquanhe@foxmail.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
break60
9307a1d2e6
Online editing is prohibited
4 years ago
xingchun-chen
3b15a9a7f5
Update worker_group_id to worker_group ( #2433 )
...
* add LoginTest license
* Delete useless packages
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group
Co-authored-by: chenxingchun <438044805@qq.com>
4 years ago
break60
3094806070
Modify list style
4 years ago
break60
cc9c0d6633
Repair naming
4 years ago
break60
35267625c5
Change the name of the shell node and modify the parameter transmission method of spark, mr, python, and flink nodes
4 years ago
break60
b13c768fc9
Optimize resource tree
4 years ago
qiaozhanwei
94ef4c6c60
update UT in pom.xml
4 years ago
qiaozhanwei
eecf992432
update UT in pom.xml
4 years ago
qiaozhanwei
22c4a6a3de
update UT in pom.xml
4 years ago
qiaozhanwei
8772c73909
pom modify
4 years ago
qiaozhanwei
de3bf1b35d
init.sql modify
4 years ago
qiaozhanwei
a085aa8fa3
modify UT
4 years ago
liwenhe1993
a65a30e15a
Exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties ( #2387 )
...
* Remove .helmignore file
* Exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties
When running rat, exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties
4 years ago
qiaozhanwei
0294b2898a
postgresql init.sql modify
4 years ago
qiaozhanwei
8d46953599
modify ci_e2e.yml
4 years ago
qiaozhanwei
373423ae40
mapper add Transactional and rollback
4 years ago
liwenhe1993
978bb085b4
Refactor dockerfile ( #2384 )
...
* Remove .helmignore file
* Refactor dockerfile
4 years ago
Zonglei Dong
818b4c6391
Add maven-wrapper support for dolphinscheduler. ( #2381 )
...
* add maven-wrapper support.
* fixes maven build command to maven-wrapper.
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
BoYiZhang
bcdf58969c
Fix document errors ( #2382 )
...
* Remove invalid code
* fix document errors
Co-authored-by: zhanglong <zhanglong@ysstech.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
qiaozhanwei
7a9e1c4fbf
remove ExecuteTaskRequestCommand and ExecuteTaskResponseCommand
4 years ago
dailidong
038bde5efe
[Refactor worker] Optimize code , reduce cost time from 60ms to 0.5ms ( #2318 )
...
* update logback
* update log
* refactor worker registry (#2107 )
* Refactor worker (#2115 )
* refactor worker registry
* refactor master server
* Modify workgroupid parameter name (#2105 )
* Delete worker group management page
* Modify workgroupid parameter name
* Refactor worker (#2121 )
* refactor worker registry
* refactor master server
* refactor MasterSchedulerService
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1,worker TaskPros use TaskExecutionContext replase
2,Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
* task prioriry refator
* remove ITaskQueue
* TaskPriority refactor
* remove logs
* WorkerServer refactor
* MasterSchedulerService modify
* WorkerConfig listen port modify
* modify master and worker listen port
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* not exist in openjdk,just delete
* add master and worker properties
* add master and worker properties
* add master and worker properties
* fix cpu 100% bug
* simplify master、 worker、alert、dao properties
* add master and worker properties
* add master and worker properties
* add master and worker properties
* Optimize code , reduce cost time from 60ms to 0.5ms
* merge code form remote
Co-authored-by: Tboy <guo.jiwei@immomo.com>
Co-authored-by: break60 <790061044@qq.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
qiaozhanwei
cc3ab0f191
timing online modify ( #2296 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1,worker TaskPros use TaskExecutionContext replase
2,Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
* task prioriry refator
* remove ITaskQueue
* TaskPriority refactor
* remove logs
* WorkerServer refactor
* MasterSchedulerService modify
* WorkerConfig listen port modify
* modify master and worker listen port
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* Encapsulate the parameters required by sqltask
* 1,Encapsulate the parameters required by sqltask
2,SQLTask optimization
* AbstractTask modify
* ProcedureTask optimization
* MasterSchedulerService modify
* TaskUpdateQueueConsumer modify
* test
* DataxTask process run debug
* DataxTask process run debug
* add protobuf dependency,MR、Spark task etc need this
* TaskUpdateQueueConsumer modify
* TaskExecutionContextBuilder set TaskInstance workgroup
* WorkerGroupService queryAllGroup modify
query available work group
* 1,get workergroup from zk modify
2,SpringConnectionFactory repeat load modify
* master and worker register ip use OSUtils.getHost()
* ProcessInstance host set ip:port format
* worker fault tolerance modify
* Constants and .env modify
* master fault tolerant bug modify
* UT add pom.xml
* timing online modify
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
Tboy
87b994230c
Refactor worker ( #2248 )
...
* let quartz use the same datasource
* move master/worker config from dao.properties to each config
add master/worker registry test
* move mybatis config from application.properties to SpringConnectionFactory
* move mybatis-plus config from application.properties to SpringConnectionFactory
* refactor TaskCallbackService
* add ZookeeperNodeManagerTest
4 years ago
Tboy
c61c59ae54
Refactor worker ( #2186 )
...
* let quartz use the same datasource
* move master/worker config from dao.properties to each config
add master/worker registry test
4 years ago
qiaozhanwei
8b990b5c1c
java doc error modify ( #2004 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
4 years ago
qiaozhanwei
bcc5690f58
LogClientService modify
4 years ago
songgg
0ad610a0f0
[optimization]:remove duplicate code ( #2377 )
...
* sqlTask failed to run
* remove duplicate code
* remove duplicate code
* remove duplicate code
* remove duplicate code
* remove duplicate code
Co-authored-by: songqh <songquanhe@foxmail.com>
4 years ago
itbasketplayer
d03f9daa0e
.gitignore remove taskInstance/index.vue( #2300 ) and no need to findProcessDefineById 2 times( #2373 ) ( #2374 )
...
* some optimization
* revert
* ProcessDefinitionService#updateProcessDefinition findProcessDefineById 1 time
4 years ago
zixi0825
3f044e7771
#2282 fix workflow dependent bug ( #2329 )
...
* fix workflow dependent bug
* fix workflow dependent bug 2
* fix workflow dependent bug 2
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
break60
4709e44a1e
Fix the problem of data echo in script edit box
4 years ago
break60
4b265f057a
fix
4 years ago
break60
9c2af1442b
Fix the problem of data echo in script edit box
4 years ago
break60
e6527c7a92
Corrections to historical jar packages and resource data
4 years ago
break60
b7851639eb
Corrections to historical jar packages and resource data
4 years ago
lgcareer
54f04a378e
init full_name in dml of version 1.2.2 ( #2341 )
...
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
Rubik-W
d8ccab6a49
fix:mail send fail #2345 ( #2346 )
...
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
BoYiZhang
7fa0c0f79a
Remove invalid code ( #2342 )
...
Co-authored-by: zhanglong <zhanglong@ysstech.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
break60
18d7c66bec
Supplemental licenses and repair resources cannot be renamed
4 years ago
break60
3d72643d4a
Modify ans-ui version and timing management style
4 years ago
dailidong
db3c6ce861
Delete ReleaseNotes.md ( #2338 )
4 years ago
Rubik-W
9b6ab81e60
fix #2334 ( #2335 )
...
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago