liwenhe1993
78f2fe253e
Modify docker-compose and kubernetes config
...
1. Move kubernetes to docker directory
2. Change docker-compose directory's name, and move docker-compose to docker directory
3. Modify docker-compose config and kubernetes config
4. Modify startup.sh in dockerfile
4 years ago
liwenhe1993
8b088c2ddd
Add docker-compose.yml
4 years ago
oceanos
ce1bdda762
fix showType in sql.vue
4 years ago
oceanos
27e97b8f92
fix ui i18n issue
4 years ago
zixi0825
da8798bce2
add license ( #2511 )
...
Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>
4 years ago
liwenhe1993
bcd0fac5d5
Modify README.md file
4 years ago
liwenhe1993
ed129e93c7
Modify config
4 years ago
liwenhe1993
f0e1c25efb
Modify config
4 years ago
liwenhe1993
7082f00a43
Delete 1.2.0 helm config
4 years ago
liwenhe1993
7d206c691f
Modify helm config and change directory's name
...
1.Change the directory's name to kubernetes
2.Add helm directory by version
3.Modify helm config file
4 years ago
break60
e1ceb216e8
fix style
4 years ago
break60
6999f8951b
disabled
4 years ago
break60
5dff0a4e65
Add force not to cache and fix jar instance of workflow instance not showing
4 years ago
break60
cf31f289ec
Add force not to cache and fix jar instance of workflow instance not showing
4 years ago
muzhongjiang
7ace040a1f
fixed bug #2492 ( #2497 )
...
Co-authored-by: mzjnumber1@163.com <mzjnumber1@163.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
Simon
d8a165ac6f
fix #2450 ( #2493 )
...
* fix #1441
* support custom datax config
* support datax custom config
* support datax custom config
* support datax custom config
* fix #2450
Co-authored-by: 张世鸣 <zhangshiming@cvte.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
zhangchunyang
ff4200b19e
resolve #2475 Ambari plugin development for the dolphin scheduler in version 2.0.0 … ( #2488 )
...
* Ambari plugin development for the dolphin scheduler in version 2.0.0 is complete
* Update the Ambari plugin of DS usage documentation
* delete readme whic is not completed
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
4 years ago
break60
a76d0719a9
delete img
4 years ago
dailidong
88bdb20a91
Update HttpUtils.java
4 years ago
qiaozhanwei
3c650a0339
send mail error, #2466 bug fix ( #2470 )
...
* dispatch task fail will set task status failed
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,no worker condition , master will while ture wait for worker startup
2,worker response task status sync wait for result
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* 1,task status statistics and process status statistics bug fix (#2357 )
2,worker group bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
* send mail error, #2466 bug fix
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
zhangchunyang
0c1ee3c3b9
resolve #2474 ( #2477 )
...
* In the dev branch, in order to the RPM package which is printed under the dist module contain configuration files: master.properties, worker.properties
* Restore files deleted by mistake
Co-authored-by: zhangchunyang <zhangchunyang@analysys.com.cn>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
4 years ago
break60
5f69b82c6a
Change the background color of the disabled state of the radio button when the workflow goes online
4 years ago
Rubik-W
759b671596
fix: Gantt chart bug
4 years ago
songgg
b06c118af6
[optimization]:prevent repeated database updates ( #2396 )
...
* sqlTask failed to run
* prevent repeated database updates
* prevent repeated database updates
* prevent repeated database updates
Co-authored-by: songqh <songquanhe@foxmail.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
break60
9307a1d2e6
Online editing is prohibited
4 years ago
xingchun-chen
3b15a9a7f5
Update worker_group_id to worker_group ( #2433 )
...
* add LoginTest license
* Delete useless packages
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* e2e add project and workflow case
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group in init.sql
* Update worker_group_id to worker_group
Co-authored-by: chenxingchun <438044805@qq.com>
4 years ago
break60
3094806070
Modify list style
4 years ago
break60
cc9c0d6633
Repair naming
4 years ago
break60
35267625c5
Change the name of the shell node and modify the parameter transmission method of spark, mr, python, and flink nodes
4 years ago
break60
b13c768fc9
Optimize resource tree
4 years ago
qiaozhanwei
94ef4c6c60
update UT in pom.xml
4 years ago
qiaozhanwei
eecf992432
update UT in pom.xml
4 years ago
qiaozhanwei
22c4a6a3de
update UT in pom.xml
4 years ago
qiaozhanwei
8772c73909
pom modify
4 years ago
qiaozhanwei
de3bf1b35d
init.sql modify
4 years ago
qiaozhanwei
a085aa8fa3
modify UT
4 years ago
liwenhe1993
a65a30e15a
Exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties ( #2387 )
...
* Remove .helmignore file
* Exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties
When running rat, exclude .mvn/jvm.config and .mvn/wrapper/maven-wrapper.properties
4 years ago
qiaozhanwei
0294b2898a
postgresql init.sql modify
4 years ago
qiaozhanwei
8d46953599
modify ci_e2e.yml
4 years ago
qiaozhanwei
373423ae40
mapper add Transactional and rollback
4 years ago
liwenhe1993
978bb085b4
Refactor dockerfile ( #2384 )
...
* Remove .helmignore file
* Refactor dockerfile
4 years ago
Zonglei Dong
818b4c6391
Add maven-wrapper support for dolphinscheduler. ( #2381 )
...
* add maven-wrapper support.
* fixes maven build command to maven-wrapper.
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
BoYiZhang
bcdf58969c
Fix document errors ( #2382 )
...
* Remove invalid code
* fix document errors
Co-authored-by: zhanglong <zhanglong@ysstech.com>
Co-authored-by: dailidong <dailidong66@gmail.com>
4 years ago
qiaozhanwei
7a9e1c4fbf
remove ExecuteTaskRequestCommand and ExecuteTaskResponseCommand
4 years ago
dailidong
038bde5efe
[Refactor worker] Optimize code , reduce cost time from 60ms to 0.5ms ( #2318 )
...
* update logback
* update log
* refactor worker registry (#2107 )
* Refactor worker (#2115 )
* refactor worker registry
* refactor master server
* Modify workgroupid parameter name (#2105 )
* Delete worker group management page
* Modify workgroupid parameter name
* Refactor worker (#2121 )
* refactor worker registry
* refactor master server
* refactor MasterSchedulerService
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1,worker TaskPros use TaskExecutionContext replase
2,Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
* task prioriry refator
* remove ITaskQueue
* TaskPriority refactor
* remove logs
* WorkerServer refactor
* MasterSchedulerService modify
* WorkerConfig listen port modify
* modify master and worker listen port
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
* not exist in openjdk,just delete
* add master and worker properties
* add master and worker properties
* add master and worker properties
* fix cpu 100% bug
* simplify master、 worker、alert、dao properties
* add master and worker properties
* add master and worker properties
* add master and worker properties
* Optimize code , reduce cost time from 60ms to 0.5ms
* merge code form remote
Co-authored-by: Tboy <guo.jiwei@immomo.com>
Co-authored-by: break60 <790061044@qq.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
qiaozhanwei
cc3ab0f191
timing online modify ( #2296 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
* ExecutorManager interface add generic type
* add TaskInstanceCacheManager receive Worker report result
* TaskInstance setExecutePath
* add TaskInstanceCacheManager to receive Worker Task result report
* TaskInstanceCacheManager add remove method
* add license
* add dispatcht task method
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* AbstractCommandExecutor remove db access
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* taskInstanceCache is null ,need load from db
* 1,worker TaskPros use TaskExecutionContext replase
2,Master kill Task , KillTaskProcessor modify
* worker remove db
* ShellTask modify
* master persistence processId and appIds
* master persistence processId and appIds
* master add kill task logic
* master add kill task logic
* master add kill task logic
* javadoc error modify
* remove chinese log
* executeDirectly method add Override
* remote module modify
* TaskKillResponseProcessor command type modify
* create buildKillCommand
* host add host:port format
* host add host:port format
* TaskAckProcessor modify
* TaskAckProcessor modify
* task prioriry refator
* remove ITaskQueue
* task prioriry refator
* remove ITaskQueue
* TaskPriority refactor
* remove logs
* WorkerServer refactor
* MasterSchedulerService modify
* WorkerConfig listen port modify
* modify master and worker listen port
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* cancelTaskInstance set TaskExecutionContext host,logPath,executePath
* Encapsulate the parameters required by sqltask
* 1,Encapsulate the parameters required by sqltask
2,SQLTask optimization
* AbstractTask modify
* ProcedureTask optimization
* MasterSchedulerService modify
* TaskUpdateQueueConsumer modify
* test
* DataxTask process run debug
* DataxTask process run debug
* add protobuf dependency,MR、Spark task etc need this
* TaskUpdateQueueConsumer modify
* TaskExecutionContextBuilder set TaskInstance workgroup
* WorkerGroupService queryAllGroup modify
query available work group
* 1,get workergroup from zk modify
2,SpringConnectionFactory repeat load modify
* master and worker register ip use OSUtils.getHost()
* ProcessInstance host set ip:port format
* worker fault tolerance modify
* Constants and .env modify
* master fault tolerant bug modify
* UT add pom.xml
* timing online modify
Co-authored-by: qiaozhanwei <qiaozhanwei@analysys.com.cn>
4 years ago
Tboy
87b994230c
Refactor worker ( #2248 )
...
* let quartz use the same datasource
* move master/worker config from dao.properties to each config
add master/worker registry test
* move mybatis config from application.properties to SpringConnectionFactory
* move mybatis-plus config from application.properties to SpringConnectionFactory
* refactor TaskCallbackService
* add ZookeeperNodeManagerTest
4 years ago
Tboy
c61c59ae54
Refactor worker ( #2186 )
...
* let quartz use the same datasource
* move master/worker config from dao.properties to each config
add master/worker registry test
4 years ago
qiaozhanwei
8b990b5c1c
java doc error modify ( #2004 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
4 years ago
qiaozhanwei
bcc5690f58
LogClientService modify
4 years ago