Tboy
89a70f8b2b
Refactor worker ( #6 )
...
* Refactor worker (#2000 )
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
* add- register processor
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* buildAckCommand taskInstanceId not set modify (#2002 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify (#2004 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment (#2006 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
* java doc error modify
* add comment
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
Tboy
1292b03e33
Refactor worker ( #4 )
...
* Refactor worker (#2000 )
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
* add- register processor
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* buildAckCommand taskInstanceId not set modify (#2002 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
* buildAckCommand taskInstanceId not set modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
Technoboy-
5dca139595
add- register processor
5 years ago
Tboy
e4679109af
Refactor worker ( #1997 )
...
* Refactor worker (#2 )
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
Technoboy-
00c9b80108
updates
5 years ago
Tboy
658922056a
Refactor worker ( #2 )
...
* Refactor worker (#1993 )
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* TaskExecutionContext create modify (#1994 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
qiaozhanwei
9d89eb03cd
TaskExecutionContext create modify ( #1994 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
* TaskExecutionContext create modify
5 years ago
Tboy
3800a2a99b
Refactor worker ( #1993 )
...
* Refactor worker (#1 )
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
* updates
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
Technoboy-
64d538e158
updates
5 years ago
Tboy
d6ea202ed7
Refactor worker ( #1 )
...
* add TaskResponseProcessor (#1983 )
* 1, master persistent task 2. extract master and worker communication model (#1992 )
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
Co-authored-by: qiaozhanwei <qiaozhanwei@outlook.com>
5 years ago
qiaozhanwei
ff86dc7d57
1, master persistent task 2. extract master and worker communication model ( #1992 )
...
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* 1, master persistent task
2. extract master and worker communication model
* add license
* modify javadoc error
5 years ago
Tboy
158322bd41
add TaskResponseProcessor ( #1983 )
5 years ago
Technoboy-
63b76d7154
add TaskResponseProcessor
5 years ago
qiaozhanwei
d16a8aa370
add comment
5 years ago
qiaozhanwei
2bb2d0ce7c
master/worker basic communication
5 years ago
qiaozhanwei
06927c2cf4
master/worker basic communication
5 years ago
qiaozhanwei
c39e511262
master/worker basic communication
5 years ago
qiaozhanwei
f6a2130ba1
master/worker basic communication
5 years ago
qiaozhanwei
910401fb2d
master/worker basic communication
5 years ago
qiaozhanwei
e7c32affc6
master/worker basic communication
5 years ago
Tboy
ac93d78379
Refactor worker ( #1979 )
...
* updates
* move FetchTaskThread logic to WorkerNettyRequestProcessor
* add NettyRemotingClient to scheduler thread
* refactor TaskScheduleThread, add TaskInstanceCallbackService
5 years ago
Tboy
f9500c58b1
Refactor worker ( #1975 )
...
* updates
* move FetchTaskThread logic to WorkerNettyRequestProcessor
* add NettyRemotingClient to scheduler thread
5 years ago
qiaozhanwei
9b75bebf1b
1,add sendAsync method 2,refactor LoggerClient ( #1965 )
...
* 1,remove dolphinscheduler-rpc module 2,add dolphinscheduler-remote module 3,add dolphinscheduler-service module 4,refactor LoggerServer module (#1925 )
* 1,remove dolphinscheduler-rpc module
2,add dolphinscheduler-remote module
3,add dolphinscheduler-service module
4,refactor LoggerServer module
* ProcessUtils modify
* Refactor architecture (#1926 )
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
* #1873 some updates for TaskQueueZkImpl
* #1875 remove unused properties in pom
* #1878
1. remove tomcat dependency
2. remove combined_logback.xml in api module
3. format pom.xml for not aligning
* #1885 fix api server startup failure
1. add jsp-2.1 dependency
2. remove jasper-runtime dependency
* add stringutils ut (#1921 )
* add stringutils ut
* Newfeature for #1675 . (#1908 )
Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell.
* Add modify user name for process definition (#1919 )
* class overrides equals() and should therefore also override hashCode()
* #1862 add modify user in process difinition list
* #1862 add pg-1.2.2 ddl.sql
* modify ScriptRunnerTest
* add updateProessDifinition UT
* modify updateProcessDifinition UT
* modify updateProcessDifinition UT
* modify mysql 1.2.2 ddl.sql&dml.sql
* add scope test to mysql in pom
* modify pg-1.2.2 ddl.sql
* refactor module
* updates
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
* dolphinscheduler-common remove spring (#1931 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* SpringApplicationContext class title add license (#1932 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* add license (#1934 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* move datasource classes to dao module
* fix send4LetterWord bug
* Refactor architecture (#1936 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* LoggerServiceTest remove ProcessDao (#1944 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* LoggerServiceTest remove ProcessDao
* exclude jasper-compiler in case of runtime conflict (#1938 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* DataAnaylysisServiceTest and ProcessDefinitionService modify
* remote module add comment
* OSUtilsTest modify
* add finally block to close channel
* add finally block to close channel (#1951 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* add finally block to close channel
* refactor log client service
* add sendSync method
* 1,quartz.properties add conf category
2,dolphinscheduler-daemon.sh modify
* dolphinscheduler-binary.xml modify
* add sendAsync method (#1962 )
* add sendAsync method
* add sendAsync method
* 1,add sendAsync method
2,refactor LoggerClient
* LogClientService modify
Co-authored-by: Tboy <technoboy@yeah.net>
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
5 years ago
qiaozhanwei
c1ee133392
Refactor Architecture Basic modification #1658 ( #1946 )
...
* 1,remove dolphinscheduler-rpc module 2,add dolphinscheduler-remote module 3,add dolphinscheduler-service module 4,refactor LoggerServer module (#1925 )
* 1,remove dolphinscheduler-rpc module
2,add dolphinscheduler-remote module
3,add dolphinscheduler-service module
4,refactor LoggerServer module
* ProcessUtils modify
* Refactor architecture (#1926 )
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
* #1873 some updates for TaskQueueZkImpl
* #1875 remove unused properties in pom
* #1878
1. remove tomcat dependency
2. remove combined_logback.xml in api module
3. format pom.xml for not aligning
* #1885 fix api server startup failure
1. add jsp-2.1 dependency
2. remove jasper-runtime dependency
* add stringutils ut (#1921 )
* add stringutils ut
* Newfeature for #1675 . (#1908 )
Continue to finish the rest works, add the cache feature for dependence,mr,python,sub_process,procedure and shell.
* Add modify user name for process definition (#1919 )
* class overrides equals() and should therefore also override hashCode()
* #1862 add modify user in process difinition list
* #1862 add pg-1.2.2 ddl.sql
* modify ScriptRunnerTest
* add updateProessDifinition UT
* modify updateProcessDifinition UT
* modify updateProcessDifinition UT
* modify mysql 1.2.2 ddl.sql&dml.sql
* add scope test to mysql in pom
* modify pg-1.2.2 ddl.sql
* refactor module
* updates
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
* dolphinscheduler-common remove spring (#1931 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* SpringApplicationContext class title add license (#1932 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* add license (#1934 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* Refactor architecture (#1936 )
* move datasource classes to dao module
* fix send4LetterWord bug
* LoggerServiceTest remove ProcessDao (#1944 )
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* dolphinscheduler-common remove spring
* LoggerServiceTest remove ProcessDao
* exclude jasper-compiler in case of runtime conflict (#1938 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* DataAnaylysisServiceTest and ProcessDefinitionService modify
* remote module add comment
* OSUtilsTest modify
* add finally block to close channel (#1951 )
* move datasource classes to dao module
* fix send4LetterWord bug
* exclude jasper-compiler in case of runtime conflict
* add finally block to close channel
Co-authored-by: Tboy <technoboy@yeah.net>
Co-authored-by: khadgarmage <khadgar.mage@outlook.com>
Co-authored-by: zhukai <boness@qq.com>
Co-authored-by: Yelli <amarantine@my.com>
5 years ago
gabry.wu
44b76468a8
Adapting partial code(file name start with C) to the sonar cloud rules ( #1918 )
...
* Adapting partial code(file name start with C) to the sonar cloud rules
* add some UT
* add some UT(rollback JSONUtils.checkJsonVaild)
* add some UT(fix OSUtils.exeCmd UT)
5 years ago
zhangzy
515255b919
ut
5 years ago
Rubik
fccbcc8d7d
fix: The constructor has passed in an taskAppId, no need to get from taskAppId. ( #1906 )
5 years ago
zhangzy
9d944d3f76
Optimize duplicate code
...
Use public methods to simplify duplicate code
5 years ago
zhangzy
662233e0dd
Remove ScheduleUtil,use the existing CronUtils
...
CronUtils is a public quartz tools, then the project dolphinscheduler-api can remove dolphinscheduler-server
5 years ago
dailidong
c63cd3e237
combine logback config of master/worker/alert/api server to one ( #1898 )
...
* combine logback config of master/worker/alert/api server to one logback.xml
5 years ago
魔方不在手
f942e5ced3
[feature] data synchronization function ( #1881 )
...
* feature:data synchronization function
* feature:data synchronization function
* feature:data synchronization function
* fix:add license
* fix:resource close bug
* fix:remove class author
* fix:Improve test coverage
* fix:add UT
* fix:add UT
* fix:data sync node renamed to datax
* fix:add UT
* fix: UT bug
* fix:Optimize variable name
* fix:pom
* fix:Variable name error
* fix:optimize the code
5 years ago
Yelli
78bfe918d0
change datasource null check position ( #1883 )
5 years ago
Yelli
5169689c35
class overrides equals() and should therefore also override hashCode() ( #1882 )
5 years ago
Tboy
0712ccc342
#1871 correct spelling ( #1872 )
...
* move version to parent pom
* move version properties to parent pom for easy management
* remove freemarker dependency
* delete CombinedApplicationServer
* #1871 correct spelling
5 years ago
liwenhe1993
30db5c1467
Api module relp server module/1756 ( #1766 )
...
* Remove server module on api module
1. Remove server module and add dao module.
2. Move quartz in server module to dao module.
3. Update config and class.
to resolve conflicts,I deleted CombinedApplicationServer.java
Co-authored-by: dailidong <dailidong66@gmail.com>
5 years ago
Jave-Chen
d371745ddf
Fix bug: Use try-with-resources or close this "Socket" in a "finally" clause. ( #1716 )
...
* #1714
5 years ago
gabry.wu
abe80fc538
[Feature] python task logs print delayed ( #1844 )
...
* [Feature] python task logs print delayed
#1843
5 years ago
samz406
aa91572def
fix Misspelled words ( #1841 )
...
* modify UdfFuncServiceTest UT
* fix get tenantCode my NPE
* add ResourcesServiceTest
* add error log
* add BaseServiceTest BaseServiceTest UT
* update
* fix word spelling
* Revert "fix word spelling"
This reverts commit 19bde51350
.
* fix Misspelled words
5 years ago
lilin
9ebe177e11
fix Misspelled words
5 years ago
lilin
55923016b4
Revert "fix word spelling"
...
This reverts commit 19bde51350
.
5 years ago
lilin
19bde51350
fix word spelling
5 years ago
老佛爷
1c77708a89
Supplementary data by schedule ( #1830 )
...
* Supplementary data by schedule
* fix sonar check bug
* fix code duplicated blocks
* ut
* loop by day
* MasterExecThread test
* test add licene
Co-authored-by: dailidong <dailidong66@gmail.com>
5 years ago
gabry.wu
c531c88e7e
[Feature] AbstractCommandExecutor.commandType difficult to understand ( #1833 )
...
issue: https://github.com/apache/incubator-dolphinscheduler/issues/1831
5 years ago
lgcareer
779672ec2a
[Fix issue #1770 ]check udf and data source in order to fix issue 1770 ( #1826 )
...
* check udf and data source in order to fix issue 1770
* check udf and data source in order to fix issue 1770
* update testListAuthorizedUdfFunc
5 years ago
ZHAOLIPAN
68f736953b
fix typos ( #1821 )
5 years ago
qiaozhanwei
b9ac6d66f1
fix #1775 bug,delete process definition when process instance is running ( #1776 )
...
* remove LogViewServiceGrpc.java file and pom modify
* remove kazoo
* remove kazoo
* remove kazoo
* remove common monitor package
* add license
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* remove kazoo modify
* install.sh remove python kazoo
* add system param whether repeat running
* remove kazoo modify
* BusinessTimeUtils remove whther repeat running inner param
* add AccessTokenMapperTest UT
* CI UT yml modify,start postgresql and zookeeper by default
* add AlertGroupMapperTest UT in github action
* Conflicts reslove
* AlertMappert UT modify
* AlertMappert UT modify
* AlertMappert UT modify
* CommandMapperTest UT modify
* DataSourceMapperTest UT modify
* fix #1775 bug,delete process definition when process instance is running
* verifyTenantIsNull remove process definnition id print log
5 years ago
gabry.wu
88b022cb57
ITaskQueue should have "hasTask" function ( #1744 )
...
* issue https://github.com/apache/incubator-dolphinscheduler/issues/1742
* remove unnecessary catch
* fix exception type
* fix bad code smell
* remove log exceptions
* catch exception
5 years ago
DK.Pino
aa715e17bf
remove lombok dependency(last) ( #1771 )
5 years ago
bao liang
e0e0696b4f
add out put log when master/worker server start ( #1769 )
...
* merge hadoop.properties into common.properties
* merge hadoop,zookeeper.properties into common.properties
remove combined.properties/master.properties/worker.properties
* change db user/pwd to test/test
* rename .dolphinscheduler_en.sh to dolphinscheduler_env.sh
remove some unused in install.sh
* add out put log when master/worker server start...
* add start log when servers start
5 years ago
Yelli
963ed4a8c6
ds.server & ds.common.zk regularize log print ( #1754 )
5 years ago