Jay Chung
8efaa9fa1f
fix: data quality can not use ( #15551 )
...
* fix: data quality can not use
fix : #15468 , #15249 , #14858
---------
Co-authored-by: Rick Cheng <rickchengx@gmail.com>
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
9 months ago
Wenjun Ruan
4d15932ede
Fix createFile with permission will not work ( #15556 )
9 months ago
Wenjun Ruan
64e1e67581
Use DefaultUncaughtExceptionHandler to log the uncached exception ( #15496 )
...
Co-authored-by: fuchanghai <changhaifu@apache.org>
10 months ago
Wenjun Ruan
0b873e6870
[HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist ( #15377 )
10 months ago
Wenjun Ruan
7b9c9e0eb2
Enable set ServerLoadProtection fot Master/Worker ( #15439 )
10 months ago
David Zollo
a0bc778baf
[Improvement] Ensure that HttpUtils can only get result from certification URL ( #15288 )
...
* make httputils just can get Http request not Https
* add test
10 months ago
Wei Xiaonan
c0ed68121d
[Feature-14832][Listener]Implementation of Listener Mechanism ( #14981 )
...
* first commit
* 1. sql: sync ddl
2. front-end: change to ternary expression
3. back-end: correct license header in ListenerEvent.java
* test case
* frontend: remove unnecessary console
* fix unit test
* remove log depends on user-provided value
* fix dolphinscheduler_postgresql.sql
* sync database schema
* fix unit test
* fix unit test
* fix some NIT.
* extract GLOBAL_ALERT_GROUP_ID into variable
* fix ddl bug
* add column task_type in t_ds_fav_task in upgrade/3.2.0_schema
* add unit test
1 year ago
Wenjun Ruan
312c339722
Delete File generated by UT ( #15022 )
1 year ago
Gallardot
2a65590117
[Improvement][Task] Mask password in task log ( #14988 )
...
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: xiangzihao <460888207@qq.com>
1 year ago
Wenjun Ruan
020092ed1e
Set charset in upgrading tools to solve read upgrade sql mojibake ( #14955 )
1 year ago
Aaron Wang
b12df72a0c
[Fix][Resource Center] Remove NONE storage type and set LOCAL type as default ( #14661 )
1 year ago
Wenjun Ruan
9ce8871158
Support get property from env/jvm/common.properties ( #14645 )
1 year ago
Wenjun Ruan
2b99451ccd
Support filter restrict network interface ( #14638 )
1 year ago
Wenjun Ruan
cbd354d134
Add host/port in heartbeat ( #14591 )
1 year ago
Gallardot
9d10de6efa
[Improvement][Task] Mask configYaml in task log ( #14571 )
...
* [Improvement][Task] Mask configYaml in task log
Signed-off-by: Gallardot <gallardot@apache.org>
---------
Signed-off-by: Gallardot <gallardot@apache.org>
Co-authored-by: Aaron Wang <wangweirao16@gmail.com>
1 year ago
fuchanghai
ec29220977
[improve-#13966] mask datax log ( #13969 )
...
Co-authored-by: fuchanghai <‘2875334588@qq.com’>
2 years ago
Wenjun Ruan
61a689aa5a
Use percentage to represent memory/cpu usage ( #13896 )
2 years ago
Rick Cheng
7ee66f2d02
[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage ( #13777 )
2 years ago
Rick Cheng
aa79c01ce9
[Feature-13419][Remote Logging] Add support for writing task logs to S3 ( #13649 )
...
* [Feature-13419][Remote Logging] Add support for writing task logs to S3
* Update dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/log/remote/S3RemoteLogHandler.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* use try with resource
* remove unnecessary log
---------
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
Rick Cheng
2bd65fb2df
[Feature][Remote Logging] Add support for writing task logs to OSS ( #13332 )
2 years ago
Jay Chung
78e5569afd
[feat] Add type local turn on resource center by default ( #13303 )
2 years ago
Aaron Wang
ccad56e88e
[Improvement][Master] Validate same content of input file when using task cache ( #13298 )
...
* support file content checksum
* fix inject null storageOperate bug
2 years ago
rickchengx
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2 years ago
Wenjun Ruan
a0d37fc7ae
Set tenantDir permission ( #12486 )
2 years ago
caishunfeng
dedff70f90
[Improvement] Merge spi.utils into common.utils ( #12502 )
...
* improve JSONUtil
* merge spi.utils into common.utils
* split constants && remove some copy utils method
* remove StringUtils
2 years ago
Eric Gao
d46e4659d9
[Improvement][Style] Fix remaining style errors and wildcard imports ( #12412 )
...
* Fix remaining style errors and wildcard imports
* Upgrade spotless to the latest stable version, exclude .github folder from spotless check and fix dead link
* Fix spotless matching scope of markdown files
2 years ago
Yann Ann
b357781df2
[Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules ( #12363 )
2 years ago
kezhenxu94
db1d319159
Reorganize some classes in common module, remove duplicate classes ( #12321 )
2 years ago
Yann Ann
17cd644506
[Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. ( #12264 )
...
* fix process duration issue
* use processInstance.getState().isFinished() replace new isFinish function
* add WorkflowUtils
2 years ago
Eric Gao
9ab79e064c
[Improvement][Test] Fully remove the usage of powermock from the whole project ( #12244 )
...
* Fully remove the usage of powermock from the whole project
* Upgrade org.reflections to 0.10.12
2 years ago
Yann Ann
c87f6d89a4
[fix#12195] Change date to timestamp to support cross diff time zones ( #12239 )
...
* fix DS support cross time zone, use timestamp replace date
2 years ago
Yann Ann
289e1ecdc6
[Bug] [Common] update IPv4 Pattern ( #11762 )
...
* [Bug] [Common] IPv4 Pattern is wrong. #11758
2 years ago
Eric Gao
66958b91d7
[Feature][Resource Center] Add support for Alibaba Cloud OSS as storage of resource center ( #11708 )
...
* Add support for Alibaba Cloud OSS as storage of resource center
* Add dependency licenses
* Refactor code, add unit tests and related docs
2 years ago
caishunfeng
2e61c76c22
[Improvement] Add remote task model ( #11767 )
2 years ago
Kengo Seki
444c7e6eb7
[Improvement] Replace commons-lang 2 function invocations with commons-lang3 ( #11810 )
...
* [Improvement] Replace commons-lang 2 function invocations with commons-lang3
2 years ago
Wenjun Ruan
67e7f88d8b
Refactor heart beat task, use json to serialize/deserialize ( #11702 )
...
* Refactor heart beat task, use json to serialize/deserialize
2 years ago
kezhenxu94
13e4720aa2
Upgrade spring boot and swagger ( #11574 )
2 years ago
caishunfeng
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
fuchanghai
05932bcf55
[fix-11295] remove duplicate classes ( #11355 )
2 years ago
liyangyang
6f0a609793
[Improvement 11072][common] Added HTTPS request support in kerberos environment ( #11127 )
...
* [Improvement-11072][dolphinscheduler-common] Added HTTPS request support in kerberos environment
* [Improvement-11072][dolphinscheduler-common] supplement
Co-authored-by: liyangyang <liyangyang@bizseer.com>
2 years ago
liyangyang
f13e7a95ae
[Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support ( #11017 )
...
* [Improvement-11013][dolphinscheduler-common] YarnHAAdminUtils#getActiveRMName function Add HTTPS Hadoop environment support
* [Improvement-11013][dolphinscheduler-common] add test code
* [Improvement-11013][dolphinscheduler-common] code format
* [Improvement-11013][dolphinscheduler-common] add hadooputils test code
* [Improvement-11013][dolphinscheduler-common] remove extra blank lines
* [Improvement-11013][dolphinscheduler-common] adjusts test code
* [Improvement-11013][dolphinscheduler-common] remove useless import
* [Improvement-11013][dolphinscheduler-common] add test code
* [Improvement-11013][dolphinscheduler-common] shortened string
* [Improvement-11013][dolphinscheduler-common] format test code style
Co-authored-by: liyangyang <liyangyang@bizseer.com>
2 years ago
pinkhello
030fb89d6e
[Fixed-10833] [Bug] [Quartz] timezone display doesn't match the next_fire_time in ds 3.0.0-beta1 version ( #10865 )
...
* closed [10619] [Improvement][Master] batch remove TaskInstaceId and workflowInstanceId
* fixed # 10833 timezone display error
* checkstyle
2 years ago
WangJPLeo
8f621ff98b
[Optimization] Calculate global parameter and local parameter at master. ( #10704 )
...
* Global parameter and local parameter calculation external expansion.
* k8s task ut fix.
* TimePlaceholderUtils import DateUtils fix
* follow the review comments to fix.
* follow the review comments to fix.
* e2e rerun
2 years ago
WangJPLeo
b5184138fa
[Feature] Time function analysis extension. ( #10624 )
...
* Time function analysis extension.
* param add.
* clear useless logs and update method notes
* permission omission fix.
* extending time functions to optimize static methods
* e2e rerun.
2 years ago
juzimao
b2879c0e05
[Fix] fix the HttpUtilsTest' test case , it is always time out. ( #10294 )
2 years ago
juzimao
062146eecd
[Fix] Fix the JSONUtils tool class time zone problem #10282 ( #10284 )
...
* [Fix] Fix the JSONUtils tool class time zone problem #10282
* [Fix] Fix the JSONUtils tool class time zone problem #10282
* Update JSONUtils.java
remove unnessnary log
* Update JSONUtilsTest.java
add timezone import
Co-authored-by: xiangzihao <460888207@qq.com>
2 years ago
hstdream
f3c647d45e
[Improvement][Api] Interface and entity optimization to improve code scalability ( #10466 ). ( #10468 )
...
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466 ).
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466 ).
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466 ).
* [Improvement][Api] Interface and entity optimization to improve code scalability (#10466 ).
* fix ut timezone.
Co-authored-by: houshitao <shitaohou@163.com>
2 years ago
retime123
67c4f2b259
[Feature][Monitoring] Added disk available capacity monitoring ( #10287 )
...
* Added disk available capacity monitoring
* resolve conflict
Added disk available capacity monitoring
* resolve conflict
Added disk available capacity monitoring
* resolve conflict
Added disk available capacity monitoring
2 years ago
xiangzihao
50e9f2916a
[CI] bumping actions/cache to v3 to fix ci error ( #10345 )
...
* bumping actions/cache to v3
* fix JSONUtilsTest.java unit test error
2 years ago
kezhenxu94
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
2 years ago