961e67f524
[Improvement][User] Query all users filter un enabled. ( #11504 )
...
* user query all filter un enabled
* restore permissions
2 years ago
4893bef5a7
[Improvement][TaskInstance] reduce database queries ( #11522 )
...
* [Improvement][TaskInstance] reduce database queries
* Update dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/mapper/TaskInstanceMapper.java
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
* [Improvement][TaskInstance] queryByInstanceIdsAndCodes -> queryByProcessInstanceIdsAndTaskCodes
Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
Co-authored-by: caishunfeng <caishunfeng2021@gmail.com>
2 years ago
abfef1a929
[improvement] Add two parameters in workergroup, and support the application of description display and other parameters ( #11542 )
...
* [Improvement] Improvement default worker group
* [Improvement] Improvement default worker group
* [Improvement] Improvement default worker group
* [Improvement] Improvement default worker group
* [Improvement] Improvement default worker group
* [improvement] The default worker grouping supports editing
* [improvement] The default worker grouping supports editing
* Update WorkerGroupServiceImpl.java
* Update WorkerGroupServiceImpl.java
* The default worker grouping supports editing
* update sql file
* update
* update
* update
* update
2 years ago
0b82755796
Fix some resource leak ( #11576 )
2 years ago
2862f5b67c
Set process instance and task priority default value as 2 ( #11539 )
2 years ago
5983e41f4b
[fix] Database change not sync ( #11258 )
...
* [fix] Database change not sync
* Make del sql upgrade same as release version
* Correct data quality dml sql
* Upgrade database DDL to avoid log path too long error
* Add missing if exists
2 years ago
f3d28112ce
optimize sorting priority for workflow define ( #11462 )
2 years ago
8217784044
[Fix-1360]: Fix Description length check ( #11371 )
...
* [Fix-1360]: Fix Description length check
* Update dolphinscheduler_h2.sql
h2 Increase the length of some fields
* Update dolphinscheduler_ddl.sql
2 years ago
0464123c2b
[Feature-11223] support stream task ( #11350 )
...
* add task execute type
* update task definition list paging
* update task instance list paging
* stream task start
* [Feature][UI] Some changes to execute task.
* Set the connection edge to dashed line.
* Add FLINK_STREAM task.
* add stream task
* flink savepoint and cancel
* fix query bug
* add stream task definition
* add task instance for stream task
* delete stream task definition state
* update api for stream task definition edit
* modify search for stream task instance
* add language
* delete task type search for stream task definition
* change task type search for stream task instance
* add jump button
* add savepoint
* add down log for stream task instance
* ui test
* stream task start
* run DAG
* [Fix][UI] Fix the stream task edgs not to be dashed when filling back.
* [Feature][UI] Remove some fields for FLINK_STREAM.
* add start modal
* add dryRun column for stream task instance
* fix duration
* fix pon
* fix build error
* Add success tip
* add auto sync for stream task instance
* remove forgien key for task instance
* license header
* UT fix
* modify locales
* recover common config
* fix UT
* add doc
Co-authored-by: Amy <amywang0104@163.com>
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
8774415197
Split ExecutionStatus to WorkflowExecutionStatus and TaskExecutionStatus ( #11340 )
2 years ago
acd3d3fab1
Fix TaskGroup cannot work and will cause master dead loop ( #11254 )
...
* Fix TaskGroup cannot work and will cause master dead loop
* Remove acquireTaskGroupAgain in ProcessServiceImpl
2 years ago
8e21c38c00
Write alert result into db ( #11221 )
2 years ago
4d9db3451e
[Bug] [API] If the single log length is long, it will causes the View Log page to hang ( #10612 )
2 years ago
ccb7641468
修改数据质量查询的权限判断 ( #10977 )
...
Co-authored-by: fanwanlong <fanwanlong@kezaihui.com>
2 years ago
fd59f0bb32
[Fix-11031] AccessToken can only be used by the creator. ( #11032 )
...
* AccessToken can only be used by the creator.
* supplement ut
* checkstyle fix
2 years ago
5e9c7dad23
Add dolphinscheduler-bom to manage the dependency version ( #11025 )
2 years ago
81930e5420
[python] Fix tasks with multiple upstream and workflow query error ( #10941 )
...
* when task with more than one upstreams, mapper
TaskDefinitionMapper method queryByName will return
more than one record, and failed the mybatis result
type, so we have to add `limit 1` to it to
* add multiple runs of example in integrate test
* Change from subprocess.Popen to subprocess.call_check
in integrating test which will raise an error when failed
2 years ago
4ff8eaa996
[Fix-10595][api] Fix Dependent Node Only View Projects Created By Self ( #10834 )
...
* [Fix-10595][api] Fix Dependent Node Only View Projects Created By Self
2 years ago
99a134febb
fix: typo task definition. ( #10958 )
2 years ago
9f34a837b8
[Fix-10909] Returns executionStatus for each process instance status and access token module support. ( #10922 )
...
* Returns executionStatus for each process instance status and access token module support
2 years ago
0db9bbd538
[fix] delete workflow or task used by other tasks ( #10873 )
...
currently, users can delete process definitions used
in other sub-process tasks or in other dependent tasks.
but this change will break the dependence of those task
and failed DAG, this patch add validation of those
delete behavior to avoid this error
2 years ago
a6154220dc
[fix] update queue and tenant with same code error ( #10877 )
...
in ae6aa53f
3 years ago
f639a2eed4
[Fix-10854] Fix database restart may lost task instance status ( #10866 )
...
* Fix database update error doesn't rollback the task instance status
* Fix database error may cause workflow dead with running status
3 years ago
3756a233d8
[Fix-10863] Command execution result data statistics remove userId condition. ( #10864 )
...
* Command execution result data statistics remove userId condition.
* e2e rerun
3 years ago
ae6aa53f96
[python] Fix submit and run error ( #10792 )
...
because we add permission, so it failed out
createQueue method. this patch fix it and
do some refactor of our tenant and queue
validator code
3 years ago
1e48bbc5c6
[Feature-10629][Improvement] Support multi cluster environments - namespace use cluster ( #10650 )
...
* server code
* namespace ui
* fix dao test
* fix test
* fix
* docs and image update
Co-authored-by: qianl4 <qianl4@cicso.com>
3 years ago
b8a90d801e
[Improvement] Resource authority module database table unique index increased. ( #10807 )
...
* Resource authority module database table unique index increased.
* add unique in sql file
* rerun
* ut fix
* e2e rerun
* dao un fix
3 years ago
d2fe16d252
[Optimization] Config module resource relation fix. ( #10718 )
...
* Config module resource relation fix.
* Boolean judge fix
* e2e rerun
* e2e rerun
* e2e rerun
* ArrayList fix
* change variable name.
* Add transaction processing on create data resource method
3 years ago
1b86394d3c
Optimize sql script use insert ignore ( #10700 )
3 years ago
bc4ceda4cf
TaskGroup remove query func permission check. ( #10557 )
3 years ago
20348578a2
[Feature] [Permission]Data permission module added and Query class api remove verification. ( #10504 )
...
* Data permission module added
* ut fix.
* queueController ut fix.
* queue service ut fix.
* e2e rerun
3 years ago
0dd6f4008e
[fix][master]: fix condition npe ( #10478 )
...
* [fix][master]: fix condition npe
* [fix][master]: fix condition npe
Co-authored-by: huaangcg <huangcg@getui.com>
3 years ago
ad2646ff1f
Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe ( #10479 )
...
* Fix TaskProcessorFactory#getTaskProcessor get common processor is not thread safe
3 years ago
7aa9fa4965
[imporve] Add index to table t_ds_relation_process_instance ( #10461 )
3 years ago
ff065d8e5b
[Feature][Improvement] Support multi cluster environments - k8s type ( #10096 )
...
* service code
* [Feature][UI] Add front-end for cluster manage
* fix e2e
* remove comment on cluster controller
* doc
* img
* setting e2e.yaml
* test
* rerun e2e
* fix bug from comment
* Update index.tsx
use Nspace instead of css.
* Update index.tsx
Remove the style.
* Delete index.module.scss
Remove the useless file.
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Amy0104 <97265214+Amy0104@users.noreply.github.com>
3 years ago
b86dc53ad1
[fix][Python] Support same task name in project defferent process definition ( #10428 )
...
close : #10431
3 years ago
9782fe4e7c
[Fix-10367] Permission check related key adjustment. ( #10368 )
...
* Permission check related key adjustment.
* resource create or upload fix.
* Analysis Permission fix.
* Ut coverage add.
* rerun
* source permission fix.
* ut coverage is achieved
* Reference permission package path modification
* k8s path bug fix.
* k8s path bug fix.
* Corrected controller method name and rerun.
3 years ago
b1fb17119b
[Feature-6758][Task] Add limit resource usage for tasks base on cgroup ( #10373 )
3 years ago
e3e39cbdea
[Fix] Privilege Reconstruction Data Query Fix & Resource Creation Post Oper… ( #10313 )
...
* Privilege Reconstruction Data Query Fix & Resource Creation Post Operations.
* Resource Retry
* e2e retry
* create project log add
* project list query log add
* clean project log
* delete delay
* delete delay
* remove post handle
* project e2e
* browser refresh
* browser refresh
* e2e fix
* e2e browser refresh
* rowk flow e2e fix
* mapper deduplication
* udf e2e
* e2e
3 years ago
d80cf21456
Clean up unused dependencies and packaging issues ( #9944 )
3 years ago
3a9e67325e
Fix database initialize late in standalone. ( #10296 )
3 years ago
a4948f58e6
[Feature][Permission] Reconstruction of permissions of resource center and monitoring center. ( #10307 )
...
* Reconstruction of permissions of resource center and monitoring center.
* clear local logs.
* resource query fix
3 years ago
53ab6f7b92
[Feature][API] Modify the permissions of project management, security center, data source center and data quality module. ( #10289 )
...
* Resource userName is null
* [Fix-10082]Resource userName is null and udf function manager add a username
* [Fix-10082]Resource userName is null and udf function manager add a username
* [Fix-10082]Resource userName is null and udf function manager add a username
* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.
* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.
* [Feature][API] Modify the permissions of project management, security center, data source center and data quality module.
Co-authored-by: houshitao <shitaohou@163.com>
3 years ago
7ac8ea493c
[Feature][Permission] Project management module authority control refactoring, authority abstract interface setting. ( #10261 )
...
* Create process definition with task group and task group priority cannot be save into db
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* [Feature][API] Permission control of project
* The result of the assertion cannot be changed. The only difference is the judgment condition.
* test recovery.
* controller test fix.
* ProjectE2ETest fix.
* WebElement import.
* Prioritize problem solving.
* Judging the length of the set fix
Co-authored-by: houshitao <shitaohou@163.com>
Co-authored-by: hstdream <33045461+hstdream@users.noreply.github.com>
3 years ago
d8db2b57d2
[fix] Task group queue query all list error ( #10237 )
...
Add support query all task queue by not given specific groupId
close : #10102
3 years ago
bd34e66b8a
[Fix-10076] queryUserByToken use server timezone ( #10177 )
...
* [Fix-10076] queryUserByToken use server timezone
* [Fix-10076] queryUserByToken use server timezone
3 years ago
ee2b855ced
[BUG][TaskGroup] Task group does not take effect ( #10093 )
...
* fix 10092: Task group does not take effect
* fix 10092: Task group does not take effect
* fix 10092: Task group does not take effect
3 years ago
701b535ae6
[Fix-10082]Resource userName is null and udf function manager add a username ( #10064 )
...
* Resource userName is null
* [Fix-10082]Resource userName is null and udf function manager add a username
* [Fix-10082]Resource userName is null and udf function manager add a username
* [Fix-10082]Resource userName is null and udf function manager add a username
Co-authored-by: houshitao <shitaohou@163.com>
3 years ago
cd70ad584a
Create process definition with task group and task group priority cannot be save into db ( #10078 )
...
Co-authored-by: houshitao <shitaohou@163.com>
3 years ago
bc1c15b142
[Feature-8252][doc] K8s and namespace manager docs and web page update ( #9881 )
...
* test
* test
* doc
* fix image error
* fix
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/en/guide/security.md
* Update docs/docs/zh/guide/security.md
* fix doc
Co-authored-by: qianl4 <qianl4@cicso.com>
Co-authored-by: William Tong <weitong@cisco.com>
Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
3 years ago
JiPeng Wang
longtb
insist777
kezhenxu94
Wenjun Ruan
Jiajie Zhong
juzimao
caishunfeng
zhuxt2015
jackfanwan
Assert
SongTao Zhuang
qianli2022
chuxing
SmallProgrammer
陈家名
xiangzihao
hstdream
BaoLiang