78e5569afd
[feat] Add type local turn on resource center by default ( #13303 )
2 years ago
78ba71bdbd
[Feature][task]add azure datafactory task type ( #13417 )
...
* init data factory
* add task-type-config.yaml
* add data factory ui
* submit doc
* submit license
---------
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
3a6e10397f
[feature][api-datasource]add redshift auth mode to get connection by access key ( #13379 )
...
* submit redshift auth mode
* add front end
* add doc and fix frontend
Co-authored-by: devosend <devosend@gmail.com>
2 years ago
a843e0b96d
Add documentation to release Helm Chart ( #13385 )
2 years ago
e39bf59b4b
[fix][data quality] fix when running data quality task with Error "No main class set in JAR" ( #13360 )
2 years ago
366f999167
[Feature][Deployment] Add KEDA autoscaler support for worker deployment when deployed in K8S cluster ( #13367 )
...
* Add keda autoscaler support for worker deployment when deployed in K8S cluster
* Add mysql scaler for worker autoscaling
* Add docs for worker autoscaler
* Add support for external postgresql db
2 years ago
3f16776cd7
[improvement][install.sh] fix the install Error "Command not found rmr" & su… ( #13163 )
...
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [BUG][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [docs] add documentation for building with different ZK versions
* support both 3.4 and 3.8
* [improvement][install.sh] fix the install Error "Command not found rmr" & support ZooKeeper (3.4.6+)
* update known-dependencies.txt
* [improvement][install.sh] fix the install Error "Command not found rmr"
* support ZooKeeper (3.4.6+) by activating zk-3.4 profile
* make zk-3.8 as default option in pom.xml
* update defalut ZK version in docs
* update known-dependencies.txt
Co-authored-by: wangxx <wangxx@kcwl.com>
2 years ago
22958682c4
add 3.1.3 release ( #13357 )
2 years ago
8f7b141fe7
[Fix-13287][doc]Fix Chinese workflow-definition.md duplication description in execution-type ( #13361 )
2 years ago
bcf03ad4d1
[Feature-9467] add DAMENG DataSource ( #12860 )
...
* [Feature-9467][DataSource] add DAMENG （达梦） data source
* [Feature-9467] add DM datasource doc (Issue #9467 )
* [Feature-9467] add DM IDataBaseOptionKeys
* [Feature-9467] add DM DataSource: DmDataSourceChannelFactoryTest remove testGetDmConnection method
* [Feature-9467] modification package dm to dameng;
* [Feature-9467] add Dameng DmJdbcDriver18 License
* [Feature-9467] add DM DataSource: remove DruidDataSourceClient
Co-authored-by: lenian <yuenian@mananacare.com>
2 years ago
2c952139b4
feat: Release version 304 ( #13319 )
...
Release new version 304
2 years ago
8503ee0eed
[Improvement][Worker] Startup parameter should have the highest priority ( #13274 )
2 years ago
aec26f06db
[doc] Correct install_env.sh file name ( #13294 )
...
duplicate #12209
2 years ago
9199049180
[Improvement][docker] Add SPRING_JACKSON_TIME_ZONE to .env file ( #13271 )
...
* tz in docker
* update default tz and update doc
Co-authored-by: chenjiaming <chenjiaming@kezaihui.com>
2 years ago
1f7f900e78
[Fix][Doc] Replace the links. ( #13276 )
...
* [Fix][Doc] Replace the links.
* [Fix][Doc] Revised `.dlc.json`
* [Fix] Fix the dead link.
2 years ago
06b77b34c7
[doc][datasource-12820] add azure sql database doc ( #13254 )
2 years ago
14ec4a2398
Remove dao module in worker ( #13242 )
2 years ago
c213c6fe34
Fix a tiny bug in release doc ( #13239 )
2 years ago
66e20271ad
[Feature][Master] Add task caching mechanism to improve the running speed of repetitive tasks ( #13194 )
...
* Supports task instance cache operation
* add task plugin cache
* use SHA-256 to generate key
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Update dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
* Optimizing database Scripts
* Optimize clear cache operation
Co-authored-by: Jay Chung <zhongjiajie955@gmail.com>
2 years ago
5c75d312fa
Add StarRocks datasource ( #13204 )
2 years ago
84496c5f04
[Fix][Doc]Update pseudo-cluster.md ( #13207 )
...
* Update pseudo-cluster.md
* Update pseudo-cluster.md
2 years ago
dcf02eab45
[Fix] Replaced dead links in the docs. ( #13170 )
...
* [Fix] Replaced dead links.
* [Improvement] Format markdowns.
2 years ago
560d232cbd
[Bug][Worker] Fix duplicated key bug when have out parameters of same name ( #12930 )
2 years ago
209af2ad29
Add release 3.1.2 documentation ( #13150 )
2 years ago
917df4f6ca
[fix-13041] fix example checkFormula ( #13110 )
...
Co-authored-by: zhangshunmin <zhangshunmin@kezaihui.com>
2 years ago
316496211a
[doc] refactor release ( #13135 )
...
* [doc] refactor release
* [doc] refactor release
2 years ago
e90cd9e13b
[release] version 3.0.3 ( #13131 )
2 years ago
e180e16981
[Fix] Fix Java path in Kubernetes Helm Chart ( #12987 )
2 years ago
38b876733c
[Feature-10498] Mask the password in the log of sqoop task ( #11589 )
2 years ago
b40c63f02d
[Feature][DataSource]Add trino datasource plugin ( #12911 )
2 years ago
6e224d08a2
[fix] Python task can not pass the parameters to downstream task. ( #12961 )
2 years ago
2f8f0952fb
[Bug-12954] [Schedule] Fix that workflow-level configuration information does not take effect when timing triggers execution ( #12955 )
2 years ago
27c00ed377
[Document] Fix grammar and spelling ( #12940 )
2 years ago
5672337156
[docs] Update new release for 3.0.2 ( #12949 )
2 years ago
27c37b8828
Fix grammar and spelling ( #12937 )
2 years ago
d803658abd
[Document] Fix spelling ( #12935 )
2 years ago
22532fe1d8
[Document] Update faq, fix spelling, remove repeated words ( #12934 )
2 years ago
7c90bf01bc
[Improvement][Task Plugin] Improvement Kubeflow task plugin ( #12928 )
...
add example
check phase in status:conditions
2 years ago
2dbc79693e
[feature][task plugin] Add new task plugin for apache linkis ( #12693 )
2 years ago
9e6f4d2bc1
[Improvement][Document]Update architecture and process-start-flow pic ( #12912 )
...
Co-authored-by: xuhaihui <xuhaihui@cmss.chinamobile.com>
2 years ago
0373e06615
[Feature-8030][docs] Add sqoop task doc ( #12855 )
...
* [Feature-8030][docs] Add sqoop task doc
* Update docs/docs/zh/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* Update docs/docs/en/guide/task/sqoop.md
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
* [Feature-8030][docs] Add sqoop task doc
Co-authored-by: Eric Gao <ericgao.apache@gmail.com>
2 years ago
229c554912
[feature][task] Add Kubeflow task plugin for MLOps scenario ( #12843 )
2 years ago
019e7475d1
The new Chinese document latest version is 3.1.1 ( #12869 )
2 years ago
a887303d48
add 3.1.1 release doc ( #12864 )
2 years ago
454f1303a0
Add minio as demo storage for helm charts ( #12861 )
2 years ago
6896fa9b47
[fix][doc] Dead link for python api ( #12848 )
...
* [fix][doc] Dead link for python api
ref: apache/dolphinscheduler#12779 and
apache/dolphinscheduler-sdk-python#1
* fix dead link
2 years ago
775b3f87b4
[doc] Add skip spotless check during ASF release. ( #12835 )
2 years ago
1347a8f94c
[chore] Separate Python API into another repository ( #12779 )
...
Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
2 years ago
9bba4b105c
[fix][doc] Fix sql-hive and hive-cli doc ( #12765 )
2 years ago
6d79414491
Add instructions on how to configure logging level for debugging purpose ( #12699 )
2 years ago
Jay Chung
Tq
kezhenxu94
v-wx-v
Eric Gao
Kerwin
Donald Yang
lenian
Aaron Wang
陈家名
Amy0104
Wenjun Ruan
JieguangZhou
lifeng
longtb
旺阳
rickchengx
insist777
John Bampton
Assert
xuhhui
baihongbin