Tree: fb8f3edc5a

2.0.7-release

2.0.8-release

2.0.9-release

3.0.0-release

3.0.0/version-upgrade

3.0.1-release

3.0.2-release

3.0.3-release

3.0.4-release

3.0.5-release

3.0.6-release

3.1.0-release

3.1.1-release

3.1.2-release

3.1.3-release

3.1.4-release

3.1.5-release

3.1.6-release

3.1.7-release

3.1.8-release

3.1.9-release

3.2.0-release

3.2.1-prepare

3.2.1-release

3.2.2-prepare

3.2.2-release

3.2.2-release-bak

dev

dev_wenjun_refactorMaster

upstream-dev

1.0.0

1.0.1

1.0.2

1.0.3

1.0.4

1.0.5

1.1.0

1.1.0-preview

1.2.0

1.2.1

1.3.0

1.3.1

1.3.2

1.3.3

1.3.4

1.3.5

1.3.6

1.3.8

1.3.9

2.0.0

2.0.0-alpha

2.0.1

2.0.2

2.0.3

2.0.4

2.0.5

2.0.6

2.0.7

2.0.8

2.0.9

3.0.0

3.0.0-alpha

3.0.0-beta-1

3.0.0-beta-2

3.0.1

3.0.2

3.0.3

3.0.4

3.0.5

3.0.6

3.1.0

3.1.1

3.1.2

3.1.3

3.1.4

3.1.5

3.1.6

3.1.7

3.1.8

3.1.9

3.2.0

test

v2.3.3

v2.3.4.202211081355

v2.3.4.202211091515

vdev-20220412-1028

vdev-20220414-1341

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'fb8f3edc5a'

${ noResults }

Commit Graph

916 Commits (fb8f3edc5adaa42a48389895f3a16a173495e935)

Author	SHA1	Message	Date
zixi0825	4ba6d667fc	[Feature][DataQuality] Add Data quality Module #4283 (#6718) ... * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA * fix Constants bug * remove the unused class * add unit test * fix code style error * add unit test * refactor data quality common entity * fix code style error * add unit test * close e2e test * fix code smell bug * modify dataquality enum value to 14 in TaskType * add data qualtiy task * update * add getDatasourceOptions interface * fix checkstyle * close e2e test * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * add unit test and alter dataquality task result * fix checkstyle * fix process service test error * add unit test and fix code smells * fix checkstyle error * fix unit test error * fix checkstyle error * change execute sql type name * revert ui pom.xml * fix data quality task error * fix checkstyle error * fix dq task src_connector_type ui select bug * fix spark rw postgresql bug * change mysql driver scope * fix form-create json bug * fix code smell * fix DolphinException Bug * fix ui validate rule and Alert title * fix target connection param bug * fix threshold validate change * add rule input entry index * change statistic_comparison_check logic * remove check type change * add DateExpressionReplaceUtil * fix null point expetion * fix null point expetion * fix test error * add more sql driver * fix test error and remove DateExprReplaceUtil * add get datasource tables and columns * add get datasource tables and columns * remove hive-jdbc in pom.xml * fix code smells * update sql * change the pom.xml * optimize multi_table_accuracy ui * fix v-show error * fix code smells * update sql * [Feature][DataQuality] Add data quality task ui (#5054) * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * fix dq task src_connector_type ui select bug * fix threshold validate change * remove check type change * add get datasource tables and columns * optimize multi_table_accuracy ui * fix v-show error * fix code smells Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality module (#4830) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * update * close e2e test * fix spark rw postgresql bug * change mysql driver scope * add more sql driver * remove hive-jdbc in pom.xml * change the pom.xml Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality task backend (#4883) * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA Co-authored-by: sunchaohe <sunzhaohe@linklogis.com> * refactor data_quality_module * add header license * data quality module refactor * fix unit test error * fix checkstyle error * fix unit test error * fix checkstyle error * fix unit test error * fix code smell * fix check style * fix unit test error * task statistics value add unique code * fix unit test error * fix checkstyle error * fix checkstyle * fix security hotspot * fix unit test error * fix security hotspot * fix check * add data quality task error handling * fix unit test error * add unit test * add unit test * optimize data quality result alert * fix unit test * fix sql script error * fix bug * update sql script * fix checkstyle * add license * fix checkstyle * fix checkstyle * fix unit test * add jacoco dependencies * fix unit test * fix unit test * add jacoco dependencies * add unit test * add unit test * add license * fix checkstyle * fix pom * fix checkstyle * fix checkstyle * merge dev * fix ui error * fix pom error * fix pom error * fix test error * fix test error * mssql-jdbc exclude azure-keyvault * fix test error * merge dev and add unit test * add notes * rollback the CollectionUtils * fix * update sql * fix * fix * fix query rule page error * change dq.jar path * fix sql error * fix ui error * fix(dq): jar path&task enum description * add notes on DataQualityApplication * fix dq result jump error * fix(ui): page condition * feat(ui): add show error output path * change version * remove all chinese word in sql * merge Co-authored-by: sunchaohe <sunzhaohe@linklogis.com>	3 years ago
yc322	fb9f4a1339	[Feature-5822][api] Add audit log (#6322) ... * rebase * update audit log type name * fix the quoted property error * fix bug * update audit global switch default value * fix wrong ddl comment * fix wrong code style * update audit log search sql * add licenses * add unit test * fix wrong code style * fix bugs * fix wrong code style * add test case * add test case * add license * Add unit test in pom.xml * resolve code smell problem * mysql and postgresql ddl update * update audit log path and audit page query * update audit configuration * update audit log schema, add resource type and resource id * update audit query and list page * resolve audit log front page bugs and log query error * update audit configuration * resolve wrong configuration * update AuditLogControllerTest * update application.yaml * resolve code smell * update standalone configuration * resolve bugs Co-authored-by: yc322 <1393242780@qq.com>	3 years ago
Kerwin	103ccb01da	change version to 2.0.4-SNAPSHOT (#8188)	3 years ago
wind	b5fa54b6be	[Bug-7865][MasterServer] retry logic optimization (#8156) ... * submit task optimization * cloneAndReset * update * tolerant task restart when init * fix snoar check * fix test * delete unuse file * taskInstance key * code style * skip complete when retry Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
mask	898727709f	[fix-7671][plugin] Supports whether SQL is placed in the same session for configuration(fix-7671) (#7675) ... -Supports whether SQL is placed in the same session for configuration	3 years ago
Ivan0626	b807c677ab	Close the FileOutputStream in FileUtils.java file (#7937) ... Close the FileOutputStream in FileUtils.java file	3 years ago
wind	e4cdd82b7c	[Improvement][TaskLog] Unified task log (#7831) ... * task logger * update * log format * remove master config task-logger * udpate log level Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
Kerwin	5172862a0a	Add seatunnel task plugin (#7131)	3 years ago
springmonster	0911fd711d	[Bug-7832, Improvement] Add unit test for worker module, fix apache#7832. Optimize HttpUtils and HttpUtilsTest 1. Checking input parameters of getResponseContentString 2. Add unit test (#7798)	3 years ago
aaronlinv	707e3a6ec1	[Improvement][Logger] Logger server integrate into master and worker (#6894)	3 years ago
wind	8808c0a700	[Bug-7474][MasterServer] fix failover when node host is null (#7475) ... * fix failover when node host is null * add failover execute thread * worker handle dead server * fix task instance failover time check * fix upgrade sql * failover logic update Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
BaoLiang	605767e47b	[Fix-7654]Dependent node onChangeProjectCode error (#7672) ... * fix #7654 Dependent node onChangeProjectCode error * fix #7654 Dependent node onChangeProjectCode error * fix #7654 Dependent node onChangeProjectCode error * update ut	3 years ago
wangxj3	9e763ad0d1	[Feature-#6422] [api-server] task group queue (#7491) ... * add task group * modify task group * pull dev * add license header * modify code style * fix code style * fix sql error * fix error * fix test * fix test * fix test * fix test * fix code style * fix ut * code style * fix unit test * test ut * ut * add unittest * test ut * modify back ut * majorization code * fix conflict * fix ut * add task group api * reset file * fix ut * fix lost column * fix ut * fix ut * fix ut * fix ut * delete duplicate code * fix code style 、name * fix ut * fix mapper Co-authored-by: wangxj <wangxj31>	3 years ago
wind	41bf1a955e	[Improvement-7213][MasterServer] execute thread pool code optimization (#7258) ... * threadpool optimization * threadpool params * rebase dev * ut check fix * add return * rebase dev * event loop Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
kezhenxu94	67cc260d52	Split the components into individual package, refactor configurations to use Spring properties (#7160) ... * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes. * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes. * Split the components into individual package A follow-up PR will be made to build dedicated Docker images for each component, so that every component Docker image has minimal jars, which is easy to maintain and good for security fixes.	3 years ago
Kerwin	4e6265df11	fix Property or field 'all' cannot be found (#7246)	3 years ago
Manhua	2dc09c627f	[Fix-5551][common] Fix ExecutionStatus for hive-on-Tez application (#6289) ... * add ENDED state * Update HadoopUtils.java	3 years ago
zwZjut	af9ed35295	[Feature][MasterServer] add cache for workGroup and schedule #6987 (#7161) ... * to #6987 * to #6987 * to #6987 * to #6987 * to #6987 * to #6987: @Param -> @Name * to #6987: fix Sonar * to #6987: fix Sonar Co-authored-by: honghuo.zw <honghuo.zw@alibaba-inc.com>	3 years ago
wind	ba2b2a67c2	[Feature-6988][MasterServer] add cache manager for workflow (#7090) ... * add cache manager for workflow * [DS-6988][MasterServer] add cache manager for workflow * cache evict code optimization * test Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wangxj3	2b519f31e9	[Feature-#6422] task group queue (#6722) ... * add task group * modify task group * pull dev * add license header * modify code style * fix code style * fix sql error * fix error * fix test * fix test * fix test * fix test * fix code style * fix ut * code style * fix unit test * test ut * ut * add unittest * test ut * modify back ut * majorization code * fix conflict * fix ut Co-authored-by: wangxj <wangxj31>	3 years ago
kezhenxu94	2ed3c0c3a7	Recover unit tests that have not been run for some time (#7054)	3 years ago
Sunny Lei	0dcff1425a	[DS-5229][feat] Implement server port custom config (#6947) ... * [DS-5229][fix] server port custom config This closes #5229 * [DS-5229][feat] Implement server port custom config This closes #5229 * [Bug] [readme] Error link to Docker and k8s in readme apache#6802 (#6862) * [Bug] [readme] Error link to Docker and k8s in readme #6802 1、modify the error link * [Bug] [readme] Error link to Docker and k8s in readme #6802 1、modify the error link in readme_zh_cn.md * [DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852) Co-authored-by: caishunfeng <534328519@qq.com> * [DS-5229][feat] Implement server port custom config Modify review suggestion This closes #5229 Co-authored-by: GaoTianDuo <gaotianduo_yewu@cmss.chinamobile.com> Co-authored-by: wind <caishunfeng@users.noreply.github.com> Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
Kerwin	f0630bc9a0	Fix view task status module on project homepage cannot read property label of undefined (#6956)	3 years ago
Hua Jiang	a0955a078a	[Fix-7019][MasterServer] Fix the issue with failing to save and run the process that contains the switch task. (#7046)	3 years ago
wind	8e93939121	[DS-6963][MasterServer]add cache manager for tenant and user (#6974) ... * cache manager for tenant and user * add test * fix checkstyle * add dependencies * fix sonar check * use spring boot cache configuration * add license * check style * check style * add license * change proxy name to processor * add license header * check style * add license file * add license file * add license Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
lvshaokang	1a88b1863b	[Improvement-5785][common] Fix code format (#6864) ... * [DS-5785][style] Fix common module code format * [DS-5785][style] Fix common module code format	3 years ago
kezhenxu94	ef0cb46661	Fix shell tools for database schema cannot run (#7003)	3 years ago
wind	e6239e808b	[DS-6829][WorkerServer] skip create log dir and print log in dryRun model (#6852) ... Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
JinYong Li	4bec792160	[Fix][Common] rewrite code generate,fix bit shift (#6914) ... * rewrite code generate,fix bit shift * fix ut * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * add algorithm from licenses file * fix ut	3 years ago
Kerwin	802fc498b5	[Fix-#6605][Common] Fix the situation where the obtained string property is empty. (#6661) ... * Fix the situation where the obtained string property is empty. * recovery test * update code style. * megre dev.	3 years ago
chouc	f564687a89	[Improvement][Log] optimize task log path to reduce task running time (#6731) ... * [Improvement][Log] optimize task log path to reduce task running time * Reduce the creation of log directories Co-authored-by: Kirs <acm_master@163.com>	3 years ago
OS	880c1d28ff	[Feature][master] change sub process id to code. (#6846) ... * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * 6597 change sub process id to code. * code style * fix ut process * fix ut process	3 years ago
kezhenxu94	4114cb07f6	Add actuator and enable metrics, add Grafana configs (#6840)	3 years ago
mask	a998415afe	[Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) (#6828) ... * [Feature][datasource] Change DataSource Connection Pool from Druid to HiKariCP (#6490) * fix pom dep scope * filter alert * filter alert * filter alert * fix checkstyle * remove hikaricp version * update pom * add properties * add properties * rename properties * fix e2e fail * rename properties	3 years ago
Assert	089f73ebe4	[Fix-6707][common] Fix complement data error because of global variables (#6759) ... * [Fix-6707][common] Fix complement data error because of global variables * [Fix-6707][common] Fix complement data error because of global variables * [Fix-6707][common] Fix complement data error because of global variables * [Fix-6707][common] Fix complement data error because of global variables Co-authored-by: shangeyao <sgy960921> Co-authored-by: OS <29528966+lenboo@users.noreply.github.com>	3 years ago
Jiajie Zhong	6045728428	[ci] Add checkstyle prohibit rule System.out.println (#6778) ... * [ci] Add checkstyle prohibit rule System.out.println * Correct RegexpSingleline place	3 years ago
kezhenxu94	11844415b0	Refactor datasource and task plugins and simplify its usage (#6767)	3 years ago
mask	0aea5ae11a	[feature-6071][plugin] add datasource plugin. (#6071) (#6361) ... * [feature-6071][plugin] add datasource plugin. (#6071) * remove the dependency of datasource in common and task-plugin module. * the new datasource-api module provides data source connection acquisition. * add sqlserver data source plug-in. * add ds license * fix check style * update spi pom * frx conflict resolution * fix check style * fix datasource ut * fix code check style * fix code check style * fix datasource ut * add pg hive mysql oracle clickhouse db2 datasource * fix datasource package * update datasource pom * update datasource pom * update datasource pom * update datasource pom * update pom * update pom dep * update pom dep * fix license * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * fix ut * add oracle package * modify comments * conflict resolution * rename log comment * rename log comment	3 years ago
kezhenxu94	05bae0b226	Refactor alert plugins and simplify its usage (#6723)	3 years ago
kezhenxu94	02350ea37b	Fix datasource not work in tests and standalone server, and run all tests by default (#6743)	3 years ago
JinYong Li	be28d2c63b	[Bug][SnowFlakeUtils] fix snowFlake bug (#6744) ... * fix snowFlake bug * fix hash machine	3 years ago
kezhenxu94	63602bf77c	Clean up the utility codes (#6732)	3 years ago
Wenjun Ruan	0f94577d26	Use nanoTime replace currentTimemill to avoid clock backwards (#6740)	3 years ago
OS	24bd8a16e1	[Bug][Master] The task of dependent should use taskCode (#6730) ... * fix #6682 The task of dependent should use taskCode * fix #6682 The task of dependent should use taskCode	3 years ago
Wenjun Ruan	0afb780718	[Improvement-5807][Dao] Use h2 in UT (#6500) ... * Use H2 in UT * change scope * Change profile name to h2 * Add datasource-h2.properties, datasource-postgresql.properties * Fix UT * Resolve conflict * Remove startDatabase	3 years ago
kezhenxu94	5400abc74f	Refactor registry plugin and simplify its usage (#6712)	3 years ago
wind	72daba58cd	[DS-6694][Master] Reduce the refresh resource interval of LowerWeight (#6695) ... * [DS-6694][Master] Reduce the refresh resource interval of LowerWeight * add server node update event handle Co-authored-by: caishunfeng <534328519@qq.com>	3 years ago
wangxj3	dc8b87e473	[Feature-#6268][server-master] Serial execte process (#6185) ... * add serial processInstance * fix bug * add test * fix code style * fix style code * add sql * fix sql error * add api * add test * fix code style * modify api * delete column , fix mapper * fix unimport * fix test * fix bug of missing param for Python * fix code style * fix test * fix test Co-authored-by: wangxj <wangxj31>	3 years ago
Jiajie Zhong	dd6ed36f65	Add Python API implementation of workflows-as-code (#6269) ... * Init DS python SDK pydolphinscheduler: python code definition * Doc first * Add quick start and developer doc * Java documentation change * Add LICENSE-py4j.txt * Add py4j to release-docs/LICENSE * Move dependency version to parent pom * Remove outdated code * Add tenant parameter to tutorial	3 years ago
aCodingAddict	f60e3c219a	[DS-6606] [common] JSONUtils#getNodeString String type (#6618)	3 years ago