diff --git a/EasyScheduler使用手册.docx b/docs/EasyScheduler使用手册.docx similarity index 100% rename from EasyScheduler使用手册.docx rename to docs/EasyScheduler使用手册.docx diff --git a/gitbook/fonts/fontawesome/FontAwesome.otf b/docs/gitbook/fonts/fontawesome/FontAwesome.otf similarity index 100% rename from gitbook/fonts/fontawesome/FontAwesome.otf rename to docs/gitbook/fonts/fontawesome/FontAwesome.otf diff --git a/gitbook/fonts/fontawesome/fontawesome-webfont.eot b/docs/gitbook/fonts/fontawesome/fontawesome-webfont.eot similarity index 100% rename from gitbook/fonts/fontawesome/fontawesome-webfont.eot rename to docs/gitbook/fonts/fontawesome/fontawesome-webfont.eot diff --git a/gitbook/fonts/fontawesome/fontawesome-webfont.svg b/docs/gitbook/fonts/fontawesome/fontawesome-webfont.svg similarity index 100% rename from gitbook/fonts/fontawesome/fontawesome-webfont.svg rename to docs/gitbook/fonts/fontawesome/fontawesome-webfont.svg diff --git a/gitbook/fonts/fontawesome/fontawesome-webfont.ttf b/docs/gitbook/fonts/fontawesome/fontawesome-webfont.ttf similarity index 100% rename from gitbook/fonts/fontawesome/fontawesome-webfont.ttf rename to docs/gitbook/fonts/fontawesome/fontawesome-webfont.ttf diff --git a/gitbook/fonts/fontawesome/fontawesome-webfont.woff b/docs/gitbook/fonts/fontawesome/fontawesome-webfont.woff similarity index 100% rename from gitbook/fonts/fontawesome/fontawesome-webfont.woff rename to docs/gitbook/fonts/fontawesome/fontawesome-webfont.woff diff --git a/gitbook/fonts/fontawesome/fontawesome-webfont.woff2 b/docs/gitbook/fonts/fontawesome/fontawesome-webfont.woff2 similarity index 100% rename from gitbook/fonts/fontawesome/fontawesome-webfont.woff2 rename to docs/gitbook/fonts/fontawesome/fontawesome-webfont.woff2 diff --git a/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.css b/docs/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.css similarity index 100% rename from gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.css rename to docs/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.css diff --git a/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.js b/docs/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.js similarity index 100% rename from gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.js rename to docs/gitbook/gitbook-plugin-expandable-chapters/expandable-chapters.js diff --git a/gitbook/gitbook-plugin-fontsettings/fontsettings.js b/docs/gitbook/gitbook-plugin-fontsettings/fontsettings.js similarity index 100% rename from gitbook/gitbook-plugin-fontsettings/fontsettings.js rename to docs/gitbook/gitbook-plugin-fontsettings/fontsettings.js diff --git a/gitbook/gitbook-plugin-fontsettings/website.css b/docs/gitbook/gitbook-plugin-fontsettings/website.css similarity index 100% rename from gitbook/gitbook-plugin-fontsettings/website.css rename to docs/gitbook/gitbook-plugin-fontsettings/website.css diff --git a/gitbook/gitbook-plugin-highlight/ebook.css b/docs/gitbook/gitbook-plugin-highlight/ebook.css similarity index 100% rename from gitbook/gitbook-plugin-highlight/ebook.css rename to docs/gitbook/gitbook-plugin-highlight/ebook.css diff --git a/gitbook/gitbook-plugin-highlight/website.css b/docs/gitbook/gitbook-plugin-highlight/website.css similarity index 100% rename from gitbook/gitbook-plugin-highlight/website.css rename to docs/gitbook/gitbook-plugin-highlight/website.css diff --git a/gitbook/gitbook-plugin-insert-logo-link/plugin.css b/docs/gitbook/gitbook-plugin-insert-logo-link/plugin.css similarity index 100% rename from gitbook/gitbook-plugin-insert-logo-link/plugin.css rename to docs/gitbook/gitbook-plugin-insert-logo-link/plugin.css diff --git a/gitbook/gitbook-plugin-insert-logo-link/plugin.js b/docs/gitbook/gitbook-plugin-insert-logo-link/plugin.js similarity index 100% rename from gitbook/gitbook-plugin-insert-logo-link/plugin.js rename to docs/gitbook/gitbook-plugin-insert-logo-link/plugin.js diff --git a/gitbook/gitbook-plugin-livereload/plugin.js b/docs/gitbook/gitbook-plugin-livereload/plugin.js similarity index 100% rename from gitbook/gitbook-plugin-livereload/plugin.js rename to docs/gitbook/gitbook-plugin-livereload/plugin.js diff --git a/gitbook/gitbook-plugin-lunr/lunr.min.js b/docs/gitbook/gitbook-plugin-lunr/lunr.min.js similarity index 100% rename from gitbook/gitbook-plugin-lunr/lunr.min.js rename to docs/gitbook/gitbook-plugin-lunr/lunr.min.js diff --git a/gitbook/gitbook-plugin-lunr/search-lunr.js b/docs/gitbook/gitbook-plugin-lunr/search-lunr.js similarity index 100% rename from gitbook/gitbook-plugin-lunr/search-lunr.js rename to docs/gitbook/gitbook-plugin-lunr/search-lunr.js diff --git a/gitbook/gitbook-plugin-search/lunr.min.js b/docs/gitbook/gitbook-plugin-search/lunr.min.js similarity index 100% rename from gitbook/gitbook-plugin-search/lunr.min.js rename to docs/gitbook/gitbook-plugin-search/lunr.min.js diff --git a/gitbook/gitbook-plugin-search/search-engine.js b/docs/gitbook/gitbook-plugin-search/search-engine.js similarity index 100% rename from gitbook/gitbook-plugin-search/search-engine.js rename to docs/gitbook/gitbook-plugin-search/search-engine.js diff --git a/gitbook/gitbook-plugin-search/search.css b/docs/gitbook/gitbook-plugin-search/search.css similarity index 100% rename from gitbook/gitbook-plugin-search/search.css rename to docs/gitbook/gitbook-plugin-search/search.css diff --git a/gitbook/gitbook-plugin-search/search.js b/docs/gitbook/gitbook-plugin-search/search.js similarity index 100% rename from gitbook/gitbook-plugin-search/search.js rename to docs/gitbook/gitbook-plugin-search/search.js diff --git a/gitbook/gitbook-plugin-sharing/buttons.js b/docs/gitbook/gitbook-plugin-sharing/buttons.js similarity index 100% rename from gitbook/gitbook-plugin-sharing/buttons.js rename to docs/gitbook/gitbook-plugin-sharing/buttons.js diff --git a/gitbook/gitbook.js b/docs/gitbook/gitbook.js similarity index 100% rename from gitbook/gitbook.js rename to docs/gitbook/gitbook.js diff --git a/gitbook/images/apple-touch-icon-precomposed-152.png b/docs/gitbook/images/apple-touch-icon-precomposed-152.png similarity index 100% rename from gitbook/images/apple-touch-icon-precomposed-152.png rename to docs/gitbook/images/apple-touch-icon-precomposed-152.png diff --git a/gitbook/images/favicon.ico b/docs/gitbook/images/favicon.ico similarity index 100% rename from gitbook/images/favicon.ico rename to docs/gitbook/images/favicon.ico diff --git a/gitbook/style.css b/docs/gitbook/style.css similarity index 100% rename from gitbook/style.css rename to docs/gitbook/style.css diff --git a/gitbook/theme.js b/docs/gitbook/theme.js similarity index 100% rename from gitbook/theme.js rename to docs/gitbook/theme.js diff --git a/docs/images/architecture.jpg b/docs/images/architecture.jpg deleted file mode 100644 index 34791b1608..0000000000 Binary files a/docs/images/architecture.jpg and /dev/null differ diff --git a/images/esr_1.png b/docs/images/esr_1.png similarity index 100% rename from images/esr_1.png rename to docs/images/esr_1.png diff --git a/images/esr_10.png b/docs/images/esr_10.png similarity index 100% rename from images/esr_10.png rename to docs/images/esr_10.png diff --git a/images/esr_11.png b/docs/images/esr_11.png similarity index 100% rename from images/esr_11.png rename to docs/images/esr_11.png diff --git a/images/esr_12.png b/docs/images/esr_12.png similarity index 100% rename from images/esr_12.png rename to docs/images/esr_12.png diff --git a/images/esr_13.png b/docs/images/esr_13.png similarity index 100% rename from images/esr_13.png rename to docs/images/esr_13.png diff --git a/images/esr_2.png b/docs/images/esr_2.png similarity index 100% rename from images/esr_2.png rename to docs/images/esr_2.png diff --git a/images/esr_3.png b/docs/images/esr_3.png similarity index 100% rename from images/esr_3.png rename to docs/images/esr_3.png diff --git a/images/esr_4.png b/docs/images/esr_4.png similarity index 100% rename from images/esr_4.png rename to docs/images/esr_4.png diff --git a/images/esr_5.png b/docs/images/esr_5.png similarity index 100% rename from images/esr_5.png rename to docs/images/esr_5.png diff --git a/images/esr_6.png b/docs/images/esr_6.png similarity index 100% rename from images/esr_6.png rename to docs/images/esr_6.png diff --git a/images/esr_7.png b/docs/images/esr_7.png similarity index 100% rename from images/esr_7.png rename to docs/images/esr_7.png diff --git a/images/esr_8.png b/docs/images/esr_8.png similarity index 100% rename from images/esr_8.png rename to docs/images/esr_8.png diff --git a/images/esr_9.png b/docs/images/esr_9.png similarity index 100% rename from images/esr_9.png rename to docs/images/esr_9.png diff --git a/images/favicon.ico b/docs/images/favicon.ico similarity index 100% rename from images/favicon.ico rename to docs/images/favicon.ico diff --git a/images/logo.png b/docs/images/logo.png similarity index 100% rename from images/logo.png rename to docs/images/logo.png diff --git a/images/mal_1.png b/docs/images/mal_1.png similarity index 100% rename from images/mal_1.png rename to docs/images/mal_1.png diff --git a/images/mal_10.png b/docs/images/mal_10.png similarity index 100% rename from images/mal_10.png rename to docs/images/mal_10.png diff --git a/images/mal_11.png b/docs/images/mal_11.png similarity index 100% rename from images/mal_11.png rename to docs/images/mal_11.png diff --git a/images/mal_12.png b/docs/images/mal_12.png similarity index 100% rename from images/mal_12.png rename to docs/images/mal_12.png diff --git a/images/mal_13.png b/docs/images/mal_13.png similarity index 100% rename from images/mal_13.png rename to docs/images/mal_13.png diff --git a/images/mal_14.png b/docs/images/mal_14.png similarity index 100% rename from images/mal_14.png rename to docs/images/mal_14.png diff --git a/images/mal_15.png b/docs/images/mal_15.png similarity index 100% rename from images/mal_15.png rename to docs/images/mal_15.png diff --git a/images/mal_16.png b/docs/images/mal_16.png similarity index 100% rename from images/mal_16.png rename to docs/images/mal_16.png diff --git a/images/mal_17.png b/docs/images/mal_17.png similarity index 100% rename from images/mal_17.png rename to docs/images/mal_17.png diff --git a/images/mal_18.png b/docs/images/mal_18.png similarity index 100% rename from images/mal_18.png rename to docs/images/mal_18.png diff --git a/images/mal_19.png b/docs/images/mal_19.png similarity index 100% rename from images/mal_19.png rename to docs/images/mal_19.png diff --git a/images/mal_2.png b/docs/images/mal_2.png similarity index 100% rename from images/mal_2.png rename to docs/images/mal_2.png diff --git a/images/mal_20.png b/docs/images/mal_20.png similarity index 100% rename from images/mal_20.png rename to docs/images/mal_20.png diff --git a/images/mal_21.png b/docs/images/mal_21.png similarity index 100% rename from images/mal_21.png rename to docs/images/mal_21.png diff --git a/images/mal_22.png b/docs/images/mal_22.png similarity index 100% rename from images/mal_22.png rename to docs/images/mal_22.png diff --git a/images/mal_23.png b/docs/images/mal_23.png similarity index 100% rename from images/mal_23.png rename to docs/images/mal_23.png diff --git a/images/mal_24.png b/docs/images/mal_24.png similarity index 100% rename from images/mal_24.png rename to docs/images/mal_24.png diff --git a/images/mal_25.png b/docs/images/mal_25.png similarity index 100% rename from images/mal_25.png rename to docs/images/mal_25.png diff --git a/images/mal_26.png b/docs/images/mal_26.png similarity index 100% rename from images/mal_26.png rename to docs/images/mal_26.png diff --git a/images/mal_27.png b/docs/images/mal_27.png similarity index 100% rename from images/mal_27.png rename to docs/images/mal_27.png diff --git a/images/mal_28.png b/docs/images/mal_28.png similarity index 100% rename from images/mal_28.png rename to docs/images/mal_28.png diff --git a/images/mal_29.png b/docs/images/mal_29.png similarity index 100% rename from images/mal_29.png rename to docs/images/mal_29.png diff --git a/images/mal_3.png b/docs/images/mal_3.png similarity index 100% rename from images/mal_3.png rename to docs/images/mal_3.png diff --git a/images/mal_30.png b/docs/images/mal_30.png similarity index 100% rename from images/mal_30.png rename to docs/images/mal_30.png diff --git a/images/mal_31.png b/docs/images/mal_31.png similarity index 100% rename from images/mal_31.png rename to docs/images/mal_31.png diff --git a/images/mal_32.png b/docs/images/mal_32.png similarity index 100% rename from images/mal_32.png rename to docs/images/mal_32.png diff --git a/images/mal_33.png b/docs/images/mal_33.png similarity index 100% rename from images/mal_33.png rename to docs/images/mal_33.png diff --git a/images/mal_34.png b/docs/images/mal_34.png similarity index 100% rename from images/mal_34.png rename to docs/images/mal_34.png diff --git a/images/mal_35.png b/docs/images/mal_35.png similarity index 100% rename from images/mal_35.png rename to docs/images/mal_35.png diff --git a/images/mal_36.png b/docs/images/mal_36.png similarity index 100% rename from images/mal_36.png rename to docs/images/mal_36.png diff --git a/images/mal_37.png b/docs/images/mal_37.png similarity index 100% rename from images/mal_37.png rename to docs/images/mal_37.png diff --git a/images/mal_38.png b/docs/images/mal_38.png similarity index 100% rename from images/mal_38.png rename to docs/images/mal_38.png diff --git a/images/mal_39.png b/docs/images/mal_39.png similarity index 100% rename from images/mal_39.png rename to docs/images/mal_39.png diff --git a/images/mal_4.png b/docs/images/mal_4.png similarity index 100% rename from images/mal_4.png rename to docs/images/mal_4.png diff --git a/images/mal_40.png b/docs/images/mal_40.png similarity index 100% rename from images/mal_40.png rename to docs/images/mal_40.png diff --git a/images/mal_41.png b/docs/images/mal_41.png similarity index 100% rename from images/mal_41.png rename to docs/images/mal_41.png diff --git a/images/mal_42.png b/docs/images/mal_42.png similarity index 100% rename from images/mal_42.png rename to docs/images/mal_42.png diff --git a/images/mal_43.png b/docs/images/mal_43.png similarity index 100% rename from images/mal_43.png rename to docs/images/mal_43.png diff --git a/images/mal_44.png b/docs/images/mal_44.png similarity index 100% rename from images/mal_44.png rename to docs/images/mal_44.png diff --git a/images/mal_45.png b/docs/images/mal_45.png similarity index 100% rename from images/mal_45.png rename to docs/images/mal_45.png diff --git a/images/mal_46.png b/docs/images/mal_46.png similarity index 100% rename from images/mal_46.png rename to docs/images/mal_46.png diff --git a/images/mal_47.png b/docs/images/mal_47.png similarity index 100% rename from images/mal_47.png rename to docs/images/mal_47.png diff --git a/images/mal_48.png b/docs/images/mal_48.png similarity index 100% rename from images/mal_48.png rename to docs/images/mal_48.png diff --git a/images/mal_49.png b/docs/images/mal_49.png similarity index 100% rename from images/mal_49.png rename to docs/images/mal_49.png diff --git a/images/mal_5.png b/docs/images/mal_5.png similarity index 100% rename from images/mal_5.png rename to docs/images/mal_5.png diff --git a/images/mal_50.png b/docs/images/mal_50.png similarity index 100% rename from images/mal_50.png rename to docs/images/mal_50.png diff --git a/images/mal_51.png b/docs/images/mal_51.png similarity index 100% rename from images/mal_51.png rename to docs/images/mal_51.png diff --git a/images/mal_52.png b/docs/images/mal_52.png similarity index 100% rename from images/mal_52.png rename to docs/images/mal_52.png diff --git a/images/mal_53.png b/docs/images/mal_53.png similarity index 100% rename from images/mal_53.png rename to docs/images/mal_53.png diff --git a/images/mal_54.png b/docs/images/mal_54.png similarity index 100% rename from images/mal_54.png rename to docs/images/mal_54.png diff --git a/images/mal_55.png b/docs/images/mal_55.png similarity index 100% rename from images/mal_55.png rename to docs/images/mal_55.png diff --git a/images/mal_56.png b/docs/images/mal_56.png similarity index 100% rename from images/mal_56.png rename to docs/images/mal_56.png diff --git a/images/mal_57.png b/docs/images/mal_57.png similarity index 100% rename from images/mal_57.png rename to docs/images/mal_57.png diff --git a/images/mal_58.png b/docs/images/mal_58.png similarity index 100% rename from images/mal_58.png rename to docs/images/mal_58.png diff --git a/images/mal_59.png b/docs/images/mal_59.png similarity index 100% rename from images/mal_59.png rename to docs/images/mal_59.png diff --git a/images/mal_6.png b/docs/images/mal_6.png similarity index 100% rename from images/mal_6.png rename to docs/images/mal_6.png diff --git a/images/mal_60.png b/docs/images/mal_60.png similarity index 100% rename from images/mal_60.png rename to docs/images/mal_60.png diff --git a/images/mal_61.png b/docs/images/mal_61.png similarity index 100% rename from images/mal_61.png rename to docs/images/mal_61.png diff --git a/images/mal_62.png b/docs/images/mal_62.png similarity index 100% rename from images/mal_62.png rename to docs/images/mal_62.png diff --git a/images/mal_63.png b/docs/images/mal_63.png similarity index 100% rename from images/mal_63.png rename to docs/images/mal_63.png diff --git a/images/mal_64.png b/docs/images/mal_64.png similarity index 100% rename from images/mal_64.png rename to docs/images/mal_64.png diff --git a/images/mal_7.png b/docs/images/mal_7.png similarity index 100% rename from images/mal_7.png rename to docs/images/mal_7.png diff --git a/images/mal_8.png b/docs/images/mal_8.png similarity index 100% rename from images/mal_8.png rename to docs/images/mal_8.png diff --git a/images/mal_9.png b/docs/images/mal_9.png similarity index 100% rename from images/mal_9.png rename to docs/images/mal_9.png diff --git a/images/mal_t_1.jpg b/docs/images/mal_t_1.jpg similarity index 100% rename from images/mal_t_1.jpg rename to docs/images/mal_t_1.jpg diff --git a/images/mal_t_2.jpg b/docs/images/mal_t_2.jpg similarity index 100% rename from images/mal_t_2.jpg rename to docs/images/mal_t_2.jpg diff --git a/images/vs_scheduler.jpg b/docs/images/vs_scheduler.jpg similarity index 100% rename from images/vs_scheduler.jpg rename to docs/images/vs_scheduler.jpg diff --git a/docs/index.html b/docs/index.html index 97ce6cbb17..fe2ddd5c38 100644 --- a/docs/index.html +++ b/docs/index.html @@ -1 +1,902 @@ -welcome + + + + + + + Easyscheduler简介 · 调度系统-EasyScheduler + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+ + + + + + + + +
+ +
+ +
+ + + + + + + + +
+
+ +
+
+ +
+ +

简介

+

导语

+
+
EasyScheduler是易观研发的大数据分布式工作流调度系统。主要解决数据研发ETL错综复杂的依赖关系,而不能直观监控任务健康状态等问题。EasyScheduler通过可视化拖拽任务节点的方式形成DAG(有向无环图)流程图,在运行过程中可实时监控任务的运行状态,同时支持重试、从指定节点恢复失败、暂停及Kill任务、任务运行历史查看等等操作。
+
+

背景

+

工作流调度系统在大数据平台中是一个核心的基础设施,是大数据开发必不可少的重要组成部分。由于数据处理流程常常具有很长的依赖链条,因此依赖单机的crontab等单纯依赖时间调度的方式,往往存在很大的弊端,如依赖不清晰,出错难以查找等问题。因此,我们调研了市面上流行的调度系统。 +并和azkaban、airflow做了一些对比:

+
+

+
+

JPG

+
+

       鉴于易观日处理数据30TB,复杂的ETL依赖关系,我们开发了EasyScheduler。

+
+

EasyScheduler由在工作流调度方面工作多年的几位小伙伴研发而成,致力于成为大数据平台的中流砥柱,使调度变得更加容易,更可以从其中文名“易调度”看出我们的初衷,如果你对目前市面上的调度不够满意,非常欢迎试用易调度,欢迎大家加入进来,提出需求,也欢迎贡献代码, 感兴趣的伙伴们可以加我们微信:510570367,一起加入EasyScheduler吧,多多交流!

+

系统部分截图:

+

工作流实例

+

工作流DAG设计

+

工作流DAG任务节点设计

+

工作流运行情况

+ + +
+ +
+
+
+ +

results matching ""

+
    + +
    +
    + +

    No results matching ""

    + +
    +
    +
    + +
    +
    + +
    + + + + + + +
    + + +
    + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/pages/background-1.md b/docs/pages/background-1.md similarity index 100% rename from pages/background-1.md rename to docs/pages/background-1.md diff --git a/pages/background-2.html b/docs/pages/background-2.html similarity index 100% rename from pages/background-2.html rename to docs/pages/background-2.html diff --git a/pages/deploy-background.html b/docs/pages/deploy-background.html similarity index 100% rename from pages/deploy-background.html rename to docs/pages/deploy-background.html diff --git a/pages/deploy-foreground.html b/docs/pages/deploy-foreground.html similarity index 100% rename from pages/deploy-foreground.html rename to docs/pages/deploy-foreground.html diff --git a/pages/foreground-1.md b/docs/pages/foreground-1.md similarity index 100% rename from pages/foreground-1.md rename to docs/pages/foreground-1.md diff --git a/pages/foreground-2.html b/docs/pages/foreground-2.html similarity index 100% rename from pages/foreground-2.html rename to docs/pages/foreground-2.html diff --git a/pages/guide-architecture.html b/docs/pages/guide-architecture.html similarity index 100% rename from pages/guide-architecture.html rename to docs/pages/guide-architecture.html diff --git a/pages/guide-manual.html b/docs/pages/guide-manual.html similarity index 100% rename from pages/guide-manual.html rename to docs/pages/guide-manual.html diff --git a/search_index.json b/docs/search_index.json similarity index 100% rename from search_index.json rename to docs/search_index.json diff --git a/styles/website.css b/docs/styles/website.css similarity index 100% rename from styles/website.css rename to docs/styles/website.css diff --git a/index.html b/index.html deleted file mode 100644 index fe2ddd5c38..0000000000 --- a/index.html +++ /dev/null @@ -1,902 +0,0 @@ - - - - - - - Easyscheduler简介 · 调度系统-EasyScheduler - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    -
    - - - - - - - - -
    - -
    - -
    - - - - - - - - -
    -
    - -
    -
    - -
    - -

    简介

    -

    导语

    -
    -
    EasyScheduler是易观研发的大数据分布式工作流调度系统。主要解决数据研发ETL错综复杂的依赖关系,而不能直观监控任务健康状态等问题。EasyScheduler通过可视化拖拽任务节点的方式形成DAG(有向无环图)流程图,在运行过程中可实时监控任务的运行状态,同时支持重试、从指定节点恢复失败、暂停及Kill任务、任务运行历史查看等等操作。
    -
    -

    背景

    -

    工作流调度系统在大数据平台中是一个核心的基础设施,是大数据开发必不可少的重要组成部分。由于数据处理流程常常具有很长的依赖链条,因此依赖单机的crontab等单纯依赖时间调度的方式,往往存在很大的弊端,如依赖不清晰,出错难以查找等问题。因此,我们调研了市面上流行的调度系统。 -并和azkaban、airflow做了一些对比:

    -
    -

    -
    -

    JPG

    -
    -

           鉴于易观日处理数据30TB,复杂的ETL依赖关系,我们开发了EasyScheduler。

    -
    -

    EasyScheduler由在工作流调度方面工作多年的几位小伙伴研发而成,致力于成为大数据平台的中流砥柱,使调度变得更加容易,更可以从其中文名“易调度”看出我们的初衷,如果你对目前市面上的调度不够满意,非常欢迎试用易调度,欢迎大家加入进来,提出需求,也欢迎贡献代码, 感兴趣的伙伴们可以加我们微信:510570367,一起加入EasyScheduler吧,多多交流!

    -

    系统部分截图:

    -

    工作流实例

    -

    工作流DAG设计

    -

    工作流DAG任务节点设计

    -

    工作流运行情况

    - - -
    - -
    -
    -
    - -

    results matching ""

    -
      - -
      -
      - -

      No results matching ""

      - -
      -
      -
      - -
      -
      - -
      - - - - - - -
      - - -
      - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -