Skip to content

YevgenyKopp/YevgenyKopp.FlinkClient

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Flink Client Documentation

This application allows you to upload .jar files on the Apache Flink cluster, observe existing jars on the cluster and run any of them with specified parameters.

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

With this application you can also observe all the jobs previously launched (running and finished) and see if there any exceptions occurred in process.

Apache Flink

Getting Started

See the guide below to install the Apache Flink on your machine:

You can setup your Flink cluster with standalone configuration using external resources:

When it's done, you can start the Flink Client.

Application Guide

Once you start the Flink Client application you will see the following connection dialog:

Connection Dialog

Type Flink cluster URL in the given text box (default is http://localhost:8081) and press Connect button. The application will check if the given URL is accessible and Main Window will open:

Main Window

Main Window

Here you go! Now you can surf through the Main Window interface. To switch between existing Uploaded, Running and Completed jobs use tabs on the left pane:

Main Window Tabs

Upload New Job

When on the "Submit New Job" tab press the "+ Add New" button and choose file in your system (file extension should be .jar or .py):

Upload File

Submit Job

Once the file is uploaded, find it in the list and click on it's row. Properties pane will appear.
Specify parameters, which you wish to run this job with, and click "Submit" button:

Submit Job

To see the job plan, click on the "View Plan" button in the same pane:

View Plan

If something went wrong (e.g. if specified submit parameters are incorrect), Flink Client will show the error dialog with detailed description:

Error Detailed Description

Running/Completed Jobs

Once you've submitted the job, you can observe its status in Running Jobs tab (if the job is still running) or in Completed Jobs tab (if it's completed):

Completed Jobs

During job processing some errors may occur. To see thrown exceptions for particular job, click on the "Exceptions" button:

Job Exceptions

To define the count of Total/Failed/Finished/etc. tasks for job, point on appropriate icons above the Tasks column.

Auto Refreshing

If you wish to set Main Window Auto Refresh mode, you can use the appropriate function on Menu Bar:

Auto Refresh Mode

You can also refresh it immediately by pressing the refresh button on the left.

Enjoy your Flinking!

About

Client Application for Apache Flink

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages