How to setup a Flow

Adding a flow to the portal

In the flows-page click Add flow to add a flow to the Raven Portal. You will be brought to the flow-editor to build your flow.

Start by clicking Edit from the top flow-editor menu and change the Untitled into a meaningful name and click save.

A new flow is created, let's proceed with adding some bricks.

Building a flow

To build a flow you start by adding a source-brick. You can create a source and configure the source-brick in the sources menu.

Add a brick

After setting up a source you connect bricks for analyzing and enriching the data. Add a brick by clicking Add brick and selecting the desired brick from the list.

Configure your brick

The transform, connector, and data science bricks are configured from the configuration menu inside the brick inspector. Select the brick by clicking on it and select Inspect from the top flow-editor menu.

A window will appear showing various tabs. Click the Config tab to configure the selected brick.

To read more about the configuration-options and info for the brick you select the tab Help in the brick inspector.

Connect the bricks

After configuring a brick connect it by clicking on the output from the source and dragging the arrow to the new brick. It is possible to apply multiple arrows to different bricks.

Repeat these steps for adding more bricks.

Activate a data retention policy

When the data requires a retention policy you select the brick and click Inspect, and find the tab Data policy. Here you can select a policy.

Quickly spot if a brick has a policy by looking for a little icon displaying a paper.

To create a Data Retention Policy select Settings from the left-side menu and select Data policies. You will see a overview of all available policies, and in the top is a option to Add data policy.

Once defined, inside the flow simply go to the configuration of the brick, go to the Data policy tab, and choose your defined retention time. Now all data flowing through this brick will get deleted if older than the chosen retention time.

Save your flow

When your flow is complete and all bricks are connected with arrows you click save in the top flow-editor menu.

When the flow is saved you can start all the bricks, and save the flow again. Now the bricks will start and after a while you can see the data flowing through and retrieve more information about every brick running state by clicking the brick once and looking at the right-side panel.