Components

All calculation tasks have a calculation component that determine calculation method.

Role

Role of calculation component is:

• Store calculation parameters
• Actual calculation

Features

• Validating parameter
• Validating data (not released yet)
• Manipulating Partitioned data
• Executing calculation

---

Flow

Flow of Calculation component is:

1. Built with parameters
2. Inputting data at start of execution
3. Calculating
4. Outputting data at end of execution

Built-in and user-defined calculation components

DSF has many Calculation components in dsf_opkg repositories, And of course you can define them.

---

Types of components

In DSF, there are two types of calculation component.

Operator

Operator is one of calculation component to do single calculation.

You can do most of things by using this simplest component.

Component Set

Component Set is one of calculation component to do multiple calculation as pipeline at once.

This type of component is very useful when you want to use same logic many time or share logic for someone.

Partitioning

DSF has features to manipulate large amount of data by using data partitioning.

1. you can partition data by partitioning component.

2. For partitioned data, you can most of regular calculation component. It apply calculation for all partitions.

3. You can use partition component when you want to iterate all partitions with states.

4. You can integrate all partitions into single data by using integrating component.