Archive Pipeline

This pipeline contains two steps, the first step zip all working directories, which are older than the configured period to a .tar.gz. The second step deletes all working directories, which are older than the configured period.

Components & Concept

Please refer to Process Pipelines for technical insights.

Configuration

The configurations for the periods can be done in Magento’s admin UI Stores > Configuration > Pacemaker > Pipeline Settings

process pipelines archive pipeline
Figure 1. Configuration in Magento Backend

Archive Pipeline

The configuration Pipeline Execute Time > Clean Up contains a cron expression value, which defines when the clean up (archive pipeline) for the working directories should run. By default, this value is set to 3 o’clock every day.

The configuration Archive Cleanup > Compress Pipeline Data Older Than defines the period for the file compression. By default, this value is 3 months.

The configuration Archive Cleanup > Delete Pipeline Data Older Than defines the period for the file compression. By default, this value is 6 months.

Pipeline Cancel

To avoid never-ending pipelines (this depends on the implementation of custom pipelines), there is a cancel routine, which cancels all pipelines older than the configured time in Archive Cleanup > Cancel Pipelines Older Than. This value is 3 weeks by default. This pipeline contains two steps, the first step zip all working directories, which are older than the configured period to a .tar.gz. The second step deletes all working directories, which are older than the configured period.

Components & Concept

Please refer to Process Pipelines for technical insights.

Configuration

The configurations for the periods can be done in Magento’s admin UI Stores > Configuration > Pacemaker > Pipeline Settings

process pipelines archive pipeline
Figure 2. Configuration in Magento Backend

Archive Pipeline

The configuration Pipeline Execute Time > Clean Up contains a cron expression value, which defines when the clean up (archive pipeline) for the working directories should run. By default, this value is set to 3 o’clock every day.

The configuration Archive Cleanup > Compress Pipeline Data Older Than defines the period for the file compression. By default, this value is 3 months.

The configuration Archive Cleanup > Delete Pipeline Data Older Than defines the period for the file compression. By default, this value is 6 months.

Pipeline Cancel

To avoid never-ending pipelines (this depends on the implementation of custom pipelines), there is a cancel routine, which cancels all pipelines older than the configured time in Archive Cleanup > Cancel Pipelines Older Than. This value is 3 weeks by default.