Archive pipelines

This pipeline contains two steps:

  • The first step is to compress all working directories which are older than the configured period to a .tar.gz.

  • The second step will delete all active directories, which are older than the configured period.

Components & Concept

Please refer to Process Pipelines for technical insights.

Configuration

The configurations for the periods can be done in Magento’s admin UI Stores  Configuration  Pacemaker  Pipeline Settings

ee process pipelines archive pipeline
Figure 1. Configuration in Magento Backend

Archive pipeline

The configuration Pipeline Execute Time  Clean Up contains a cron expression value, which defines when the clean up (archive pipeline) for the working directories should run.

3:00 am daily

The configuration Archive Cleanup  Compress Pipeline Data Older Than defines the file compression period.

3 months

The configuration Archive Cleanup  Delete Pipeline Data Older Than defines the file compression period.

6 months

Pipeline cancel

Depending on the implementation of custom pipelines to avoid endless running pipelines, there is a cancel routine, eliminating all pipelines older than the configured time in Archive Cleanup  Cancel Pipelines Older Than.

3 weeks