|
| 1 | += CircleCI Server AWS S3 Storage Lifecycle Guide |
| 2 | +:page-layout: classic-docs |
| 3 | +:page-liquid: |
| 4 | +:source-highlighter: rouge |
| 5 | +:rouge-linenums-mode: inline |
| 6 | +:icons: font |
| 7 | +:toc: macro |
| 8 | +:toc-title: |
| 9 | +:sectanchors: |
| 10 | + |
| 11 | + |
| 12 | +[.serveronly]_This document is intended for system administrators of self-hosted installations of CircleCI Server._ |
| 13 | + |
| 14 | +This guide is intended to help system administrators of CircleCI Server installations on AWS better understand how S3 storage is used. This can help to cut compute resource costs and avoid issues for service users when removing resources. |
| 15 | + |
| 16 | +In CircleCI Server, S3 Lifecycle policies are not configured automatically. The figures provided in this guide are examples to help you create a lifecycle policy for your installation. For more information on the steps required to add policy rules, see the https://docs.aws.amazon.com/AmazonS3/latest/user-guide/create-lifecycle.html[AWS Lifecycle Policy Guide]. |
| 17 | + |
| 18 | +== Example Lifecycle Policy Configuration for S3 Buckets |
| 19 | + |
| 20 | +NOTE: Scroll table to the right to view all content. |
| 21 | + |
| 22 | +[.table.table-striped] |
| 23 | +[cols=5*, options="header", stripes=even] |
| 24 | +|=== |
| 25 | +| **Prefix** |
| 26 | +| **Tag** |
| 27 | +| **Suggested Number of Days** |
| 28 | +| **Description of files** |
| 29 | +| **Side effects of deletion** |
| 30 | + |
| 31 | +| `artifacts` |
| 32 | +| (null) |
| 33 | +| 30 |
| 34 | +| General artifacts (deliverables from `store_artifacts` and `store_test_results`) |
| 35 | +| Artifacts will disappear from the list of artifacts in job results. URLs will return 404. |
| 36 | + |
| 37 | +| `artifacts` |
| 38 | +| `"circleci.object_type" === "project.cache"` |
| 39 | +| 15 |
| 40 | +| Dependency caches |
| 41 | +| The first build after deletion will be slow due to cache miss. |
| 42 | + |
| 43 | +| `artifacts` |
| 44 | +| `"circleci.object_type" === "workflow.workspace"` |
| 45 | +| 15 |
| 46 | +| Workspaces |
| 47 | +| If a job depending on workspaces is rerun (e.g. SSH rerun), `attach_workspace` will restore no files, and subsequent steps will fail. |
| 48 | + |
| 49 | +| `artifacts/picard-task-configs` |
| 50 | +| (null) |
| 51 | +| 1 |
| 52 | +| Task config |
| 53 | +| None |
| 54 | + |
| 55 | +| `action-logs` |
| 56 | +| (null) |
| 57 | +| 365 |
| 58 | +| Outputs from each step |
| 59 | +| Outputs will not be shown any longer. Loading indicator will remain even after opening a pull-down for each step. |
| 60 | + |
| 61 | +| `cache` |
| 62 | +| (null) |
| 63 | +| 15 |
| 64 | +| Legacy cache |
| 65 | +| This folder is not actively used. If a job depends on these files, the first build after deletion will be slow due to cache miss. |
| 66 | +|=== |
| 67 | + |
| 68 | +[discrete] |
| 69 | +== Additional Locations Not Listed Above |
| 70 | + |
| 71 | +[discrete] |
| 72 | +=== `audit-logs` |
| 73 | + |
| 74 | +This is where audit logs are saved. Deleting this folder and files under this fodler has no impact on future operation of CircleCI, but deleted logs will be definitely lost and cannot be recovered. |
| 75 | + |
| 76 | +[discrete] |
| 77 | +=== `code-signing-keys` |
| 78 | + |
| 79 | +This is where signing keys for macOS/iOS apps are stored. This folder is no longer used actively. |
| 80 | + |
| 81 | +[discrete] |
| 82 | +=== `test-results` |
| 83 | + |
| 84 | +This is where statistic data collected with `store_test_results` resides. The data is used for future test splitting with `circleci tests split --split-by=timings`. **Deleting test results will cause CIRCLE BUG errors in future jobs using `parallelism`**. |
0 commit comments