Skip to content

Commit 39ccfd3

Browse files
Merge pull request circleci#4636 from circleci/server/s3-lifecycle-guide
add S3 lifecycle page to docs site and PDF
2 parents dfac3de + e7659dd commit 39ccfd3

File tree

3 files changed

+89
-1
lines changed

3 files changed

+89
-1
lines changed

jekyll/_cci2/_ops-guide.adoc

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -58,4 +58,6 @@ include::customizations.adoc[]
5858

5959
include::architecture.adoc[]
6060

61+
include::storage-lifecycle.adoc[]
62+
6163
:leveloffset: -1

jekyll/_cci2/storage-lifecycle.adoc

Lines changed: 84 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,84 @@
1+
= CircleCI Server AWS S3 Storage Lifecycle Guide
2+
:page-layout: classic-docs
3+
:page-liquid:
4+
:source-highlighter: rouge
5+
:rouge-linenums-mode: inline
6+
:icons: font
7+
:toc: macro
8+
:toc-title:
9+
:sectanchors:
10+
11+
12+
[.serveronly]_This document is intended for system administrators of self-hosted installations of CircleCI Server._
13+
14+
This guide is intended to help system administrators of CircleCI Server installations on AWS better understand how S3 storage is used. This can help to cut compute resource costs and avoid issues for service users when removing resources.
15+
16+
In CircleCI Server, S3 Lifecycle policies are not configured automatically. The figures provided in this guide are examples to help you create a lifecycle policy for your installation. For more information on the steps required to add policy rules, see the https://docs.aws.amazon.com/AmazonS3/latest/user-guide/create-lifecycle.html[AWS Lifecycle Policy Guide].
17+
18+
== Example Lifecycle Policy Configuration for S3 Buckets
19+
20+
NOTE: Scroll table to the right to view all content.
21+
22+
[.table.table-striped]
23+
[cols=5*, options="header", stripes=even]
24+
|===
25+
| **Prefix**
26+
| **Tag**
27+
| **Suggested Number of Days**
28+
| **Description of files**
29+
| **Side effects of deletion**
30+
31+
| `artifacts`
32+
| (null)
33+
| 30
34+
| General artifacts (deliverables from `store_artifacts` and `store_test_results`)
35+
| Artifacts will disappear from the list of artifacts in job results. URLs will return 404.
36+
37+
| `artifacts`
38+
| `"circleci.object_type" === "project.cache"`
39+
| 15
40+
| Dependency caches
41+
| The first build after deletion will be slow due to cache miss.
42+
43+
| `artifacts`
44+
| `"circleci.object_type" === "workflow.workspace"`
45+
| 15
46+
| Workspaces
47+
| If a job depending on workspaces is rerun (e.g. SSH rerun), `attach_workspace` will restore no files, and subsequent steps will fail.
48+
49+
| `artifacts/picard-task-configs`
50+
| (null)
51+
| 1
52+
| Task config
53+
| None
54+
55+
| `action-logs`
56+
| (null)
57+
| 365
58+
| Outputs from each step
59+
| Outputs will not be shown any longer. Loading indicator will remain even after opening a pull-down for each step.
60+
61+
| `cache`
62+
| (null)
63+
| 15
64+
| Legacy cache
65+
| This folder is not actively used. If a job depends on these files, the first build after deletion will be slow due to cache miss.
66+
|===
67+
68+
[discrete]
69+
== Additional Locations Not Listed Above
70+
71+
[discrete]
72+
=== `audit-logs`
73+
74+
This is where audit logs are saved. Deleting this folder and files under this fodler has no impact on future operation of CircleCI, but deleted logs will be definitely lost and cannot be recovered.
75+
76+
[discrete]
77+
=== `code-signing-keys`
78+
79+
This is where signing keys for macOS/iOS apps are stored. This folder is no longer used actively.
80+
81+
[discrete]
82+
=== `test-results`
83+
84+
This is where statistic data collected with `store_test_results` resides. The data is used for future test splitting with `circleci tests split --split-by=timings`. **Deleting test results will cause CIRCLE BUG errors in future jobs using `parallelism`**.

jekyll/_data/sidenav.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -321,7 +321,7 @@ en:
321321
link: 2.0/overview/
322322
- name: Nomad
323323
link: 2.0/nomad/
324-
- name: Monitoring
324+
- name: Metrics & Monitoring
325325
link: 2.0/monitoring/
326326
- name: Nomad Metrics
327327
link: 2.0/nomad-metrics/
@@ -359,6 +359,8 @@ en:
359359
link: 2.0/customizations/
360360
- name: Architecture
361361
link: 2.0/architecture/
362+
- name: Storage Lifecycle
363+
link: 2.0/storage-lifecycle/
362364
- name: Acknowledgments
363365
link: 2.0/open-source/
364366
- name: Server v2.19 PDFs

0 commit comments

Comments
 (0)