Skip to content

Commit a444e5d

Browse files
Merge pull request #27 from gaetan-craft/patch-1
storage: Add gcs documentation
2 parents 631af3a + 339a1d0 commit a444e5d

File tree

1 file changed

+24
-10
lines changed

1 file changed

+24
-10
lines changed

docs/storage.md

+24-10
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ Tips:
1616

1717
1. Default OpenObserve runs as `Local mode`, you can set `LOCAL_MODE=false` to enable `Cluster mode`.
1818
1. In `Local mode` it also can use `s3` as storage, you can set `ZO_LOCAL_MODE_STORAGE=s3` to storage data in s3.
19-
1. For GCS, OSS they all support `s3` SDK, so you can think of them as s3 for all practical purposes. Azure blob is also supported.
19+
1. For GCS, OSS they all support `s3` SDK, so you can think of them as s3 for all practical purposes. GCS is also supported if s3 is not suitable for you. Azure blob is also supported.
2020

2121
## Data
2222

@@ -74,19 +74,33 @@ OpenObserve can use Openstack swift for storing stream data, following environme
7474
### Google GCS
7575

7676
OpenObserve can use google cloud storage for storing stream data, following environment variables needs to be setup:
77+
Using S3 api:
78+
79+
| Environment Variable | Value | Description |
80+
| ------------------------ | -------| --------------------------------------------------------------- |
81+
| ZO_S3_SERVER_URL | - | gcs server address. should be: `https://storage.googleapis.com` |
82+
| ZO_S3_REGION_NAME | - | region name, gcs region name, or: `auto` |
83+
| ZO_S3_ACCESS_KEY | - | access key |
84+
| ZO_S3_SECRET_KEY | - | secret key |
85+
| ZO_S3_BUCKET_NAME | - | bucket name |
86+
| ZO_S3_FEATURE_HTTP1_ONLY | true | -- |
87+
| ZO_S3_PROVIDER | s3 | Use s3 compatible API |
7788

78-
| Environment Variable | Value | Description |
79-
| ------------------------ | ----- | --------------------------------------------------------------- |
80-
| ZO_S3_SERVER_URL | - | gcs server address. should be: `https://storage.googleapis.com` |
81-
| ZO_S3_REGION_NAME | - | region name, gcs region name, or: `auto` |
82-
| ZO_S3_ACCESS_KEY | - | access key |
83-
| ZO_S3_SECRET_KEY | - | secret key |
84-
| ZO_S3_BUCKET_NAME | - | bucket name |
85-
| ZO_S3_FEATURE_HTTP1_ONLY | true | -- |
86-
| ZO_S3_PROVIDER | s3 | Use s3 compatible API for gcp |
8789

8890
You can refer to: [https://cloud.google.com/storage/docs/aws-simple-migration](https://cloud.google.com/storage/docs/aws-simple-migration)
8991

92+
Or you can use gcs directly:
93+
94+
| Environment Variable | Value | Description |
95+
| ------------------------ | -------| ----------------------------------------------------------------------- |
96+
| ZO_S3_SERVER_URL | - | gcs server address. should be: `https://storage.googleapis.com` |
97+
| ZO_S3_REGION_NAME | - | region name, gcs region name, or: `auto` |
98+
| ZO_S3_ACCESS_KEY | - | Path to gcp json private key if not available through instance metadata |
99+
| ZO_S3_BUCKET_NAME | - | bucket name |
100+
| ZO_S3_PROVIDER | gcs | Use gcs api |
101+
102+
Under the hood [object_store crate](https://docs.rs/object_store/0.10.1/object_store/gcp/struct.GoogleCloudStorageBuilder.html) is used through `with_env()` function and if `ZO_S3_ACCESS_KEY` is set also with `with_service_account_path()` function
103+
90104
### Alibaba OSS (aliyun)
91105

92106
OpenObserve can use Alibaba(aliyun) OSS for storing stream data, following environment variables needs to be setup:

0 commit comments

Comments
 (0)