You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: wiki/QFS-on-S3.md
+22-23Lines changed: 22 additions & 23 deletions
Original file line number
Diff line number
Diff line change
@@ -54,14 +54,13 @@ The changes for each is presented below.
54
54
instead of pointing to an existing directory in chunkserver, it points to an hypothetical
55
55
directory in which chunkservers can place S3 files. For example, the corresponding line
56
56
for this parameter can read:
57
-
```
58
-
chunkServer.objectDir = s3://myfirstbucket.
59
-
```
60
-
In example, the part after "s3://" in the specified object directory, i.e. "myfirstbucket."
57
+
```
58
+
chunkServer.objectDir = s3://myfirstbucket.
59
+
```
60
+
In the example, the part after "s3://" in the specified object directory, i.e. "myfirstbucket."
61
61
(including the . sign at the end), is treated as the configuration suffix. Metaserver
62
62
associates the configuration suffix with an S3 bucket name and AWS credentials to access
63
63
the given bucket. Corresponding metaserver configuration changes are described in the next section.
64
-
65
64
This is the only required parameter that needs to be set up in chunkserver configuration file for S3 support. For the optional S3 parameters in chunkserver configuration file, please visit [here](https://github.com/quantcast/qfs/blob/master/conf/ChunkServer.prp#L290).
66
65
67
66
\***One can specify multiple object directories with chunkServer.objectDir parameter.
@@ -71,21 +70,21 @@ Please refer to [Specifying Multiple Object Store Directories](#MultipleObjectSt
71
70
1.*Add and set [metaServer.objectStoreEnabled](https://github.com/quantcast/qfs/blob/master/conf/MetaServer.prp#L1200) parameter.*
72
71
73
72
This parameter enables object store in metaserver. For example:
74
-
```
75
-
metaServer.objectStoreEnabled = 1
76
-
```
73
+
```
74
+
metaServer.objectStoreEnabled = 1
75
+
```
77
76
2.*For each configuration suffix specified in the chunkserver configuration file, specify
78
77
the [chunkServer.diskQueue.<object-store-directory-prefix>bucketName](https://github.com/quantcast/qfs/blob/master/conf/MetaServer.prp#L1245),
and [chunkServer.diskQueue.<object-store-directory-prefix>secretAccessKey](https://github.com/quantcast/qfs/blob/master/conf/MetaServer.prp#L1251)
81
80
parameters.*
82
81
83
82
For example, using the same object directory specified in chunkserver configuration example, one can have:
For the other optional S3 parameters in the metaserver configuration file, please visit [here](https://github.com/quantcast/qfs/blob/master/conf/MetaServer.prp#L1196).
0 commit comments