Skip to content
This repository was archived by the owner on Apr 10, 2024. It is now read-only.

Commit eff0831

Browse files
committed
Update documentation
1 parent 88e0664 commit eff0831

File tree

3 files changed

+19
-7
lines changed

3 files changed

+19
-7
lines changed

README.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -187,10 +187,16 @@ The generated file `moresql.json` will be in place ready for use.
187187

188188
These features are part of mosql but not implemented in MoreSQL. PRs welcome.
189189

190-
* Dot Notation for nested structures
191190
* extra_props field for spare data
192-
* Automatic creation of tables/columns
191+
* Automatic creation of tables/columns (we require explicit actions from users after providing guidance)
193192

193+
## Dot notation
194+
195+
We support dot notation for extracting nested objects from Mongo.
196+
197+
`user.address` will perform a `(get_in map [:user :address])` type nested fetch.
198+
199+
See gjson project for full syntax details: https://github.com/tidwall/gjson#path-syntax
194200
## Performance
195201

196202
During benchmarking when moresql is asked to replay existing events from oplog we've seen the following performance with the following configurations:

docs/README.template.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -129,10 +129,16 @@ The generated file `moresql.json` will be in place ready for use.
129129

130130
These features are part of mosql but not implemented in MoreSQL. PRs welcome.
131131

132-
* Dot Notation for nested structures
133132
* extra_props field for spare data
134-
* Automatic creation of tables/columns
133+
* Automatic creation of tables/columns (we require explicit actions from users after providing guidance)
135134

135+
## Dot notation
136+
137+
We support dot notation for extracting nested objects from Mongo.
138+
139+
`user.address` will perform a `(get_in map [:user :address])` type nested fetch.
140+
141+
See gjson project for full syntax details: https://github.com/tidwall/gjson#path-syntax
136142
## Performance
137143

138144
During benchmarking when moresql is asked to replay existing events from oplog we've seen the following performance with the following configurations:

docs/TODO.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -20,16 +20,15 @@ TO DEPLOY and RELEASE
2020

2121
DESIRED
2222
==
23-
* [ ] Use dot notation for config description of nested maps, ie allow for `get_in("outerkey", "innerkey")` as `outerkey.innerkey` by using https://github.com/tidwall/gjson
24-
* [ ] Improve library testing (unit and integration/system). Potentially using docker for full trip integration tests.
23+
* [x] Use dot notation for config description of nested maps, ie allow for `get_in("outerkey", "innerkey")` as `outerkey.innerkey` by using https://github.com/tidwall/gjson
2524
* [x] Refactor tail to have a producer/consumer as Read/Write
2625
* [x] Setup https://github.com/thejerf/suture wrappers on components
2726
* [x] Add testing and refactor to make each bit fairly decoupled
2827
* [x] Include docs and scripts to transition from mosql to moresql
2928
* [x] Setup formal worker pool along with overflow pool of workers
3029
* [x] add tracking mechanism for missing/broken tables beyond "log it into abyss".
3130
* [x] add error handling with rollbar/bugsnag/etc
32-
* [ ] Add persistance for oplog if desired by user via commandline flag
31+
* [ ] Improve library testing (unit and integration/system). Potentially using docker for full trip integration tests.
3332

3433

3534
SOMEDAYs
@@ -45,3 +44,4 @@ SOMEDAYs
4544
* [ ] Writers should fit the interface of accepting a pointer to tables struct and the channel of incoming operations
4645
* [ ] All of https://github.com/zph/moresql/blob/master/full_sync.go#L129-L136 should be inside the writer function as it will differ by output sink.
4746
* [ ] Support nested fetching ala `user.name` to extract 2 levels deep
47+
* [ ] Add persistance for oplog if desired by user via commandline flag

0 commit comments

Comments
 (0)