Skip to content

Translog architecture guide Distributed team #126416

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
Apr 25, 2025
Merged
Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
7b47e98
Translog architecture guide Distributed team
kingherc Apr 7, 2025
3ef5edc
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 8, 2025
ac038f2
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 14, 2025
37fd83d
Added links
kingherc Apr 14, 2025
231e939
PR comments
kingherc Apr 14, 2025
c8722f7
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 14, 2025
7e44680
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 15, 2025
d176ba6
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 17, 2025
805a3f6
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 19, 2025
6f0c73b
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 21, 2025
c04966d
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 22, 2025
03e6a7e
Typo
kingherc Apr 22, 2025
ce767ad
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 23, 2025
09ceff8
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 25, 2025
9b5994d
PR comments
kingherc Apr 25, 2025
f4a3aa8
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 25, 2025
9c81a71
Merge remote-tracking branch 'origin/main' into non-issue/ES-7879-tra…
kingherc Apr 25, 2025
742d7a7
PR comments
kingherc Apr 25, 2025
c623c8d
PR comments
kingherc Apr 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Typo
  • Loading branch information
kingherc committed Apr 22, 2025
commit 03e6a7e86cfff0147d1dd45636af40334781c4ff
2 changes: 1 addition & 1 deletion docs/internal/DistributedArchitectureGuide.md
Original file line number Diff line number Diff line change
Expand Up @@ -172,7 +172,7 @@ Flushes may also be automatically initiated by Elasticsearch, e.g., if the trans

A bulk request will repeateadly call ultimately the Engine methods such as [`index()` or `delete()`](https://github.com/elastic/elasticsearch/blob/591fa87e43a509d3eadfdbbb296cdf08453ea91a/server/src/main/java/org/elasticsearch/index/engine/Engine.java#L546-L564) which adds operations to the Translog.
Finally, the AfterWrite action of the [`TransportWriteAction`](https://github.com/elastic/elasticsearch/blob/main/server/src/main/java/org/elasticsearch/action/support/replication/TransportWriteAction.java) will call [`indexShard.syncAfterWrite()`](https://github.com/elastic/elasticsearch/blob/387eef070c25ed57e4139158e7e7e0ed097c8c98/server/src/main/java/org/elasticsearch/action/support/replication/TransportWriteAction.java#L548) which will put the last written translog [`Location`](https://github.com/elastic/elasticsearch/blob/693f3bfe30271d77a6b3147e4519b4915cbb395d/server/src/main/java/org/elasticsearch/index/translog/Translog.java#L977) of the bulk request into a [`AsyncIOProcessor`](https://github.com/elastic/elasticsearch/blob/main/server/src/main/java/org/elasticsearch/common/util/concurrent/AsyncIOProcessor.java) that is responsible for gradually fsync'ing the Translog and notifying any waiters.
Ultimately the bulk request is notified that the translog has fsync'ed passed the requested location, and can continue to acknowledge the bulk request.
Ultimately the bulk request is notified that the translog has fsync'ed past the requested location, and can continue to acknowledge the bulk request.

#### Translog internals

Expand Down
Loading