pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR

From: Noah Misch <noah(at)leadboat(dot)com>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR
Date: 2021-10-24 01:40:12
Message-ID: [email protected]
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURRENTLY.

CIC and REINDEX CONCURRENTLY assume backends see their catalog changes
no later than each backend's next transaction start. That failed to
hold when a backend absorbed a relevant invalidation in the middle of
running RelationBuildDesc() on the CIC index. Queries that use the
resulting index can silently fail to find rows. Fix this for future
index builds by making RelationBuildDesc() loop until it finishes
without accepting a relevant invalidation. It may be necessary to
reindex to recover from past occurrences; REINDEX CONCURRENTLY suffices.
Back-patch to 9.6 (all supported versions).

Noah Misch and Andrey Borodin, reviewed (in earlier versions) by Andres
Freund.

Discussion: https://postgr.es/m/[email protected]

Branch
------
REL_14_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/dde966efb286ddc222f17013a8cf4561a3b67a5e

Modified Files
--------------
contrib/amcheck/t/002_cic.pl | 78 ++++++++++++++++
src/backend/utils/cache/inval.c | 12 ++-
src/backend/utils/cache/relcache.c | 115 +++++++++++++++++++++--
src/bin/pgbench/t/001_pgbench_with_server.pl | 118 +++++++----------------
src/include/utils/inval.h | 1 +
src/include/utils/relcache.h | 2 +-
src/test/perl/PostgresNode.pm | 134 +++++++++++++++++++++++++++
src/tools/pgindent/typedefs.list | 1 +
8 files changed, 368 insertions(+), 93 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Noah Misch 2021-10-24 02:37:26 pgsql: Back-patch "Stop requiring an explicit return from perl subrouti
Previous Message Etsuro Fujita 2021-10-23 08:13:00 Re: pgsql: postgres_fdw: Move comments about elog level in (sub)abort clean