pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR

From: Noah Misch <noah(at)leadboat(dot)com>
To: pgsql-committers(at)lists(dot)postgresql(dot)org
Subject: pgsql: Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURR
Date: 2021-10-24 01:40:12
Message-ID: [email protected]
Views: Whole Thread | Raw Message | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Avoid race in RelationBuildDesc() affecting CREATE INDEX CONCURRENTLY.

CIC and REINDEX CONCURRENTLY assume backends see their catalog changes
no later than each backend's next transaction start. That failed to
hold when a backend absorbed a relevant invalidation in the middle of
running RelationBuildDesc() on the CIC index. Queries that use the
resulting index can silently fail to find rows. Fix this for future
index builds by making RelationBuildDesc() loop until it finishes
without accepting a relevant invalidation. It may be necessary to
reindex to recover from past occurrences; REINDEX CONCURRENTLY suffices.
Back-patch to 9.6 (all supported versions).

Noah Misch and Andrey Borodin, reviewed (in earlier versions) by Andres
Freund.

Discussion: https://postgr.es/m/[email protected]

Branch
------
REL_10_STABLE

Details
-------
https://git.postgresql.org/pg/commitdiff/db86746fd11e6d453e53b1550a46d325e3574aa7

Modified Files
--------------
src/backend/utils/cache/inval.c | 12 ++-
src/backend/utils/cache/relcache.c | 107 ++++++++++++++++++++++++-
src/bin/pgbench/t/022_cic.pl | 93 ++++++++++++++++++++++
src/include/utils/inval.h | 1 +
src/include/utils/relcache.h | 2 +-
src/test/perl/PostgresNode.pm | 155 +++++++++++++++++++++++++++++++++++++
src/test/perl/TestLib.pm | 43 ++++++++++
src/tools/pgindent/typedefs.list | 1 +
8 files changed, 409 insertions(+), 5 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message Noah Misch 2021-10-24 02:37:26 pgsql: Back-patch "Stop requiring an explicit return from perl subrouti
Previous Message Etsuro Fujita 2021-10-23 08:13:00 Re: pgsql: postgres_fdw: Move comments about elog level in (sub)abort clean