Add support for: EXCLUDE COLUMNS from PostgreSQL sources

[bobbyiliev]

Feature request

Materialize now supports excluding specific columns when ingesting data from PostgreSQL sources. This feature allows you to:

• Skip columns with unsupported data types
• Reduce hydration times by ignoring unnecessary columns

Example

Suppose you have an upstream PostgreSQL table t, with columns a and b. You can exclude column a during ingestion:

CREATE SOURCE mz_source
FROM POSTGRES CONNECTION pg_conn (PUBLICATION 'mz_source', EXCLUDE COLUMNS (t.a))
FOR ALL TABLES;

To validate that column a was excluded:

SELECT * FROM t; -- Will return only one column, b

For more information and additional examples, see our PostgresQL source documentation.