maint: catalog implementation roundtripping tests

[jayceslesar]

In pursuit of #813

[jayceslesar]

@kevinjqliu @Fokko thoughts here? I think would be pretty light work to set up a common test suite for all catalogs

Some immediate open questions:

1. Hive and Rest are like a pure mock, but I think they can be worked in (open to ideas)
2. What's up with this? https://github.com/apache/iceberg-python/blob/main/pyiceberg/catalog/sql.py#L100 NAMESPACE_MINIMAL_PROPERTIES Are those used anywhere?

[Fokko]

Good call @jayceslesar 🙌

Hive and Rest are like a pure mock, but I think they can be worked in (open to ideas)

I'm not sure if I understand the question correctly, but let me give it a try. I'd prefer to avoid mock and rely on the integration tests that we have with the rest and hive image. The rest container is updated daily from the Java repository, and will let us know if something incompatible changes.

[jayceslesar]

I'm not sure if I understand the question correctly, but let me give it a try. I'd prefer to avoid mock and rely on the integration tests that we have with the rest and hive image. The rest container is updated daily from the Java repository, and will let us know if something incompatible changes.

Amazing -- I will take a stab at consolidating the testing of all main catalog behavior in an integration test

[jayceslesar]

Ok check out the latest commit. All integration tests. Looks like unable to run locally because im missing AWS_TEST_BUCKET... Possible to use minio for that?

Edit: Also the aws creds but I trust that this is all configured in CI and I just can't see it which is fine, so if we are happy with the little setup I have I can expand it to cover all common behavior

[jayceslesar]

@kevinjqliu can you please trigger tests again? Just want to see everything hopefully work