New Check: Distinct Ratio

[flitzpiepe93]

New Check: Distinct Ratio

Description

Create a check to validate that a minimum percentage of values in a column are distinct.

Example Usage

DistinctRatioCheckConfig(
    check_id="passenger-count-uniqueness",
    column="passenger_count",
    min_ratio=0.8
)

Expected Behavior

• Calculates the ratio of distinct (non-null) values relative to the total number of rows
• Fails the check if the actual distinct ratio is below the given threshold
• Should optionally return failed rows or summary only

Benefits

• Detects columns with low cardinality that might indicate issues (e.g. constant values)
• Useful for identifying uninformative or suspiciously uniform features

[flitzpiepe93]

Issue solved with the following MR: #33