Release v0.18.1: Granular control of validation on pandas dfs.

[cosmicBboy]

✨ Highlights ✨

Granular control of pandas validation #1490

There is now support for granular control of schema-level or data-level validations. This can be done via the PANDERA_VALIDATION_DEPTH environment variable. Schema-level (or metadata) validation includes things like column name checks and column data types, while data-level validation involves checks that operate on actual data values.

export PANDERA_VALIDATION_DEPTH= SCHEMA_AND_DATA  # check schema- and data-level checks (default)
export PANDERA_VALIDATION_DEPTH=SCHEMA_ONLY  # only do schema-level checks
export PANDERA_VALIDATION_DEPTH=DATA_ONLY  # only do data-level checks

Efficient Hypothesis strategies #1503

Pandas data synthesis strategies now uses comparison operator functions for more efficient data synthesis. It also updates the minimum hypothesis version to 6.92.7.

What's Changed

• Fix copy-pasted docstring in PySpark accessor test by @deepyaman in Fix copy-pasted docstring in PySpark accessor test #1448
• Mypy precommit by @cosmicBboy in Mypy precommit #1468
• @check_types now properly passes in *args **kwargs and checks their types by @ecthompson99 in @check_types now properly passes in *args **kwargs and checks their types #1336
• Bump starlette from 0.27.0 to 0.36.2 in /dev by @dependabot in Bump starlette from 0.27.0 to 0.36.2 in /dev #1484
• Bump fastapi from 0.103.0 to 0.109.1 by @dependabot in Bump fastapi from 0.103.0 to 0.109.1 #1482
• Bump actions/cache from 3 to 4 by @dependabot in Bump actions/cache from 3 to 4 #1478
• Bump codecov/codecov-action from 3 to 4 by @dependabot in Bump codecov/codecov-action from 3 to 4 #1477
• Bump jinja2 from 3.1.2 to 3.1.3 by @dependabot in Bump jinja2 from 3.1.2 to 3.1.3 #1459
• fix: pin multimethod dep version (pandera 0.18.0 does not work with multimethod 1.11.0 (but with 1.10.0) #1485) by @schatimo in fix: pin multimethod dep version (#1485) #1486
• Fix issue where str dtype in a multiindex dataframe schema results in invalid example by @gsugar87 in Fix issue where str dtype in a multiindex dataframe schema results in invalid example #1050
• Bump python-multipart from 0.0.6 to 0.0.7 by @dependabot in Bump python-multipart from 0.0.6 to 0.0.7 #1496
• Bump python-multipart from 0.0.6 to 0.0.7 in /dev by @dependabot in Bump python-multipart from 0.0.6 to 0.0.7 in /dev #1495
• Bump python-multipart from 0.0.6 to 0.0.7 in /ci by @dependabot in Bump python-multipart from 0.0.6 to 0.0.7 in /ci #1494
• Bump jinja2 from 3.1.2 to 3.1.3 in /ci by @dependabot in Bump jinja2 from 3.1.2 to 3.1.3 in /ci #1457
• Bump starlette from 0.27.0 to 0.36.2 in /dev by @dependabot in Bump starlette from 0.27.0 to 0.36.2 in /dev #1489
• Bugfix/1463 Pandas 2.2.0 FutureWarning resolution by using assignment instead of … by @derinwalters in Bugfix/1463 Pandas 2.2.0 FutureWarning resolution by using assignment instead of … #1464
• Bump jinja2 from 3.1.2 to 3.1.3 in /dev by @dependabot in Bump jinja2 from 3.1.2 to 3.1.3 in /dev #1458
• add pandas 2.2.0 to tests, use uv for pip compile by @cosmicBboy in add pandas 2.2.0 to tests, use uv for pip compile #1502
• Efficient Hypothesis strategies by @Zac-HD in Efficient Hypothesis strategies #1503
• remove headers in requirements files by @cosmicBboy in remove headers in requirements files #1512
• Granular validations on pandas dfs by @kykyi in Granular validations on pandas dfs #1490

New Contributors

• @deepyaman made their first contribution in Fix copy-pasted docstring in PySpark accessor test #1448
• @ecthompson99 made their first contribution in @check_types now properly passes in *args **kwargs and checks their types #1336
• @schatimo made their first contribution in fix: pin multimethod dep version (#1485) #1486
• @gsugar87 made their first contribution in Fix issue where str dtype in a multiindex dataframe schema results in invalid example #1050
• @Zac-HD made their first contribution in Efficient Hypothesis strategies #1503

Full Changelog: v0.18.0...v0.18.1

---

This discussion was created from the release Release v0.18.1: Granular control of validation on pandas dfs..