Day: July 20, 2025

This can be useful to connect to cloud or partitioned datasets. Parameters: source Pyarrow dataset to scan. allow_pyarrow_filter Allow predicates to be pushed down to pyarrow. This can lead to different results if comparisons are done with null values as pyarrow handles this different than polars does. batch_size The maximum row count for scanned pyarrow record batches.