The default collect method in Polars processes your data as a single batch, which means that all the data must fit into your available memory.
If your data requires more memory than you have available, use the streaming mode to process it in batches. To use streaming mode, simply pass the streaming=True
argument to the collect
method.