python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - memory

Polars DataFrame memory size in Python

Was wondering about the size of particular polars DataFrames. I tried with: from sys import getsizeof getsizeof(df) Out[17]: 48 getsizeof(df.to_pandas()) Out[18]: 1602923950 It appears all polars df...
test-img

fvg

python

memory

python-polars

Votes: 0

Answers: 2

Latest Answer

Using the polars.DataFrame.estimated_size() method we can get the size of the dataframe similar to pandas.info(). Follow the link.
test-img

RKCH

Memory Error Exception using PIL to Process Video Stream on Raspberry Pi

I have written a Python script that runs on a Raspberry Pi and utilizes the PiCamera library to capture video, the Python Image Library (PIL) to extract individual frames, and then does some image pro...
test-img

Brayton Larson

python

multithreading

memory

raspberry-pi

picamera

Votes: 0

Answers: 0

How to efficiently create a CSR row_index vector in python?

I am trying to create a CSR matrix with m rows, n columns, filled with zeroes and ones (at most one per column). I have a numpy array idcs with indices where my 1s are located, ranging from x to n. My...
test-img

hawkspar

python

numpy

memory

sparse-matrix

Votes: 0

Answers: 1

Latest Answer

I think you're looking for something like this? ROW_INDEX=np.zeros(m+1) np.add.at(ROW_INDEX, idcs+1, 1) np.cumsum(ROW_INDEX, out=ROW_INDEX)
test-img

user7138814

Python generator pipeline using all available memory

I'm working on a cli application that searches through a disc image for byte strings that could be jpgs. The core of the application is a pipeline of generators that opens the disc image file, reads b...
test-img

Xochozomatli

python

regex

memory

generator

bytebuffer

Votes: 0

Answers: 0

Posts

Questions

Blogs

Jobs