python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Using concurrent.futures with infinite iterator and stopping criteria
I am trying to parallelize a loop which uses an infinite generator as input to collect some data and stops when a certain amount of data has been received.
My implementation is something like this.
cl...
Gerges
Votes: 0
Answers: 1
Large dataset, ProcessPoolExecutor issues
PROBLEM - ProcessPoolExecutor hasn't increased speed. Confirmed by tqdm
Learned enough about python to copy and/or write a program that works. each file takes ~40 seconds to load->filter->write....
Yusuf
Votes: 0
Answers: 1
multiprocessing.Pool map multiple arguments with shared value (Resolved)
I am practicing on using shared values for multiprocessing. I have an existing Process function that is working using shared value:
def run_procs_with_loop(lock):
# this is my shared value
...
punsoca
Votes: 0
Answers: 2
How to manage the exit of a process without blocking its thread in Python?
I'm trying to code a kind of task manager in Python. It's based on a job queue, the main thread is in charge of adding jobs to this queue. I have made this class to handle the jobs queued, able to lim...
gongar
Votes: 0
Answers: 1