Only Coders

python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - large-data-volumes

Large SQL Request optimization for Faces Euclidean Distances calculations

I am calculating Euclidean distance between faces and want to store results in a table. Current setup : Each face is stored in Objects table and Distances between faces is stored in Faces_distances t...

FXA

sql

postgresql

euclidean-distance

large-data-volumes

Votes: 0

Answers: 1

Latest Answer

try this simplified query. It took only 5 minutes on my apple M1, SQLServer, with 22231 objects 'face', generated 247.097.565 pairs, which is excatly C(22231,2) number. The syntax is compatible with p...

jjdesign

Large dataset, ProcessPoolExecutor issues

PROBLEM - ProcessPoolExecutor hasn't increased speed. Confirmed by tqdm Learned enough about python to copy and/or write a program that works. each file takes ~40 seconds to load->filter->write....

Yusuf

performance

parallel-processing

low-latency

large-data-volumes

process-pool

Votes: 0

Answers: 1

Latest Answer

Q :" PROBLEM - ProcessPoolExecutor hasn't increased speed. Confirmed by tqdm " A :No,with all respect,your main problem is not the efficiency of ProcessPoolExecutor()-instance, butyour mai...

user3666197

Plotly scatter large volume geographic data

I tried to write a code that creates a visualization of all forest fires that happened during the year 2021. The CSV file containing the data is around 1.5Gb, the program looks correct for me, but whe...

Souad

python

plotly

visualization

scatter

large-data-volumes

Votes: 0

Answers: 1

Latest Answer

have found data you describe here https://wifire-data.sdsc.edu/dataset/viirs-i-band-375-m-active-fire-data/resource/3ce73b20-f584-44f7-996b-2f319c480294 plotly uses resources for every point plotted ...

Rob Raymond

Posts

Questions

Blogs

Jobs