python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - eda

Condition Based Custom Flag

I've a dataset id ref name conditionCol 1 123 a no_error 1 456 b error 1 789 c no_error 2 231 d no_error 2 312 e no_error 2 546 f no_error 3 645 g error 3 879 h error 4 789 i ...
test-img

fast_crawler

python-3.x

pandas

data-wrangling

eda

Votes: 0

Answers: 1

Latest Answer

Use numpy.where with test if at least one value error per groups by id: m = df['id'].isin(df.loc[df['conditionCol'].eq('error'), 'id']) #alternative #m = df['conditionCol'].eq('error').groupby(df['id'...
test-img

jezrael

Counting all words in a column of a dataset pandas

I am carrying out EDA on a dataset and want to count the total number of words in a column, before and after deleting duplicates. Here is my code: print(train_dataset['text'].apply(lambda x: len(x.spl...
test-img

Adekunle Agboke

python

pandas

dataset

columnsorting

eda

Votes: 0

Answers: 1

Latest Answer

You could try to convert column values to string type before split: train_dataset['text'] = train_dataset['text'].astype(str) train_dataset['text'].apply(lambda x: len(x.split())).sum() # or train_dat...
test-img

gremur

pandas profiling with dask-dataframe. IndexError

I get an IndexError (IndexError: only integers, slices (:), ellipsis, nmpy.newaxis and integer or bolean arays are valid indices) while pandas profiling with dask. data: 290170 x 55 import dask.datafr...
test-img

vijay v pillai

python

index-error

dask-dataframe

pandas-profiling

eda

Votes: 0

Answers: 1

Latest Answer

Quick fix: following Issue #991, you can change line #13 in utils_pandas.py, just like ieaves suggested. From: w_median = (data[weights == np.max(weights)])[0] To: w_median = (data[np.where(weights ==...
test-img

Tinchosawa

Working on Data exploratory and I am now in the Cleaning data level

I am wondering when I have a date in my dataset and there are NULL values in date columns what is the best way to impute the date Null values in a datetime dtype?! As for the floats values I have alre...
test-img

user18257965

python

list

dataframe

dataset

eda

Votes: 0

Answers: 1

Latest Answer

Welcome Rasha to stackoverflow, Well to your question - Missing values are imputed for continous data, classified data based on business justification or by data interpretation and for a date kind of ...
test-img

Abhi

Posts

Questions

Blogs

Jobs