python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - logistic-regression

Python Statsmodel Logistic Regression iterate through Parquet file

I am trying to run a logistic regression model on a very large dataset with 2.3 billion observations in Python. I need a standard regression output. Statsmodels with parquet seemed promising: https://...
test-img

HLRA

python

logistic-regression

parquet

statsmodels

large-data

Votes: 0

Answers: 1

Latest Answer

You can read "subset" of your parquet file by using row groups: import random row_group = random.rand_range(self.parquet.num_row_groups) return self.parquet.read_row_group(row_group).to_pan...
test-img

0x26res

statsmodel logistic regression prediction function with dimension issue

I built my model with training data X_train (21 columns) and y_train as follows: import statsmodels.api as sm statsmodels_result=logit_model.fit() print(statsmodels_result.summary2()) statsmodels_pred...
test-img

Runhua Lei

python

logistic-regression

prediction

Votes: 0

Answers: 1

Latest Answer

You could do the same thing using an lstm network. lstm is very good for timeseries problems lag=4 train, test = data[0:train_size, :], data[train_size:train_size + test_size, :] # reshape into X=t a...
test-img

Golden Lion

Is it possible to run a logistic regression with NA values in R?

The glm function seems to only work if NA values are removed. However, I do not want to remove any data. Is there any way to run a logistic regression with missing values, without changing the data? T...
test-img

Joyce

r

logistic-regression

Votes: 0

Answers: 1

Latest Answer

There are a few ways to deal with NA values if you do not want do delete the whole row. It kind of depends on why there is an NA value, for example in a survey the NA could be a non answer which could...
test-img

Wawv

Regression through different data frames

I have several dataframes (with different names) like those below, with the same number of rows and columns but different names for the last column. df1: ID matching_variable STATUS code_1 1 1 ...
test-img

lM__3

r

dataframe

loops

logistic-regression

Votes: 0

Answers: 2

Latest Answer

Make a custom function that finds last column and uses it in clogit as formula, something like below, not tested: myClogit <- function(d){ lastColName <- tail(colnames(d), 1) f <- as.form...
test-img

zx8754

Posts

Questions

Blogs

Jobs