【问题标题】:How to iteratively train forecast models (GAM, MARS, ...) based on selected days and calculate the variable importance in the time period如何根据选定的日期迭代训练预测模型(GAM、MARS、...)并计算时间段内的变量重要性
【发布时间】:2021-05-20 10:48:16
【问题描述】:

我有一个数据表,它总是有不同数量的列和列名,还有一个名为 days 的数字变量(这个变量也不同;现在/这里:50):

library(data.table)
library(caret)

days -> 50  
## Create random data table: ##
dt.train <- data.table(date = seq(as.Date('2020-01-01'), by = '1 day', length.out = 366),
                       "DE" = rnorm(366, 35, 1), "Wind" = rnorm(366, 5000, 2), "Solar" = rnorm(366, 3, 2),
                       "Nuclear" = rnorm(366, 100, 5), "ResLoad" = rnorm(366, 200, 3),  check.names = FALSE)

我正在建模/训练一个线性模型 (= LM),我想在其中预测 DE 列,并计算变量相对于 days 变量的重要性。见以下代码sn -p:

## MODEL FITTING: ##
## Linear Model: ##

## Function that calculates the iteratively prediction: ##
calcPred <- function(data){
  ## Model fitting: ##
  xgbModel <- stats::lm(DE ~ .-1-date, data = data)
  ## Model training: ##
  stats::predict.lm(xgbModel, data)
}

## Function that calculates the iteratively variable importance: ##
varImportance <- function(data){
  ## Model fitting: ##
  xgbModel <- stats::lm(DE ~ .-1-date, data = data)
  
  terms <- attr(xgbModel$terms , "term.labels")
  varimp <- caret::varImp(xgbModel)
  importance <- data[, .(date, imp = t(varimp))]
} 


## Train Data PREDICTION with iteratively xgbModel: ##
dt.train <- dt.train[, c('prediction') := calcPred(.SD), by = seq_len(nrow(dt.train)) %/% days]

## Iteratively variable importance:##
dt.importance <- data.table::copy(dt.train[, c("prediction") := NULL])
dt.importance <- dt.importance[, varImportance(.SD), by = seq_len(nrow(dt.train)) %/% days]

这里发生了什么:我的模型总是训练 50 天,然后准确地在这段时间内预测这些训练完成的 50 天。这一直持续到我的桌子的结束日期。此外,varImportance() 函数给出了预测变量(所有列,不包括 dateDE)在训练间隔(此处为每 50 天)中的变量重要性。

最初我认为我也可以将函数 calcPred()varImportance() 用于广义加法模型 (= GAM) 和多元自适应回归样条 (= MARS) 或梯度提升 (= GB),但不幸的是这个版本仅适用于 LM。

我现在想简要描述一下其他三个模型的模型拟合,但我也需要你的帮助,以便最终计算 GAM、MARS 和 GB 模型以及 LM。

GAM:

## Create data-vector with dates of dt.train: ##
v.trainDate <- dt.train$date
## Delete column "date" of train data for model fitting: ##
dt.train <- dt.train[, c("date") := NULL]

## Preparation for GAM: ##
trainDataNames <- names(dt.train)
responseVar <- trainDataNames[1]
trainDataNames <- trainDataNames[trainDataNames != responseVar]
## Create right-hand side of GAM model in string/character format: ##
formulaRight <- paste('s(', trainDataNames, ')', sep = '', collapse = ' + ')
## Create the whole formula for GAM model in string/character format: ##
formulaGAM <- paste(responseVar, '~', formulaRight, collapse = ' ')
## Coerce to a formula object: ##
formulaGAM <- as.formula(formulaGAM)

## MODEL FITTING: ##
## Generalized Additive Model: ##
xgbModel <- mgcv::gam(formulaGAM, data = dt.train)

## Train and Test Data PREDICTION with xgbModel: ##
dt.train$prediction <- mgcv::predict.gam(xgbModel, dt.train)

## Add date columns to dt.train and dt.test: ##
dt.train <- data.table(date = v.trainDate, dt.train)

火星:

## Create vectors with all DE values of train data set: ##
v.trainY <- dt.train$DE
## Save dates of train data in an extra vector: ##
v.trainDate <- dt.train$date
## Create train matrices for GB model fitting: ##
m.trainData <- as.matrix(dt.train[, c("date", "DE") := list(NULL, NULL)])
## Model fitting with grid-search: ##: ##
hyper_grid <- expand.grid(degree = 1:3, 
                          nprune = seq(2, 100, length.out = 10) %>% floor()
              )
              
## MODEL FITTING: ##
## Multivariate Adaptive Regression Spline: ##
xgbModel <- caret::train(x = m.trainData, 
                         y = v.trainY,
                         method = "earth",
                         metric = "RMSE",
                         trControl = trainControl(method = "cv", number = 10),
                                       tuneGrid = hyper_grid
              )
              
              
## Train Data PREDICTION with xgbModel: ##
dt.train$prediction <- stats::predict(xgbModel, dt.train)

GB:

## Create vectors with all DE values of train data set: ##
v.trainY <- dt.train$DE
## Save dates of train data in an extra vector: ##
v.trainDate <- dt.train$date
## Create train matrices for GB model fitting: ##
m.trainData <- as.matrix(dt.train[, c("date", "DE") := list(NULL, NULL)])

## Gradient Boosting with hyper parameter tuning: ##
xgb_trcontrol <- caret::trainControl(method = "cv",
                                     number = 3,
                                     allowParallel = TRUE,
                                     verboseIter = TRUE,
                                     returnData = FALSE
)

xgbgrid <- base::expand.grid(nrounds = c(15000), # 15000
                             max_depth = c(2),
                             eta = c(0.01),
                             gamma = c(1),
                             colsample_bytree = c(1),
                             min_child_weight = c(2),
                             subsample = c(0.6)
)

## MODEL FITTING: ##
## Gradient Boosting: ##
xgbModel <- caret::train(x = m.trainData, 
                         y = v.trainY,
                         trControl = xgb_trcontrol,
                         tuneGrid = xgbgrid,
                         method = "xgbTree"
)

## Train data PREDICTION with xgbModel: ##
dt.train$prediction <- stats::predict(xgbModel, m.trainData)

## Add DE and date columns to dt.train: ##
dt.train <- data.table(DE = v.trainY, dt.train)
dt.train <- data.table(date = v.trainDate, dt.train)

我如何计算其他三个模型与 LM 相同?希望有人能帮助我。 很抱歉这个问题拖了这么久。

【问题讨论】:

    标签: r time-series iteration prediction forecasting


    【解决方案1】:

    您可以将模型定义为作为参数传递给calcPredvarImportance 的函数。

    例如LM

    model <- function(data) {stats::lm(DE ~ .-1-date, data = data)}
    

    GAM

    model <- function(data) {mgcv::gam(formulaGAM, data = data)}
    

    MARS:

    model <- function(data) {
      hyper_grid <- expand.grid(degree = 1:3, 
                                nprune = seq(2, 100, length.out = 10) %>% floor())
      caret::train(x = subset(data, select = -DE),
                   y = data$DE,
                   method = "earth",
                   metric = "RMSE",
                   trControl = trainControl(method = "cv", number = 10),
                   tuneGrid = hyper_grid)
    }
    

    我更新了代码以考虑这个新参数:

    library(data.table)
    library(caret)
    library(magrittr)
    
    
    days <- 50
    ## Create random data table: ##
    dt.train <- data.table(date = seq(as.Date('2020-01-01'), by = '1 day', length.out = 366),
                           "DE" = rnorm(366, 35, 1), "Wind" = rnorm(366, 5000, 2), "Solar" = rnorm(366, 3, 2),
                           "Nuclear" = rnorm(366, 100, 5), "ResLoad" = rnorm(366, 200, 3),  check.names = FALSE)
    
    dt.importance <- data.table::copy(dt.train)
    
    ## Define model & prediction functions ##
    
    model <- function(data) {stats::lm(DE ~ .-1-date, data = data)}
    
    predict <- function(data,model) {stats::predict(model, data)}
    
    calcPred <- function(data,model){
      if (nrow(data)==days) {
      stats::predict(model,data) } else {
      NULL }
    }
    
    ## Function that calculates the iteratively variable importance: ##
    varImportance <- function(data,model){
      cat(nrow(data),'\n')
      if (nrow(data)==days) {
      terms <- attr(model$terms , "term.labels")
      varimp <- caret::varImp(model)
      importance <- data[, .(date, imp = t(varimp))]} else
      { NULL }
    }
    
    
    ## Train Data PREDICTION with iteratively xgbModel: ##
    dt.train <- dt.train[, c('prediction') := calcPred(.SD,model(.SD)), by = (seq_len(nrow(dt.train))-1) %/% days]
    
    ## Iteratively variable importance:##
    
    dt.importance <- dt.importance[, varImportance(.SD,model(.SD)), by = (seq_len(nrow(dt.train))-1) %/% days]
    

    要使用其他模型,只需在上面的代码中使用您希望的模型函数。 这适用于您提供的数据集上的 LMGAM

    不幸的是,varImp 似乎不适用于带有 MARS 的数据集,尽管这是 seems feasible

    【讨论】:

    • 我已经尝试过这样的事情,但是当使用您的编码和 calcPred() 用于 GAM 和 MARS 时,我收到以下错误消息。 GAM 的错误是:Model has more coefficients than data。 MARS 错误:In nominalTrainWorkflow(x = x, y = y, wts = weights, info = trainInfo, : There were missing values in resampled performance measures. 变量重要性不适用于 GAM 和 MARS。您的代码在运行时是否有效?
    • 你说得对,我做得太快了,varImp 目前不适用于 MARS,尽管它应该:topepo.github.io/caret/variable-importance.html。我尝试解决这个问题并回复你
    • 它也不适用于 GAM,就我而言!当我有超过 12 个预测变量时,varImp() 不适用于 LM,这有点奇怪。抛出的错误是:j doesn't evaluate to the same number of columns for each group data table R。你知道为什么会这样吗?
    • 非常感谢您的帮助!!
    • 上面的代码现在适用于GAM:错误来自最后一个没有足够行的块(16而不是50)
    猜你喜欢
    • 2021-05-24
    • 2019-06-20
    • 2020-09-14
    • 2019-06-29
    • 1970-01-01
    • 2022-10-19
    • 2021-04-02
    • 2022-01-11
    • 2023-01-03
    相关资源
    最近更新 更多