K-Fold Cross Validation

 Cross-validation, sometimes called rotation estimation or out-of-sample testing, is any of various similar model validation techniques for assessing how the results of a statistical analysis will generalize to an independent data set. It is mainly used in settings where the goal is prediction, and one wants to estimate how accurately a predictive model will perform in practice. In a prediction problem, a model is usually given a dataset of known data on which training is run (training dataset), and a dataset of unknown data (or first seen data) against which the model is tested (called the validation dataset or testing set). The goal of cross-validation is to test the model's ability to predict new data that was not used in estimating it, in order to flag problems like overfitting or selection bias and to give an insight on how the model will generalize to an independent dataset (i.e., an unknown dataset, for instance from a real problem).

 File:K-fold cross validation EN.svg

 K-Fold CV is where a given data set is split into a K number of sections/folds where each fold is used as a testing set at some point. Lets take the scenario of 5-Fold cross validation(K=5). Here, the data set is split into 5 folds. In the first iteration, the first fold is used to test the model and the rest are used to train the model. In the second iteration, 2nd fold is used as the testing set while the rest serve as the training set. This process is repeated until each fold of the 5 folds have been used as the testing set.

  Image for post


Comments

Post a Comment

Popular posts from this blog

Real life example for linear regression: drug dosage and blood pressure of patients

Image
Medical researchers often use linear regression to understand the relationship between drug dosage and blood pressure of patients. For example, researchers might administer various dosages of a certain drug to patients and observe how their blood pressure responds. They might fit a simple linear regression model using dosage as the predictor variable and blood pressure as the response variable. The regression model would take the following form: blood pressure = β0 + β1(dosage) The coefficient β0 would represent the expected blood pressure when dosage is zero. The coefficient β1 would represent the average change in  blood pressure when dosage is increased by one unit. If β1 is negative, it would mean that an increase in dosage is associated with a decrease in blood pressure. If β1 is close to zero, it would mean that an increase in dosage is associated with no change in blood pressure. If β1 is positive, it would mean that an increase in dosage is associated with an increase in blood
Read more

Decision Tree algorithm

Image
A decision tree is a supervised machine learning algorithm mainly used for Regression and Classification. It breaks down a data set into smaller and smaller subsets while at the same time an associated decision tree is incrementally developed. The final result is a tree with decision nodes and leaf nodes. A decision tree can handle both categorical and numerical data.  
Read more

Real life example for linear regression: fertiliser, water and crop yields

Image
  Agricultural scientists often use linear regression to measure the effect of fertilizer and water on crop yields. For example, scientists might use different amounts of fertilizer and water on different fields and see how it affects crop yield. They might fit a multiple linear regression model using fertilizer and water as the predictor variables and crop yield as the response variable. The regression model would take the following form: crop yield = β0 + β1(amount of fertilizer) + β2(amount of water) The coefficient β0 would represent the expected crop yield with no fertilizer or water. The coefficient β1 would represent the average change in crop yield when fertilizer is increased by one unit, assuming the amount of water remains unchanged. The coefficient β2 would represent the average change in crop yield when water is increased by one unit, assuming the amount of fertilizer remains unchanged. Depending on the values of β1 and β2, the scientists may change the amount of fertilize
Read more