This discussion is archived
1 Reply Latest reply: Mar 9, 2012 8:36 AM by Mark Kelly RSS

10 fold cross validation

Brendan Oracle ACE Director
Currently Being Moderated
Hi
Is it possible to perform 10 fold cross validtion in ODMr or in PL/SQL ? If so, how ?

Thanks
Brendan
  • 1. Re: 10 fold cross validation
    Mark Kelly Oracle ACE
    Currently Being Moderated
    Hi Brendan,
    If you have enough data to afford doing a split (test/train), which is the approach built in to the Model Build Nodes, then cross validation is not particularly necessary.
    The ODM models also are designed to avoid over fitting on the train data as well.
    But if you have insufficient data to afford a split, then you could look at doing different cross validation techniques.
    ODMr does not provide any direct support for this. Although I could see how you could have various views constructed that could be used as input to different Model Builds (that allow for separate test and build data).
    You could then pass the whole lot into a single Test node as well and compare against a held aside.
    For an example on how to do it from the api, you can go to the ODM sample code and look at the dmdtxvlddemo.sql example, as it implements one form of CV.
    You can use this as a basis to do others.
    The final models built can also be brought back into ODMr via the Model node and viewed, and also Tested and Applied.
    http://www.oracle.com/technetwork/database/options/advanced-analytics/odm/odm-samples-194497.html
    Thanks,Mark

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points