5. What you really need to know

The backbone of julearn is the function run_cross_validation(), which allows you to do all the magic. All important information needed to estimate your machine learning workflow’s performance goes into this function, specified via its parameters.

But why is basically everything based on one cross-validation function? Well, because doing proper cross-validation is of utmost importance in machine learning and it is not as easy as it might seem at first glance. If you want to understand why, reading the sub-chapter Cross-validation: evaluating estimator performance is a good starting point.

Once you are familiar with the basics of cross-validation, you can follow along the other sub-chapters to learn how to setup a basic workflow using julearn’s run_cross_validation(). There you can find out more about the required data, building a basic pipeline and how to evaluate your model’s performance.

• 5.1. Why cross validation?
  • Cross-validation - The fundamentals
  • The essence of run_cross_validation()
• 5.2. Data
  • Data input to run_cross_validation()
  • Giving types to features
• 5.3. Model Building
  • Pipeline specification in run_cross_validation()
  • Feature preprocessing
  • Pipeline specification made easy with the PipelineCreator
  • Setting hyperparameters
  • Selective preprocessing using feature types
• 5.4. Model Evaluation
  • The output of run_cross_validation()
  • Cross-validation splitters
  • Scoring metrics
• 5.5. Model Comparison
  • Statistical comparisons
  • Score visualizations

If you are just interested in seeing all parameters of run_cross_validation(), click on the function link to have a look at all its parameters in the API Reference.

If you are already familiar with how to set up a basic workflow using julearn and want to do more fancy stuff, go to Selected deeper topics.