Selecting the best model in scikit-learn using cross-validation

Share this & earn $10
Data School
Published at : 03 Dec 2020
168274 views
2438
23

In this video, we'll learn about K-fold cross-validation and how it can be used for selecting optimal tuning parameters, choosing between models, and selecting features. We'll compare cross-validation with the train/test split procedure, and we'll also discuss some variations of cross-validation that can result in more accurate estimates of model performance.

Download the notebook: https://github.com/justmarkham/scikit-learn-videos
Documentation on cross-validation: http://scikit-learn.org/stable/modules/cross_validation.html
Documentation on model evaluation: http://scikit-learn.org/stable/modules/model_evaluation.html
GitHub issue on negative mean squared error: https://github.com/scikit-learn/scikit-learn/issues/2439
An Introduction to Statistical Learning: http://www-bcf.usc.edu/~gareth/ISL/
K-fold and leave-one-out cross-validation: https://www.youtube.com/watch?v=nZAM5OXrktY
Cross-validation the right and wrong ways: https://www.youtube.com/watch?v=S06JpVoNaA0
Accurately Measuring Model Prediction Error: http://scott.fortmann-roe.com/docs/MeasuringError.html
An Introduction to Feature Selection: http://machinelearningmastery.com/an-introduction-to-feature-selection/
Harvard CS109: https://github.com/cs109/content/blob/master/lec_10_cross_val.ipynb
Cross-validation pitfalls: http://www.jcheminf.com/content/pdf/1758-2946-6-10.pdf

WANT TO GET BETTER AT MACHINE LEARNING? HERE ARE YOUR NEXT STEPS:

1) WATCH my scikit-learn video series:
https://www.youtube.com/playlist?list=PL5-da3qGB5ICeMbQuqbbCOQWcS6OYBr5A

2) SUBSCRIBE for more videos:
https://www.youtube.com/dataschool?sub_confirmation=1

3) JOIN "Data School Insiders" to access bonus content:
https://www.patreon.com/dataschool

4) ENROLL in my Machine Learning course:
https://www.dataschool.io/learn/

5) LET'S CONNECT!
- Newsletter: https://www.dataschool.io/subscribe/
- Twitter: https://twitter.com/justmarkham
- Facebook: https://www.facebook.com/DataScienceSchool/
- LinkedIn: https://www.linkedin.com/in/justmarkham/
Cross-validationScikit-learnPython (Programming Language)

Just A day At The Range

Just A day At The Range

Null and Alternate Hypothesis - Statistical Hypothesis Testing - Statistics Course

Null and Alternate Hypothesis - Statistical Hypothesis Testing - Statistics Course

Expected Value and Variance of Discrete Random Variables

Expected Value and Variance of Discrete Random Variables

Как Создать Листинг на Амазон без торговой марки. Свой бренд на Amazon.

Как Создать Листинг на Амазон без торговой марки. Свой бренд на Amazon.

Madison Rayne vs Tessa Blanchard: Match in 4 | IMPACT! Highlights May 31, 2018

Madison Rayne vs Tessa Blanchard: Match in 4 | IMPACT! Highlights May 31, 2018

Better Part Of Me (ASOT 988)

Better Part Of Me (ASOT 988)

Havana (metal cover by Leo Moracchioli)

Havana (metal cover by Leo Moracchioli)

15 Things You Didn’t Know About Running an Internet Business

15 Things You Didn’t Know About Running an Internet Business

Nikon D850 Vs Z7 | 'Meant to Be the Same' Some Complained | Opinion Piece Why Difference Makes Sense

Nikon D850 Vs Z7 | 'Meant to Be the Same' Some Complained | Opinion Piece Why Difference Makes Sense

CAPTAIN TT LESSEN

CAPTAIN TT LESSEN

How to Create an Instructional Design Portfolio

How to Create an Instructional Design Portfolio

Diana and Animal Stories for Kids

Diana and Animal Stories for Kids

Term Insurance plan - detail explanation

Term Insurance plan - detail explanation

Xeric Disencumber

Xeric Disencumber

POINT OUT Hekaton: Naredite korak naprej v digitalnem marketingu

POINT OUT Hekaton: Naredite korak naprej v digitalnem marketingu

Drugs | GCMV / Gacha Club Music Video | 🏳 FLASH WARNING 🏳

Drugs | GCMV / Gacha Club Music Video | 🏳 FLASH WARNING 🏳

IF YOU SEE HIM AT MIDNIGHT, DONT GO TO SLEEP... (Scary)

IF YOU SEE HIM AT MIDNIGHT, DONT GO TO SLEEP... (Scary)

Prophetic Warning to The Church // Jesus Said This Would Happen Before His Return

Prophetic Warning to The Church // Jesus Said This Would Happen Before His Return

Johnyboy - Alcatraz

Johnyboy - Alcatraz

New Codex Death Guard 2021 Review - Warhammer 40k 9th Edition

New Codex Death Guard 2021 Review - Warhammer 40k 9th Edition

Drawback of IRR

Drawback of IRR

You'll LAUGH FOR SURE!😹-FUNNIEST And CUTEST CAT VIDEOS 😸 2021 | YUFUS

You'll LAUGH FOR SURE!😹-FUNNIEST And CUTEST CAT VIDEOS 😸 2021 | YUFUS

"Haven't You Noticed (I'm A Star)" (Remix Cover // Steven Universe) (Adriana Figueroa & VGR)

"Haven't You Noticed (I'm A Star)" (Remix Cover // Steven Universe) (Adriana Figueroa & VGR)

Barry White - Never, Never Gonna Give Ya Up (Baby Driver Soundtrack)

Barry White - Never, Never Gonna Give Ya Up (Baby Driver Soundtrack)

The Conventional Deadlift | How to Perform The Conventional Deadlift

The Conventional Deadlift | How to Perform The Conventional Deadlift

Acting Workshop ni Ogie Diaz, nauwi sa away! | Ogie Diaz

Acting Workshop ni Ogie Diaz, nauwi sa away! | Ogie Diaz

Homosexual activity documented in female gorillas for the first time

Homosexual activity documented in female gorillas for the first time

History of Arab Slave Trade

History of Arab Slave Trade

Maruti BALENO Modified to LOOK like FORD MUSTANG ! ! !

Maruti BALENO Modified to LOOK like FORD MUSTANG ! ! !

Which or That? Relative Clauses for Beginners - Basic English Grammar

Which or That? Relative Clauses for Beginners - Basic English Grammar

Cockroach milk may be a new food trend

Cockroach milk may be a new food trend

Daktronics LED Video Display: Minnesota Twins

Daktronics LED Video Display: Minnesota Twins

大軍師司馬懿之軍師聯盟

大軍師司馬懿之軍師聯盟

Urgent:l'opposition refuse tout dialogue avec hamed Bakayoko;voici la raison

Urgent:l'opposition refuse tout dialogue avec hamed Bakayoko;voici la raison

อยากตาย ( WANNA DIE ) - BUXBOSS  Ft. 1000TH

อยากตาย ( WANNA DIE ) - BUXBOSS Ft. 1000TH

Prove that Zero Factorial is Equal to One

Prove that Zero Factorial is Equal to One

Honestly (Acoustic) - Harem Scarem [lyric video]

Honestly (Acoustic) - Harem Scarem [lyric video]

Doin - Removable Disk0 (Original Mix)

Doin - Removable Disk0 (Original Mix)

LAVA PRiSON ESCAPE!!  Adley App Review of Roblox game with Dad! pirate ship and cops obby Challenge

LAVA PRiSON ESCAPE!! Adley App Review of Roblox game with Dad! pirate ship and cops obby Challenge

Meredith Andrews - Faith and Wonder (feat. Cody Ray Lee & Abbie Simmons of UPPERROOM) [Live]

Meredith Andrews - Faith and Wonder (feat. Cody Ray Lee & Abbie Simmons of UPPERROOM) [Live]

Cushy - Blocks

Cushy - Blocks

Integer Scaling - How to play crisp 1080p on 4k display (Windows 10)

Integer Scaling - How to play crisp 1080p on 4k display (Windows 10)

Hellcat on Horse & Buggy Wheels goes to town and does burnouts

Hellcat on Horse & Buggy Wheels goes to town and does burnouts

Dropping To My Goal of 111 Pounds

Dropping To My Goal of 111 Pounds

Luxurious New Model Cars Available Right Now - Fastest Cars On the Market.

Luxurious New Model Cars Available Right Now - Fastest Cars On the Market.

🔎Seeking Arrangement Review 🤷 [Is Seeking Arrangement Legit?]

🔎Seeking Arrangement Review 🤷 [Is Seeking Arrangement Legit?]

This Primary is so Underrated!!

This Primary is so Underrated!!

Dagny - Somebody (Official Music Video)

Dagny - Somebody (Official Music Video)

This is the MOST FUN game mode in Among Us

This is the MOST FUN game mode in Among Us