Skip to main content

Main menu

  • Home
  • Current Issue
  • Past Issues
  • Videos
  • Submit an article
  • More
    • About JFDS
    • Editorial Board
    • Published Ahead of Print (PAP)
  • IPR logos x
  • About Us
  • Journals
  • Publish
  • Advertise
  • Videos
  • Webinars
  • More
    • Awards
    • Article Licensing
    • Academic Use
  • Follow IIJ on LinkedIn
  • Follow IIJ on Twitter

User menu

  • Sample our Content
  • Request a Demo
  • Log in

Search

  • ADVANCED SEARCH: Discover more content by journal, author or time frame
The Journal of Financial Data Science
  • IPR logos x
  • About Us
  • Journals
  • Publish
  • Advertise
  • Videos
  • Webinars
  • More
    • Awards
    • Article Licensing
    • Academic Use
  • Sample our Content
  • Request a Demo
  • Log in
The Journal of Financial Data Science

The Journal of Financial Data Science

ADVANCED SEARCH: Discover more content by journal, author or time frame

  • Home
  • Current Issue
  • Past Issues
  • Videos
  • Submit an article
  • More
    • About JFDS
    • Editorial Board
    • Published Ahead of Print (PAP)
  • Follow IIJ on LinkedIn
  • Follow IIJ on Twitter

The Best Way to Select Features? Comparing MDA, LIME, and SHAP

Xin Man and Ernest P. Chan
The Journal of Financial Data Science Winter 2021, jfds.2020.1.047; DOI: https://doi.org/10.3905/jfds.2020.1.047
Xin Man
is a quantitative research consultant for QTS Capital Management, LLC, in Niagara-on-the-Lake, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ernest P. Chan
is the managing member of QTS Capital Management, LLC, a commodity pool operator, and trading advisor in Niagara-on-the-Lake, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • PDF (Subscribers Only)
Loading

Click to login and read the full article.

Don’t have access? Click here to request a demo 
Alternatively, Call a member of the team to discuss membership options
US and Overseas: +1 646-931-9045
UK: 0207 139 1600

Abstract

Feature selection in machine learning is subject to the intrinsic randomness of the feature selection algorithms (e.g., random permutations during MDA). Stability of selected features with respect to such randomness is essential to the human interpretability of a machine learning algorithm. The authors propose a rank-based stability metric called the instability index to compare the stabilities of three feature selection algorithms—MDA, LIME, and SHAP—as applied to random forests. Typically, features are selected by averaging many random iterations of a selection algorithm. Although the variability of the selected features does decrease as the number of iterations increases, it does not go to zero, and the features selected by the three algorithms do not necessarily converge to the same set. LIME and SHAP are found to be more stable than MDA, and LIME is at least as stable as SHAP for the top-ranked features. Hence, overall, LIME is best suited for human interpretability. However, the selected set of features from all three algorithms significantly improves various predictive metrics out of sample, and their predictive performance does not differ significantly. Experiments were conducted on synthetic datasets, two public benchmark datasets, an S&P 500 dataset, and on proprietary data from an active investment strategy.

TOPICS: Big data/machine learning, simulations, statistical methods

Key Findings

  • ▪ The authors propose a novel ranked-based instability index to measure the stability of feature selection algorithms MDA, LIME, and SHAP.

  • ▪ LIME is more stable than MDA and SHAP on the features with high importance scores.

  • ▪ LIME improves the exemplified trading strategy in both Sharpe ratio and cumulative return.

  • © 2020 Pageant Media Ltd
View Full Text

Don’t have access? Click here to request a demo

Alternatively, Call a member of the team to discuss membership options

US and Overseas: +1 646-931-9045

UK: 0207 139 1600

Log in using your username and password

Forgot your user name or password?
Next
Back to top

Explore our content to discover more relevant research

  • By topic
  • Across journals
  • From the experts
  • Monthly highlights
  • Special collections

In this issue

The Journal of Financial Data Science: 4 (2)
The Journal of Financial Data Science
Vol. 4, Issue 2
Spring 2022
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The Journal of Financial Data Science.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
The Best Way to Select Features? Comparing MDA, LIME, and SHAP
(Your Name) has sent you a message from The Journal of Financial Data Science
(Your Name) thought you would like to see the The Journal of Financial Data Science web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
The Best Way to Select Features? Comparing MDA, LIME, and SHAP
Xin Man, Ernest P. Chan
The Journal of Financial Data Science Dec 2020, jfds.2020.1.047; DOI: 10.3905/jfds.2020.1.047

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Save To My Folders
Share
The Best Way to Select Features? Comparing MDA, LIME, and SHAP
Xin Man, Ernest P. Chan
The Journal of Financial Data Science Dec 2020, jfds.2020.1.047; DOI: 10.3905/jfds.2020.1.047
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Tweet Widget Facebook Like LinkedIn logo

Jump to section

  • Article
    • Abstract
    • INSTABILITY INDEX
    • INSTABILITY COMPARISONS
    • DOES FEATURE SELECTION IMPROVE PREDICTIVE PERFORMANCE?
    • CONVERGENCE
    • APPLICATION TO S&P 500
    • APPLICATION TO TRADING STRATEGY META-LABELING
    • CONCLUSIONS
    • ACKNOWLEDGMENTS
    • ENDNOTES
    • REFERENCES
  • Info & Metrics
  • PDF (Subscribers Only)
  • PDF (Subscribers Only)

Similar Articles

Cited By...

  • No citing articles found.
  • Google Scholar
LONDON
One London Wall, London, EC2Y 5EA
0207 139 1600
 
NEW YORK
41 Madison Avenue, 20th Floor, New York, NY 10010
646 931 9045
pm-research@pageantmedia.com

Stay Connected

  • Follow IIJ on LinkedIn
  • Follow IIJ on Twitter

MORE FROM PMR

  • Home
  • Awards
  • Investment Guides
  • Videos
  • About PMR

INFORMATION FOR

  • Academics
  • Agents
  • Authors
  • Content Usage Terms

GET INVOLVED

  • Advertise
  • Publish
  • Article Licensing
  • Contact Us
  • Subscribe Now
  • Sign In
  • Update your profile
  • Give us your feedback

© 2022 Pageant Media Ltd | All Rights Reserved | ISSN: 2640-3943 | E-ISSN: 2640-3951

  • Site Map
  • Terms & Conditions
  • Privacy Policy
  • Cookies