3 ms·

Fixing the Introductory Statistics Curriculum

2 points by sebg 2y ago

westurner 2y ago
I took AP Stat in HS and then College Stats in college unnecessarily. In HS it was TI-83 calculators, and in college it was excel with optional minitab. R was new then I remember ANOVA being the pinnacle of AP Stat. There are newer ANOVA-like statistical procedures like CANOVA; "Efficient test for nonlinear dependence of two continuous variables" (2015) https://pmc.ncbi.nlm.nih.gov/articles/PMC4539721/ https://pmc.ncbi.nlm.nih.gov/articles/PMC4539721/ Estimators: Yellowbrick implements the scikit-learn Estimator API: https://www.scikit-yb.org/en/latest/ https://www.scikit-yb.org/en/latest/ "Developing scikit-learn estimators" https://scikit-learn.org/stable/developers/develop.html#estimators https://scikit-learn.org/stable/developers/develop.html#esti... : > All estimators implement the fit method: estimator.fit(X, y) > Out of all the methods that an estimator implements, fit is usually the one you want to implement yourself. Other methods such as set_params, get_params, etc. are implemented in BaseEstimator, which you should inherit from. You might need to inherit from more mixins, which we will explain later. https://scikit-learn.org/stable/modules/generated/sklearn.pipeline.Pipeline.html#sklearn.pipeline.Pipeline https://scikit-learn.org/stable/modules/generated/sklearn.pi... Sklearn Glossary > estimator: https://scikit-learn.org/stable/glossary.html#term-estimator https://scikit-learn.org/stable/glossary.html#term-estimator https://news.ycombinator.com/item?id=41311052 https://news.ycombinator.com/item?id=41311052 https://news.ycombinator.com/item?id=28523442 https://news.ycombinator.com/item?id=28523442 What is GridSearchCV and what are ways to find optimal faster than brute force grid search? IRL case studies with applied stats and ML and AI: - "ML and LLM system design: 500 case studies to learn from" https://news.ycombinator.com/item?id=43629360 https://news.ycombinator.com/item?id=43629360 Additional stats resources: - "Seeing Theory" Brown https://seeing-theory.brown.edu/ https://seeing-theory.brown.edu/ - "AP®/College Statistics" Khan Academy https://www.khanacademy.org/math/ap-statistics https://www.khanacademy.org/math/ap-statistics - "Think Stats: 3rd Edition" notebooks https://github.com/AllenDowney/ThinkStats/tree/v3 https://github.com/AllenDowney/ThinkStats/tree/v3 And physics and information theory in relation to stats as a field with many applications: - "Information Theory: A Tutorial Introduction" (2019) https://arxiv.org/abs/1802.05968 https://arxiv.org/abs/1802.05968 .. https://g.co/kgs/sPha7qR https://g.co/kgs/sPha7qR - Entropy > Statistical mechanics: https://en.wikipedia.org/wiki/Entropy#Statistical_mechanics https://en.wikipedia.org/wiki/Entropy#Statistical_mechanics - Statistical mechanics: https://en.wikipedia.org/wiki/Statistical_mechanics https://en.wikipedia.org/wiki/Statistical_mechanics - Quantum Statistical mechanics: https://en.wikipedia.org/wiki/Quantum_statistical_mechanics https://en.wikipedia.org/wiki/Quantum_statistical_mechanics Statistical procedures are inferential procedures. There are inductive, deductive, and abductive methods of inference. Statistical inference: https://en.wikipedia.org/wiki/Statistical_inference https://en.wikipedia.org/wiki/Statistical_inference Statistical literacy: https://en.wikipedia.org/wiki/Statistical_literacy https://en.wikipedia.org/wiki/Statistical_literacy Also, the ROC curve Wikipedia sidebar: https://en.wikipedia.org/wiki/Receiver_operating_characteristic https://en.wikipedia.org/wiki/Receiver_operating_characteris... What is the difference between accuracy, precision, specificity, and sensitivity? Khan Academy has curriculum alignment codes on their OER content, but not yet Schema.org/about and or :educationalAlignment for their https://schema.org/LearningResource https://schema.org/LearningResource (s)

2 points by sebg 2y ago

I took AP Stat in HS and then College Stats in college unnecessarily. In HS it was TI-83 calculators, and in college it was excel with optional minitab. R was new then I remember ANOVA being the pinnacle of AP Stat. There are newer ANOVA-like statistical procedures like CANOVA; "Efficient test for nonlinear dependence of two continuous variables" (2015) https://pmc.ncbi.nlm.nih.gov/articles/PMC4539721/ https://pmc.ncbi.nlm.nih.gov/articles/PMC4539721/ Estimators: Yellowbrick implements the scikit-learn Estimator API: https://www.scikit-yb.org/en/latest/ https://www.scikit-yb.org/en/latest/ "Developing scikit-learn estimators" https://scikit-learn.org/stable/developers/develop.html#estimators https://scikit-learn.org/stable/developers/develop.html#esti... : > All estimators implement the fit method: estimator.fit(X, y) > Out of all the methods that an estimator implements, fit is usually the one you want to implement yourself. Other methods such as set_params, get_params, etc. are implemented in BaseEstimator, which you should inherit from. You might need to inherit from more mixins, which we will explain later. https://scikit-learn.org/stable/modules/generated/sklearn.pipeline.Pipeline.html#sklearn.pipeline.Pipeline https://scikit-learn.org/stable/modules/generated/sklearn.pi... Sklearn Glossary > estimator: https://scikit-learn.org/stable/glossary.html#term-estimator https://scikit-learn.org/stable/glossary.html#term-estimator https://news.ycombinator.com/item?id=41311052 https://news.ycombinator.com/item?id=41311052 https://news.ycombinator.com/item?id=28523442 https://news.ycombinator.com/item?id=28523442 What is GridSearchCV and what are ways to find optimal faster than brute force grid search? IRL case studies with applied stats and ML and AI: - "ML and LLM system design: 500 case studies to learn from" https://news.ycombinator.com/item?id=43629360 https://news.ycombinator.com/item?id=43629360 Additional stats resources: - "Seeing Theory" Brown https://seeing-theory.brown.edu/ https://seeing-theory.brown.edu/ - "AP®/College Statistics" Khan Academy https://www.khanacademy.org/math/ap-statistics https://www.khanacademy.org/math/ap-statistics - "Think Stats: 3rd Edition" notebooks https://github.com/AllenDowney/ThinkStats/tree/v3 https://github.com/AllenDowney/ThinkStats/tree/v3 And physics and information theory in relation to stats as a field with many applications: - "Information Theory: A Tutorial Introduction" (2019) https://arxiv.org/abs/1802.05968 https://arxiv.org/abs/1802.05968 .. https://g.co/kgs/sPha7qR https://g.co/kgs/sPha7qR - Entropy > Statistical mechanics: https://en.wikipedia.org/wiki/Entropy#Statistical_mechanics https://en.wikipedia.org/wiki/Entropy#Statistical_mechanics - Statistical mechanics: https://en.wikipedia.org/wiki/Statistical_mechanics https://en.wikipedia.org/wiki/Statistical_mechanics - Quantum Statistical mechanics: https://en.wikipedia.org/wiki/Quantum_statistical_mechanics https://en.wikipedia.org/wiki/Quantum_statistical_mechanics Statistical procedures are inferential procedures. There are inductive, deductive, and abductive methods of inference. Statistical inference: https://en.wikipedia.org/wiki/Statistical_inference https://en.wikipedia.org/wiki/Statistical_inference Statistical literacy: https://en.wikipedia.org/wiki/Statistical_literacy https://en.wikipedia.org/wiki/Statistical_literacy Also, the ROC curve Wikipedia sidebar: https://en.wikipedia.org/wiki/Receiver_operating_characteristic https://en.wikipedia.org/wiki/Receiver_operating_characteris... What is the difference between accuracy, precision, specificity, and sensitivity? Khan Academy has curriculum alignment codes on their OER content, but not yet Schema.org/about and or :educationalAlignment for their https://schema.org/LearningResource https://schema.org/LearningResource (s)