Useful Machine Learning Resources

Useful machine learning resources for anyone under the sun.

Machine Learning

• Sebastian Raschka's Resources

Deep learning

• Concepts:
  • Deep Learning Book
  • Neural Networks and Deep Learning
  • 26 THINGS I LEARNED IN THE DEEP LEARNING SUMMER SCHOOL
• Software/Tutorials:
  • MXNET
  • Tensorflow Tutorialson GitHub
  • Keras as a simplified interface to Tensorflow: A Tutorial

Convolutional Neural Nets

• CS231n Convolutional Neural Networks for Visual Recognition
• http://colah.github.io/posts/2014-07-Conv-Nets-Modular/
• http://stats.stackexchange.com/questions/116362/what-does-the-convolution-step-in-a-convolutional-neural-network-do

Manifold Learning

• Pros and Cons:
  • https://www.quora.com/What%E2%80%98s-the-advantages-and-disadvantages-between-the-different-dimension-reduction-methods
  • Drawbacks
• http://colah.github.io/posts/2014-03-NN-Manifolds-Topology/

Active Learning

• Active Image Clustering: Seeking Constraints from Humans to Complement Algorithms
• Learning Concept Embeddings with Combined Human-Machine Expertise
• Human-Centered Interactive Clustering for Data Analysis
• The Human is the Loop: New Directions for Visual Analytics
• NEURAL NETWORK-BASED CLUSTERING USING PAIRWISE CONSTRAINTS

t-SNE

• Visualizing MNIST: An Exploration of Dimensionality Reduction
• t-SNE visualization of CNN codes
• O'Reilly t-SNE Tutorial

Cool Machine Learning Stuff

• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• A Fast Method to Stream Data from Big Data Sources
• ICLR 2016 Takeaways: Adversarial Models & Optimization
• Neural Networks, Types, and Functional Programming
• Automatic Differentiation - What even is it?
• Automatic Differentiation in Machine Learning - A Survey

Tangentially Related Cool Stuff

• Interactive Dashboards in Jupyter

Python

• Using Python Itertools to Save Memory
• Jupyter Notebook Tips & Tricks
  • Debugging Python in Jupyter Notebooks
• Numpy
  • Numpy Glosssary
    • Super nifty for terms like:
      • along the axis
      • shape

Environments, Workflow, and Reproducibility

1. Vim
   • A script for bundling portable vim runtimes.
2. HTTP Proxy: http_proxy=http://user:passwd@proxy.foo.com:portnumber
3. Docker Containers
   • Jupyter Notebook Python, Spark, Mesos Stack
   • Kaggle Data Science
   • Kaggle Data Science, but for Linux
4. Project Jupyter
   • Powered By Jupyter: A Survey of the Project Ecosystem
   • Git filters for Jupyter Notebook
   • Jupyter Magics - Domino Lab
   • Hacker News Jupyter/Alternatives Discussion

Teaching Materials

• Example ML Notebook for Newbies
• Data Science Python Notebooks
• Jupyter Notebook Grader