A proposed design for supporting multiple array types across SciPy, scikit-learn, scikit-image and beyond

Cross-linking the scikit-image thread on this.