Link Search Menu Expand Document

Michigan Data Interface

The Michigan Data Interface (MDI) is a standardized framework for developing, installing and running HPC data analysis pipelines and interactive R Shiny visualization applications.

These pages describe the MDI project overall. Links within lead you to documentation for specific components, e.g., how to get started writing your own tool suites.

Screenshots

Stage 1 pipelines via command line, YAML-based tool and job definition

Pipeline Runner web app running Stage 1 pipelines, remote HPC access

Stage 2 interactive apps via a access-controlled public web server

Live Demo

To try out this repository’s live demo app server:

Quick Start

Follow these instructions to clone and run the script that will install the MDI frameworks and your tool suites of interest on an HPC server:

Alternatively, use this web site to generate a custom batch script for your desktop computer, e.g., to control a remote MDI installation or run apps locally:

Tool developers should start by copying our repository suite template and following its documentation.

Guiding Principles

  • easy, standardized implementation
  • simple, effective use of modern development tools
  • efficient use of scalable computation resources
  • maximum developer flexibility
  • rapid collaboration and code sharing
  • interactive data analysis

Our goal is to help you develop and share robust data analysis tools more easily, or to use tools developed by others, without forcing too many requirements into the process.

Basic Training for Developers

This documentation assumes familiarity with open source code development. Please see our Basic Training tutorials in the link below if you need help getting started with Git, R, Shiny, job schedulers, etc.

Portability and Licensing

The MDI was created to support researchers at the University of Michigan and a few instructions are specific to our environment. However, the codebase is generic and can be used by any laboratory or organization for any data analysis need under the MIT license.


For more information about the MDI, please visit:

MDI Documentation MDI Basic Training MDI GitHub page