This index is intended to prepare hybrid-instrument builders for the basic needs of the trade: diffusion of sound and display/projection of video in complex arrangements in space.  The third section of the index relates to  protocols for controlling audio and video systems dynamically and in real-time.

SOUND DIFFUSION

• History: Musique Concrète (Pierre Schaeffer, Halim El-Dabh), Acousmonium (images)
• Perception: Doppler Effect, Precedence Effect, Echo, Reverberation
• Multi-channel audio applications: Surround, Ambisonics, Wave Field Synthesis (WFS), Directional Sound
• Multi-channel audio applications: Spatialization (see IRCAM Spat)
• Digital v. Analog: Sampling Rate, Bit-Depth, File Formats
• Hardware: Audio Interfaces (e.g. from amazon, MOTU, RME, Metric Halo)
• Future: Audio Video Bridge

VIDEO DISPLAY/PROJECTION

• History: Tony Oursler, Krzysztof Wodiczko (Art 21)
• Multi-channel Video: Inputs (e.g. IP Cameras | Analog Cameras + A-to-D Video Capture device) | Outputs (Graphics Cards for desktops | Matrox TripleHead for laptops)
• Projector technologies: LCD, DLP, Laser (example video of basic DIY version, better explanation, or commercial version from UltraLasers)
• Mobile Projection (Urban-Projection.com, MAW)
• Projection Mapping
  • Theory: Structured Light
  • Examples: overview video (courtesy of Jeff Schnabel), tumblr blog
  • Software: Camera Calibration Toolbox, GarageCube (MadMapper & Modul8), maw.livedraw (free), VPT (free)

CONTROL

• MIDI
• DMX
• OpenSoundControl
• Future: “The Internet of Things” (the Hype, embedded processors, Swarm Lab‘s mission in a nutshell, wireless communication as a computation problem, The Electric Imp)

EXERCISE

• Build a media system with multi-channel audio and video input, as well as multi-channel audio-video output