Chapter 9 Contents

• 9 Multimodality
  • 9.1 Overview
    • 9.1.1 Natural Communication with Machines
    • 9.1.2 Image Compression and Spatially Realistic Displays
    • 9.1.3 Speech Processing
    • 9.1.4 Tactile Interaction
    • 9.1.5 Data Networking and Distributed Databases
    • 9.1.6 Integration of Multiple Modalities
    • 9.1.7 Future Directions
  • 9.2 Representations of Space and Time
    • 9.2.1 Time and Space in Natural Language
      • Nature and Contents of the Markers for Time
      • Systems of Representation
      • Processing Temporal Information
      • Nature and Contents of the Markers for Space
    • 9.2.2 Implementation Issues
    • 9.2.3 Future Directions
  • 9.3 Text and Images
    • 9.3.1 From Images to Text
    • 9.3.2 From Text to Images
    • 9.3.3 Integrating Text and Images in Multimodal Systems
    • 9.3.4 Future Directions
  • 9.4 Modality Integration: Speech and Gesture
    • 9.4.1 Future Directions
  • 9.5 Modality Integration: Facial Movement & Speech Recognition
    • 9.5.1 Background
    • 9.5.2 Systems
    • 9.5.3 Future Directions
  • 9.6 Modality Integration: Facial Movement & Speech Synthesis
    • 9.6.1 Future Directions
  • References