DanceIR

DanceIR

A Research Framework for Dance Information Retrieval and Motion-Based Tempo Estimation

DanceIR is a research framework and Python toolbox for analyzing rhythmic structure directly from dance movement, without relying on audio. It combines principles from Music Information Retrieval (MIR), signal processing, and movement science to extract rhythmic anchors, estimate dance-derived tempo, and study body–music synchrony using motion capture and pose data.

This page provides an overview of the research, method, and supplementary demonstrations accompanying the DanceIR toolbox and related publications.


Overview

Natural human movement contains strong rhythmic structure. Dancers often articulate beats, subdivisions, and metrical layers through coordinated hand, foot, and torso motions. DanceIR formalizes these patterns as rhythmic anchors—kinematic events such as:

  • trajectory endpoints (zero-velocity points),
  • velocity peaks,
  • motion-energy peaks.

These anchors form periodic sequences that reveal the dancer’s internal pulse. DanceIR tracks these sequences over time and derives a global tempo estimate aligned with the dancer’s movement patterns.

The framework is designed for research on dance–music interaction, multimodal rhythm analysis, and embodied entrainment.


Method Summary

1. Rhythmic Anchor Extraction

DanceIR identifies movement anchors from pose or motion-capture data.
Common anchor types include:

  • Zero-velocity anchors (trajectory reversals)
  • Peak-velocity anchors
  • Motion-energy peaks
  • Foot contact events (from foot-ground interaction)

These sequences represent the dancer’s primary periodic motions.


2. Periodicity & Tempo Estimation

Tempo is estimated by analyzing anchor sequences using:

  • inter-onset interval (IOI) statistics,
  • windowed periodicity analysis,
  • log-scaled tempo tracking,
  • a novel Octave-Invariant Accuracy metric.

DanceIR outputs both:

  • continuous tempo curves, and
  • global tempo estimates per performance.

3. Octave-Invariant Metric (ΓOI)

To quantify dance-derived tempo accuracy, DanceIR introduces the continuous, log-scaled Octave-Invariant Accuracy:

  • Perfect alignment at half-time, original tempo, or double-time → ΓOI = 1
  • Outside the tolerance band → ΓOI = 0
  • A tempo estimate is considered a hit when ΓOI > 0

This provides a musically meaningful evaluation consistent with metrical hierarchy.


Supplementary Videos

Below are selected demonstrations generated using DanceIR.
Videos illustrate anchor extraction, periodicity tracking, global tempo estimation, and cross-anchor comparisons.

Note: Videos hosted in this repository:
https://sagar0dutta.github.io/danceir-supplementary/videos/

Anchor Extraction Example

Identification of zero- and peak-velocity anchors from hand trajectories.


Global Tempo Estimation (ΓOI)

Tempo tracking using rhythmic anchors and octave-invariant scoring.


Comparison Across Anchor Types

Different body segments emphasize different metrical layers; DanceIR unifies them.


DanceIR Toolbox

DanceIR is available as a Python package:

```bash pip install danceir