MIDI

Audio

Ab

stra

ctio

n

Layer

Description

Isomer-Symbolic

Ingests single or multiple MIDI files (in parallel) from a specified directory and populates a MySQL database with a symbolic model and associated raw MIDI data. While the raw MIDI data remains uninterpreted, it is organized into individual streams (based on MIDI track) containing collections of raw NodeEvents.

DescriptionIsomer-Audio ingests single or multiple audio files (in parallel) from a specific directory and populates a MySQL database with an audio model and associated raw audio data. While the raw audio data remains uninterpreted, it is organized into separate streams depending on the type of preprocessing (e.g. source separation) employed.

Isomer-Audio

SMSMEAPsoftopenBliSSARTSIMMJAFE

Externals

A.R.E. is an acronym defined as: Abstracted Representation Engine. The A.R.E. parses ingested raw symbolic and audio data and populates a MySQL database with abstraction layer data in a cartesian coordinate format. This allows input from various sources to combine in a single representation suitable for further analysis and transformation.

Isomer-A.R.E.

stream

segment

slice

stream

s

time

melodyharmonyrhythmtimbre

melodyharmonyrhythmtimbre

2ms

time

stream

1stre

am

2

pitch pitch IR

IR equity proximity equity

registral return

melody

A.R.E. Data(single point)

pitch pitch IR

IR equity proximity equity

registral return

tension pitches

average chroma

chroma (PCS)

harmony

A.R.E. Data(single point)

pitch pitch IR

IR equity proximity equity

registral return

tension pitches

average chroma

chroma (PCS)

N1 onset N2 onset

offset onset delta (p)

duration delta (p)

rhythm

A.R.E. Data(single point)

pitch pitch IR

IR equity proximity equity

registral return

tension pitches

average chroma

chroma (PCS)

N1 onset N2 onset

offset onset delta (p)

duration delta (p)

RMS spectral stability

spectral flatness MFCC

timbre

A.R.E. Data(single point)

Isomer-Query allows users to retrieve Isomer-generated A.R.E. data (above) and mine that data for musically relevant trends. Displays analyzed A.R.E. data as time points (X-axis) and streams/sub-streams (Y-axis) for a given model and allows on-demand calculation of any/all of the following data for any grid coordinates or range of coordinates:

Isomer-Query

harmonymelody rhythmtimbre

Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent

Tension DirectionTension InstabilityAverage Tension

Temporal DirectionTemporal Instability

IOI RangeNPVI IOI

NPVI DurationAgogic Accent

Textural FingerprintDynamic Accent

harmony

melody

rhythm

timbre

PitchPitch IR

IR EquityProximity EquityRegistral Return

Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent

Event Properties

Event Trends

TensionPitch Collection

Average ChromaChroma (12)

Tension DirectionTension InstabilityAverage Tension

Event Properties

Event TrendsN1 OnsetN2 Onset

OffsetOnset Delta (p)

Duration Delta (p)

Event Properties

Temporal DirectionTemporal Instability

IOI RangeNPVI IOI

NPVI DurationAgogic Accent

Event Trends

RMSSpectral StabilitySpectral Flatness

MFCC (13)

Event Properties

Textural FingerprintDynamic Accent

Event Trends