19
SSIP tools intro Automatic Music Transcription & Traditional Instrument - Sopele

SSIP tools intro

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: SSIP tools intro

SSIP tools intro

Automatic Music Transcription & Traditional Instrument - Sopele

Page 2: SSIP tools intro

Today’s goals

1. How AI can be used in Music

2. Learn a little bit about this region’s cultural heritage

3. Learn how to use Google Colab

Page 3: SSIP tools intro

What is AMT?● Automatic Music Transcription

Page 4: SSIP tools intro

Tone structure intro

Page 5: SSIP tools intro

Frequency domain

Page 6: SSIP tools intro

Time-frequency

Page 7: SSIP tools intro

Sopele

● Descendant of the shawn which was very popular during medieval and renaissance period

● Shawn’s descendants are now found in Swiss Alps, Italian Apennines and in western Croatia

● Traditional hand-made woodwind instrument

● Piercing sound

● Always played in pair

Page 8: SSIP tools intro

Istrian scale

● Hexatonic scale

● Small Sopila is a top voice and Great sopila is a low voice

Page 9: SSIP tools intro

Specific instrument features

● Each Sopela can produce only six distinct tones

● 12 distinct tones in monophonic settings

● 12 + 36 non-permutative combinations = 49 combinations in polyphonic settings

● Handmade

● Sound characteristics depend on performer's ability to blow air

Page 10: SSIP tools intro

Demo time

● Short song “Bela nedeja” (eng. “White Sunday”)○ “Bela nedeja” = traditional fair in the town of Kastav

● Adrian Filčić - great sopela

Page 11: SSIP tools intro

Tone in frequency domain

Small tone 0 Great tone 0

Page 12: SSIP tools intro

Results

Page 13: SSIP tools intro

Whole process

*For more info read a full article: https://doi.org/10.1016/j.patrec.2019.09.024

Page 14: SSIP tools intro

Google colab

● Free (Google account needed)● Colab resources are not guaranteed and not unlimited -> save locally or in the cloud what

is essential● Colab is based on open source project - Jupyter● Colab notebooks are stored on Google Drive● Offers GPU support -> only one notebook at the time

Let’s dive into it...

Page 15: SSIP tools intro

Colab notebooks

1. Sopela example

● https://github.com/askoki/ssip/blob/main/SSIP_2021_sopele_get_started.ipynb

2. CNN - TF2

● https://github.com/tensorflow/docs/blob/master/site/en/tutorials/images/cnn.ipynb

Page 16: SSIP tools intro

Import notebook from GitHub

1. Navigate to File→Open notebook or

https://colab.research.google.com/

2. Click on GitHub tab

3. Paste GitHub repository url

Page 17: SSIP tools intro

Enable GPU

1. Navigate to Edit→Notebook Settings

2. Select GPU from the Hardware Accelerator

drop-down

Page 18: SSIP tools intro

Projects - website

● Static website in .zip format

● https://html.com/resources/free-html-templates/

● Index.html / index.php as main site

Page 19: SSIP tools intro

Key takeaways

✅ Setting up Google Colab

✅ What is AMT?

✅ Is Sopela’s sound quiet and gentle?

✅ Structure for final project website