13
@agatestudio Sound Processing dengan FFT Edi Syaputra Knight Agate Studio

Sound Processing by Edi Syaputra

Embed Size (px)

DESCRIPTION

Presentasi dari Edi Syaputra Batubara, Crew dari Agate Studio dalam event Talent Development Saturday Agate Studio. http://agatestudio.com Talent Development Saturday adalah acara Agate Studio crew sharing berbagai topik. Mulai dari Art, Programming, Game Production dan General Business/Management. TDS ini dilakukan tanggal 8 Februari 2014 di Bandung Digital Valley.

Citation preview

Page 1: Sound Processing by Edi Syaputra

@agatestudio

Sound Processingdengan FFT

Edi SyaputraKnight

Agate Studio

Page 2: Sound Processing by Edi Syaputra

@agatestudio

DISCLAIMER

AS3, based on “FFT Based Spectrum Analyzer” (by : Gerry Beauregard)

Processing, bukan Recognizing (apalagi pake voice)

Less technique!!!!

Yang presentasi buta nada

Page 3: Sound Processing by Edi Syaputra

@agatestudio

Sound Processing?

• Bukan “masukin suara ke game”, tapi “menggunakan masukan (input) suara ke game

• Input suara -> store -> tweak/process->...

• Image Processing : Manipulating array of pixels

• Sound Processing : Manipulating “array” of samples

Page 4: Sound Processing by Edi Syaputra

What For?

• Alternatif input, selainkeyboard/mouse/joystick/tombol-tombol lainnya

Page 5: Sound Processing by Edi Syaputra

@agatestudio

FFT

• Fast Fourier TransformFourier Transform, yang cepat... :v

DFT (Discrete Fourier Transform) yang cepat

• Fourier : fungsi yang dibentuk dalam sejumlah fungsi sinus cosinus.

Page 6: Sound Processing by Edi Syaputra

@agatestudio

FFT – How?

• Raw Input (berupa sinyal suara/time domain)

• Proses

• Output (Frekuensi/frequency domain)

Konversi dari time domain ke frequency domain,

Analog ke digital

Page 7: Sound Processing by Edi Syaputra

@agatestudio

FFT – How? (2)

• Di AS3, Input microphone (sample) di-store kedalam variable

• Store sample ke buffer, lalu lakukan perhitungan

• Output bisa berupa magnitude atau frekuensi

Gampang, kan? :D

Page 8: Sound Processing by Edi Syaputra

:D

computing the DFT of N points in the naive way, using the definition, takes O(N2) arithmetical operations, while a FFT can compute the same DFT in only O(N log N) operations.

Page 9: Sound Processing by Edi Syaputra

@agatestudio

Applications

• Game berbasis suara (ya iyalah)

– Karaoke (frekuensi/pitch)

– Dll

• Manipulasi suara

Page 10: Sound Processing by Edi Syaputra

@agatestudio

Pros

• Faster than DFT

• Yang sudah dijelaskan sebelumnya (itu yang diatas juga sih...)

Page 11: Sound Processing by Edi Syaputra

@agatestudio

Cons

• Slow/Heavy sometimes, may cause a little latecoming of information (delay)

• Sensitive!

Page 12: Sound Processing by Edi Syaputra

Thanks!

• http://www.audiostretch.com/spectrum/

• http://gerrybeauregard.wordpress.com/2010/08/06/real-time-spectrum-analysis/

• http://gerrybeauregard.wordpress.com/2010/08/03/an-even-faster-as3-fft/

• http://www.aes.org/sections/pnw/pnwrecaps/2012/jj_jan/fft.pptx

Page 13: Sound Processing by Edi Syaputra

Demo, yay!