Towards the Automatic Generation of Sound Synthesis Techniques: Preparatory Steps

1. Towards the Automatic Generation of Sound Synthesis Techniques:Preparatory Steps Ricardo A. García Massachusetts Institute of Technology Machine Listening Group -- Media Lab 2000 Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

2. Goal: Having a TARGET sound and a set of Control Signals, find a “black box” capable of synthesizing the desired sound Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

3. Conference plan: • Sound Synthesis Techniques • SST space • Genetic Programming • Individuals, genetic operations, testing, fitness function • Conclusions Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

4. Sound Synthesis Techniques (SST) • Digital computer: AlgorithmSound Samples • Algorithm: Topology composed by functional blocks/parameters /connections Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

5. Basic Construction Blocks • Few types • Highly functional Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

6. SST Space • Conformed by all the possible combinations of blocks/parameters/connections (topologies) • Multidimensional (many dimensions!) • Assumption: There is at least one topology capable of synthesizing the TARGET sound Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

7. Searching the SST space • Use of evolutionary techniques: Genetic Programming • Well suited for searching in spaces with many dimensions • No need to specify the size (topology) of the solution • Multiple search paths/solutions Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

8. Genetic Programming Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

9. Key elements in Genetic Programming • Individual: Sound synthesis algorithm • Genetic Operations: Performed on the Individuals • Test of the Individual: Produce sound • Fitness Function: Distance measure Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

10. Individual • “Description” of a sound synthesis algorithm (topology) Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

11. Genetic Operations • Copy • Mutation • Crossover Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

12. Testing the individual • Translate (compile) description into a working topology • Run the topology: use the Control Signals and produce an OUTPUT sound Should be capable of running ANY topology that could be suggested by the program Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

13. Fitness Function • Distance measure between the OUTPUT and TARGET sounds • Objective: Analytical distance • Subjective: Perceptual distance Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

14. In each generation... Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

15. Conclusions • Define a standardized SST space • Use of Genetic Programming for searching • Work with topologies descriptions • Very robust scheme to run the topologies • Perceptual vs Analytical fitness function Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García

16. Contact Information • Ricardo A. García • email: rago@media.mit.edu • phone: (617) 253 0112 Automatic Generation of Sound Synthesis Techniques MIT Media Lab -- Ricardo A. García