论文标题
音乐对合成体验建模的艺术可视化
An Artistic Visualization of Music Modeling a Synesthetic Experience
论文作者
论文摘要
这个项目使音乐视而不见。音乐可以是视觉杰作。有些人自然会体验到音频的可视化 - 一种称为联觉的情况。探索的联觉的类型是,当声音在“思想的眼睛”中创造颜色时。项目包括与经历联想,先前艺术检查以及主题研究的人的访谈,以告知项目设计。音频输入,数字信号处理(包括快速的傅立叶变换(FFTS))和数据操作会产生我们可视化所需的参数。然后将参数应用于物理粒子模拟器,该粒子模拟器被重新使用以建模合成经验。该项目的结果是Max 8中的模拟器,该模拟器通过根据输入音频的数字处理提取的参数来改变每个粒子的位置,速度和颜色,从而通过粒子的位置,速度和颜色来产生视觉性能。
This project brings music to sight. Music can be a visual masterpiece. Some people naturally experience a visualization of audio - a condition called synesthesia. The type of synesthesia explored is when sounds create colors in the 'mind's eye.' Project included interviews with people who experience synesthesia, examination of prior art, and topic research to inform project design. Audio input, digital signal processing (including Fast Fourier Transforms (FFTs)) and data manipulation produce arguments required for our visualization. Arguments are then applied to a physics particle simulator which is re-purposed to model a synesthetic experience. The result of the project is a simulator in MAX 8, which generates a visual performance using particles by varying each particle's position, velocity, and color based on parameters extracted via digital processing of input audio.