Cherry blossom

Inspiration

A "breathing facade" refers to a concept where the building's exterior surface is perforated with a pattern of holes or voids to create light and shadow, facilitating natural ventilation. This can be achieved through the parametric design of brick facades. Inspired by the rhythmic patterns in facade design, I want to create a 3d visualization of sound. The rhythms will be generated by mapping audio data to alter the motion of cubes in a matrix.
‍The visualization will create stacks of cubes with oscillating motion using the WebGL renderer.

Experimentation

Controlling the rotation angle of a cube based on the amplitude of the sound at each moment
Controlling the transparency of a cube based on the proportion of the maximum frequency in sound FFT analysis at each moment
Creating an offset angle
Using the function perspective to set up an orthographic projection of the cube
Shifting perspectives
Set up dimensional lighting to create different shading of each face

Ideation

Cherry blossoms at Miho Museum

A Museum Designed Inside a Mountain and Forest in Shiga, By Architect I.M Pei

The project combines video, audio, and 3D graphics to create a visual experience of seeing cherry blossoms. Both the video and audio will influence 3d graphic outcomes. Audio amplitude affects the canvas scale, creating a visually dynamic effect synchronized with the music. Video frame pixel data is used to color the blocks on the canvas, creating a visually engaging effect driven by video pixels. I tested using a video of cherry blossoms to create the blocks. I want to capture the falling of petals through the dynamic changes in blocks. The layout changes from a 2D facade into a square matrix with a portal in the middle. This sets up a one-point perspective and increases the space depth on a 2D canvas. I was inspired by the Miho museum designed by I.M. Pei, where there is a tunnel at the entrance. It leads the journey to the museum and guides visitors to a view of the cherry garden. The experience of passing through the tunnel is surprising as you can see the glimpse of pink on the tunnel's surface.

Sound source

The final music I selected is 喜び発見 from Sakamoto's album YAE NO SAKURA.