From a slow technology perspective, we designed Pablo to visualize auditory memories and explore the recalling processes. Pablo randomly records daily sound of users, visualizes the sound into an abstract image and prints it out with QR code of the sound file. In this manner, Pablo introduces time gaps for users to speculate and recall after they receive the picture card. We conducted a field trial with two participants and each with Pablo at home for two days.

We found that Pablo encourages the users to reflect on their memories in different aspects. Through associating images with sound and memories, the users give new interpretations on images. They start to think and reflect due to the slowness of this sense-making process and interact with their embodied memories 💭 👉🏼 see the whole research atricle

README

This is a web for demonstrate the concept of Pablo: Once the TRY button is pressed, It will randomly record in the certain time interval and generate the picture card of the sound 🖨

👷🏻‍♀️ Built with

• Express.js: node.js backend framework with multer for handling multipart/form-data
• WebAudioRecorder.js: record audio
• p5.js: visualize audio
• googleapis: using Google Drive API to uplaod audio and return the url to access the audio
• qrcode.js: generate QR Code
• html2canvas: transform the picture card to the jpeg file

👩🏻‍💻 Setup

1. Clone this repo to your desktop and run npm install to install all the dependencies
2. Generate your own credentials.json by following the instruction and place the file in google_api/
3. Change the folderId to the ID of your google dirve folder where you want to upload the audio
4. Start the server by running node app.js