• Week 12
  • October 31'22

1. Dissertation — Readings

What does it mean to design beyond persuasion?

Picking up where I left off on my research, now I started to think about what it means to go beyond persuasive design. The first part of my literature review for my dissertation will be taking a look at the problems in sustainable HCI by looking at persuasive sustainability through a critical lens in order to identify its shortcomings that could potentially hinder its progress. What I am still lacking, however, is what does progress mean or look like?


Alternative approaches to persuasion as suggested by Hrönn Brynjarsdóttir et al. in a research article titled "Sustainability Unpersuaded". One of my readings talks about using ambiguity as a resource for design. It might be weird to be talking about ambiguity in HCI because it almost seems like its situated in the opposite side of the spectrum in terms of what HCI stands for and thats why I found the reading quite interesting. The reading explores the opportunities enabled through embracing ambiguity in design. For example, by pushing people to interpret a system/object through their own personal angle, ambiguity has the potential to encourage the creation of a more personal connection between the person and system/object. Looking at it from a design perspective, the advantage of the approach is that it allows the designer to engage user with issues without constraining their response.

↘Ambiguous Design ↘Sustainability Unpersuaded ↘This Changes Sustainability HCI
"The intellectual material needs to be crafted into the form of a message, just as the physical material gets crafted into a product—these are two necessary components that can be co-determined or that should eventually coalesce."

Future Readings

Discursive Design; Designing for negative emotion; revisit climate emotion readings;

"The question remains, how will you engage with your target audience in Indonesia while in Singapore? Have you made a plan yet?"

2.1 Grad Project — Informal Feedback

  • Andri showed this project from BA2 that combines plastic bags together into a large fabric! The texture was really interesting to me as it doesn't feel like plastic even though it visibly is. Materiality is something I should start looking into.

    Exchanging thoughts with Andri, Tito and Yasser

    What I took away from the conversation is that they saw that there was is a potential in combining all 3 of my ideas into 1 single thing, or categorize the ideas so that they connect to each other and thus building a narrative about the state of climate change in Indonesia. Something lacking still in all of the ideas is the question of what happens next after the interaction? I believe this is something I could disover through testing out my ideas through low-fi prototypes, which I am currently doing and to really zone in on an issue in Indonesia I want to tackle.


    Since I am talking about plastic pollution, is there a specific habit or a culturally significant routine in Indonesia that is something people overlook but actually creates a big problem? Thinking about when plastic is commonly used by Jakartans, my mind immediately goes to wet markets around the city. The plastic fine in Indonesia do not apply to wet markets (yet), thus allowing people to be carefree in their plastic usage. I noted Yasser's insights as it looks at my topic from a social design angle. He suggested an area I could look into is installing this sort of preventative/thought provoking intervention in the middle of the wet market to hinder a habit or at least cause disruption in their plastic usage habit. Of course, there are lots of details to iron out but I will keep this approach in mind as I continue with my research!

    Aesthetics. I enjoyed talking to Tito & Andri specifically about the materiality and aesthetics of the idea. They suggested exploring the materiality of plastics in a deeper level which could give my artefact a richer context. We were talking about my third idea (Extinction vs Evolution), to which they briefly mentioned about looking at mutant creatures as a result of the Fukushima nuclear waste leaking to the ocean to inspire the form of the artefact; as mutant plastic creatures that reflects the ugliness of pollution. A note worthy suggestion was also to explore how the look of the artefact could be repulsive, in a way that creates a discomfort or shock value towards its viewers. Similar with Andreas' feedback last week, the shock factor I think is something that still needs to be further thought out and explored in my ideas.

    2.2 Grad Project — Round Table Session

  • Aditi & her plants presenting! Listening to her is always such a joy! I felt like I was able to learn about Bengaluru, plants and interaction design all in one go.

    Main Takeaways: (1) Potentially connect all 3 ideas? Example exhibition space or series of objects that altogether builds a narative. (2) Let go of some ideas and focus on 1 approach (right now sea level is not connected with the others) (3) For the people interacting with the object, what question do they answer? Who are the subjects or people involved?

    Gideon suggested for me to keep building my library of sounds from different plastics, and categorize them in a way that makes sense. He said sound was an interesting approach in terms of raising awareness about plastic use. The round table was a very fruitful experierience as I got to exchange thoughts regarding my ideas with my lecturers and peers :-) Will talk about it more!

    Added some oomph to the presentation design! I noted that the presentation design from Week 11 (bottom) was looking quite boring and text heavy (although granted they were for explaining our dissertation not grad project), so for this week's I used brighter colors and played around with the images and design a bit more. The title of my project is currently morphing to something else so I decided to remove the logo for now.

    ↘Link to my slides here!
    Negative emotions — interactions eliciting a sense of annoyance, danger and repulsivity?

    2.3 Grad Project — Experiment Buzzer + Ultrasonic sensor

    I bought a new buzzer and packaged everything together using styrofoam.

    Video shows the gaps between the beeps of the buzzer get shorter the closer the sensor detects an object, and longer the further the object is (like a car backing alarm!)

  • Devices packaged in a styrofoam box! First I sketched out how the main components of the device (Arduino, breadboard and ultrasonic sensor) could be layed out inside the box and ended up stacking them together.

    What's Next?

    Thoughts for polishing the packaging: Acrylic board? Paper mache? I will leave it for now and concentrate on sorting out the interaction and tech (incorporating sound as an output)

    3.1 Prototyping — Audio devices
  • Sketch of prototype

  • Setting up with Arduino Uno, Ultrasonic sensors and a Serial MP3 Player

    Tutorials for motion-triggered sound device

    ISD1820 simple(er) to use but no storage so need to record on the device itself. Can only playback 1 audio.

    ↘Ultrasonic Sensor HCSR04 + ISD1820 + Arduino + speaker.

    SD Card (need to be reformatted a certain way (ask Andreas)) + speaker. Sound can change according to distance!!

    ↘Ultrasonic Sensor HCSR04 + Serial MP3 Player + SD Card + Arduino

    Use random function to shuffle between 10 tracks whenever motion is detected. 1 min delay between audio

    ↘Sparkfun MP3 Player Shield + SD Card

    First step... int he next section- outline steps: IDEA break into 3: (1) Get serial comm working (2) Set up Proof of concept (3) If ok, continue to set up devices

    3.2 Prototyping — Visualizing ultrasonic sensor via processing

    As a small step towards making audio respond to the sensor, Andreas suggested I try to familiarize myself to the process through a simple exercise — making the background color change according to the distance of the object from the sensor.

    Yay!!!

    Screenshot from Arduino IDE

    Screenshot from Processing

    Processing & Arduino IDE

    Great exercise and explanation on serial communication

    ↘ Serial dialogue between Processing and Arduino

    General Notes: Serial Comm: Int: Float: Data type for floating-point numbers, e.g. numbers that have a decimal point. Map: Re-maps a number from one range to another e.g. map(value, fromLow, fromHigh, toLow, toHigh)

    Examples using ultrasonic sensors for different functions

    ↘ Scaling an image ↘ Detects if someone is in front of your laptop ↘ Draws different shapes

    I used the 3rd tutorial as the main source code and tweaked some things to finally get the background color to change depending on how far the object is from the sensors. As shown in the video above, the color red means the object is located 20cm or less in front of the sensor, while yellow means its more than 100cm away from the sensor.


    The process is a much simpler version of the fan experiment conducted in Week 7. That experiment requires not only getting Processing and Arduino IDE to talk but also using an online database to access the weather API

    ↘ Link to Week 7

    3.3 Prototyping — Material and Sound

    Form exploration using plastic polythene bags and placing a colorful lightsource underneath.

    Forms were heavily inspired by Robert Janson's abstract plastic sculptures. I really liked how he was able to create these surreal, alien-like forms just by some plastic bags together. Forms will be a big part of my project and I'm definitely aiming to experiment more in creating surrealist influenced shapes like this.

    Sound Bank

  • I was setting up a google sheet to categorize my sound collection and I realized that the categorization didn't make that much sense. So far, I was recording just for the sake of finding the loudest and most annoying sound possible while not thinking much about the action involved in creating said sound. My current categories of action to produce sound from the objects are: friction/rubbing, scratching, crushing, ripping, and squeezing. I made up the categories on the spot last week while thinking about various ways a person could interact with an object, but is that all there is to it?


    Reading "What in the World Do We Hear: An Ecological Approach to Auditory Event Perception" by William W. Gaver (1993)

    Bill Gaver is a Professor of Design and co-leader of the Interaction Research Studio at the University of Northumbria, London. In his book, he created a 'map' of everyday sounds that are first derived from the 3 fundemantal sources — solid, gases and liquid. The book looks in-depth into the taxonomies of everyday sounds and focuses on auditory categorization. The book establishes 4 basic-level events that are fundamentally the sources for different sounds. I found the map really interesting to look at because it lists the additional attributes that effects the sound produced, or reversely, the information we could potentially derive by listening to it. For example, through the act of scraping an object, it conveys information about its texture, material, speed, acceleration, and force of the action. I believe this book would be a good resource in the future if I decide to push for sound-producing interactions based on everyday objects!

  • Here's my working spreadsheet. Sources of sound are based on Bill Gaver's category of the 4 basic-level events: deformation, impacts, scraping, and rolling.

    ↘ Link to spreadsheet
  • Rachel's presention! I loved listening and looking at her colorful visual explorations on digital identity and the duality of the physical and digital world.

    4.1 Cohort Presentation

  • Some of my peer's presentations!

    Colors & Music

    I loved the bursts of colors in Afiq's presentation, which is the main focus of his topic. To my knowledge, he is exploring the synthesis of colors and music, and his experiments include translating music scores into gradients of colors. I particularly found one of Afiq's main figures of inspiration, Brian Eno, quite interesting. Brian Eno's Ambient Music for Airports album explores generative systems-created music which is a continuation of the artist's experimentation on using a tape machine as a composition tool.

    ↘ More about the artist

    Brutalism

    Kelly's topic is super interesting to me as well. Although I don't know much about brutalism or brutalist architecture, I appreciate its aesthetics and very dystopian-like vibes. Her explorations into the topic are what caught my eyes the most. She mentioned about exploring the 2 extremes of brutalist aesthetics and try to incorporate it into website designs. I think very html-like sites definitely have a unique look to them, similar to the solar-powered websites I've been looking at (but will put off attempting it for now because of time pressure!) I also liked how she drew the connection from old computer icons to brutalist aesthetics.


    4.2 Weekly Roundup — Questions

    What do I want to achieve by weeks 14 & 16?

    Can you situate your reaserach topic stand within the rest of the world?

    Nuance: what specific values should the individual or community adhere to?

    So many questions and currently not much answers. Nadine brought up important pointers for during the briefing before the presentation. Are the outcomes creative? What did you find out from you research? There should be a connection between whats being said and what was made. I think I've not put aside some time to think about the aesthetics of my overall project that should be cohesive all across the outcomes, which is something I have to give more attention to now.

    But of course there are some progress too! The experiments with the tech, materials and forms helped me to solidify what the final prototype would look like. By dissertation draft submission, I hope to start a bit of my discussion with some user-testing with the prototype! Next week will be focusing more on structuring my dissertation make changes from the RPO. Looking far into the future, I also hope that my trip home to Indonesia during December break will give me a fresh point of view on my topic. I feel a biit bittersweet about ending up with plastic waste as a topic after all the research I did around climate change, but there is a reason it continues to be a problem even with it being such a saturated topic. I hope that I will be able to contribute to the discourse through my project and plant a seed for a positive change in the future.

    Extra: as a personal note I realized that I say the word "interesting" too much so here are some synonyms for my future reference — fascinating, compelling, thought-provoking, inspiring, intriguing, informative, appealing.