Category Archives: NTU

Coming from NTU research

Content Development Think Tank

My research at NTU encompassed the creation of a think tank focused on game design and development. Game Design for Entertainment: A Content Development Think Tank

Short teaser film, uses automated lipsync

This research is focused on content development borrowing from contemporary game concepts ideas for consumption in popular culture. Our methodology, a collaborative research project, will examine technical aspects of game design and integrate it with research that examines popular trends.

Bartyrun game play trailer

Game Design for Entertainment is an idea that incubates game research focusing on creating unique visuals and gameplay concepts. Much of video game research looks at the psychological effects of violent and aggressive gameplay on the user. Our research will look at appeal in visual characterization and interaction, e.g. game design.

Cinematics and Narratives

I published an academic article on “the making of” in MIT’s Leonardo online magazine that covers a research grant I received from Singapore’s National Research Foundation through the Media Development Authority.

I did a number of experiments while working on this project. Initially my research team worked on tagging imagery to evoke specific emotions, excited, happy, sad and melancholy.

Design exploration for Emotion Study

We mapped this work to design style and created a playback system that morphed from one look to another.

I worked with a number of great SE Asian artists on this project.

JC Wong artwork
Virtual sculpture by Stefani Irwan

Emote Project

The Emote Project, comprised of 50 minutes of animation in four chapter and 5 sections 2017) is about feelings, brain waves, and real-time experimental animation. Data recorded from EEG brainwave signals were analyzed for emotional patterns and reinterpreted to generate 20 animated chapters.

Emote (2017) is an ongoing series of real-time experimental animation that resulted from an interdisciplinary collaboration between Media Art Nexus and the NTU School of Computer Science and Engineering, (SCSE). The Emote Project is about feelings, brain waves and real-time experimental animation. Using EEG, the brain signals were recorded and analyzed for recognizing emotional patterns and used for generating 20 animated chapters in real time after the non-lyrical music clips of the known emotional class (such as happy, sad, exciting, scary, etc.). NTU SCSE contributed their scientific knowledge about neuro-network and specific analysis of EEG signals. The emotional states in the brain manifest EEG signals and machine-learning techniques in order to learn patterns of emotions certain signals.These can be utilized for the recognition of emotion and generating suitable external stimuli to elicit a desired emotional response.

Emote Project at the Media Art Nexus screen aspect ratio 8:1.5

We used 20 anime derived non-lyrical music clips of known emotional class (happy, exciting, sad, melancholy) provided by the Computer Science and Engineering Team.

In this work, music language is a means for learning emotions in brain and is used as an external stimulus in response to the emotional state of the brain. A study would observe the same feedback when using visuals.

Related research

Mark Chavez, Yun Ke Chang, “Cinematics and Narratives: Movie Authoring & Design Focused Interaction.” Leonardo Electronic Almanac, Published 2013-07-15, http://journals.gold.ac.uk/index.php/lea/article/view/87

Yun-Ke Chang, Mark J. Chavez, Miguel A. Morales Arroyo and Jaime Jimenez-Guzman. “An Active Cinema Experience: A Study on User Expectation and Perceived Gratifications of a Real-time Animated Film System.” 2012 Ninth International Conference on Information Technology – New Generations (2012): 674-679.
https://www.semanticscholar.org/paper/An-Active-Cinema-Experience%3A-A-Study-on-User-and-of-Chang-Chavez/bbf305de00aa2fd98a5c8a293aeb079ee9365e4b.


[Vengeance+Vengeance]

In a world where scientific achievement has merged the boundaries between man and weapon, one woman stands apart. The Resnick Corporation through advanced genomic research stands poised to control weapon development with an advanced soldier prototype. The only problem, the prototype has gone wrong.

[Vengeance+Vengeance]

[Vengeance+Vengeance] is a movie that is authored in a game engine, designed in three different styles. We varied the characterization between three design targets. Our standard style targets naturalistic proportions and colors, our cute style targets cartoon-like rounded shapes and colorful though soft tones and our extreme style attempts a more film-noir look with exaggerated though human proportions, more texture detail and an overall more contrasting tonal treatment. Typically this design style is used when she is in vulnerable situations. We use this style to draw empathy from the audience making the character more child-like and vulnerable in appearance.

The movie is created interactively by blending through these three design styles in a interactive director driven authoring system. What is presented is the final outcome of the work where the design of the characters changes in volume and color tone to manipulate the viewer’s experience.

Awards received for [Vengeance+Vengeance]