Study of Creativity

Current research projects:

  • Data Visualisation
  • Multisensory Data Processing in Real Time
  • Modelling audio-visual stimulus perception related to language aspects

Intelligent data visualisation and human-computer interaction methods

This project involves exploring: multi-user scenarios; advanced interaction technologies, e.g., haptic feedback; advanced GPU based real-time rendering technologies (ray-tracing, radiosity). The concept of telepresence in visualisations will be explored. Using MoCap markers and a glove, it is already possible to track the position of the hands and the fingertips. This would enable users to “grab” neurons from a NeuCube model, get haptic feedback about their state, e.g., by vibration based on spikes, and be able to manipulate the visualisation, e.g., by rotating the view around the specified point or grow/shrink the view. Funded by another source, we are looking into buying a dedicated render machine with two to four dedicated NVIDIA graphics cards that, combined with the motion capture system, would allow one or more users to walk through and interact with such a photorealistic scene in real-time.

Project Team

  • Prof. N. Kasabov
  • Dr. S. Marks
  • Dr. T. Robotham
  • Prof. M. Billinghurst (University of Canterbury)
  • Prof. R. Jones (University of Canterbury)
  • Dr. S. Weddell (University of Canterbury)
  • Dr. M. Sagar
  • N.Scott
  • M. Gholami
  • J. Estevez

Integrative and collaborative methods for smart system design

Our team will continue to explore a new collaborative approach to distributed software/hardware system design Aura-based collaboration in a computer-mediated collaboration environment. Reducing cognition stress and avoiding interruptions are two primary research objectives of awareness systems for collaboration studies, which have not been achieved yet. The Aura-based collaboration comprises communication approaches for facilitating collaboration among distributed people, enabling people to dynamically manage their availability status without compromising their interpersonal privacy. Based on this concept, a delegation-like application will be developed to capture, understand and predict user’s availability status. The novelty of this study is to employ data mining and neuromorphic techniques.

Project Team

  • Prof. N. Kasabov
  • Prof. S. MacDonell
  • A/Prof. T. Clear
  • Dr. A. Connor
  • Prof. Z. Salcic (The University of Auckland)
  • Dr. A. Malik (The University of Auckland)
  • Prof. M. Winikoff (University of Otago)
  • A/Prof. D. Damian (University of Victoria, Canada)
  • D. Zhang

Modelling audio-visual stimulus perception related to language aspects

The hypothesis is that the NeuCube architecture can model not only brain data measured in certain areas of the brain, but also the perception of presented stimulus data such as speech and image and to relate this information to language concepts in multilingual subjects. A proof of concept method will be explored for the first time.

Project Team

  • Prof. N. Kasabov
  • Prof. S. Harvey
  • A. Wendt