WEEK THIRTEEN: TECHNOLOGY RECAP

I think, at this point, it is important to recap some of the information from my previous assignment that is vital to this one.

Importantly, I want to point out the technology being used.  My initial research can be found here, however I have expanded this below.

Currently, scientists can use various technologies to read human brain waves. Neuroscientists have long believed that the brain works by translating aspects of the external world, such as spoken words, into patterns of electrical activity. But proving that this is true by showing that it is possible to translate these activity patterns back into the original sound – or at least a fair approximation – is nevertheless a great step forward. 

Emotiv Lifescience, is currently developing a new form of remote control that uses brainwaves to control digital devices and digital media Emotiv's EPOC headset uses 16 sensors to listen to activity across the entire brain. Software "learns" what each user's brain activity looks like when one, for instance, imagines a left turn or a jump. A computer interface reads its user's brainwaves, making it possible to control virtual objects, and even physical electronics, with mere thoughts (and a little concentration). 

Malintent is a new “security scanner” which can identify if those walking through have criminal intent- So far it can recognise seven primary emotions and emotional clues and will eventually have equipment which can analyse body movement, an eye scanner and a pheromone-reader. 

Researchers have created a device that could enable people who are completely unable to speak or move at all to nevertheless manage unscripted back-and-forth conversation. The key to such silent and still communication is the first real-time, brain-scanning speller. A mind reading program has been created which can translate thoughts into words- use for those who cannot communicate The research paves the way for brain implants that would translate the thoughts of people who have lost power of speech. The remarkable feat has given researchers fresh insight into how the brain processes language, and raises the tantalising prospect of devices that can return speech to the speechless. The next step is to test whether we can decode a word when a person imagines it. That might sound spooky, but this could really help patients.

Researchers from Japan's ATR Computational Neuroscience Laboratories have developed new brain analysis technology that can reconstruct the images inside a person's mind and display them on a computer monitor. According to the researchers, further development of the technology may soon make it possible to view other people's dreams while they sleep. "These results are a breakthrough in terms of understanding brain activity," says Dr. Cheng. "In as little as 10 years, advances in this field of research may make it possible to read a person's thoughts with some degree of accuracy." The researchers suggest a future version of this technology could be applied in the fields of art and design -- particularly if it becomes possible to quickly and accurately access images existing inside an artist's head. The technology might also lead to new treatments for conditions such as psychiatric disorders involving hallucinations, by providing doctors a direct window into the mind of the patient. ATR chief researcher Yukiyasu Kamitani says, "This technology can also be applied to senses other than vision. In the future, it may also become possible to read feelings and complicated emotional states.

http://www.jstor.org/stable/2094194
http://pinktentacle.com/2008/12/scientists-extract-images-directly-from-brain/ http://www.futuretimeline.net/blog/2012/07/1-2.htm#.UC5uw6nibz0
http://www.dailymail.co.uk/sciencetech/article-1060972/The-airport-security-scanner-read-mind.html#ixzz24LLa1nzO
http://www.ted.com/talks/tan_le_a_headset_that_reads_your_brainwaves.html
http://www.guardian.co.uk/science/2012/jan/31/mind-reading-program-brain-words?fb=optOut

WEEK THIRTEEN: TESTING THE VIDEO

I began my animation today, and it is taking longer than I had anticipated.  The issues I am having the most is keeping the pitch of my voice the same for the entire sound recording.

Here is a little preview of what I have done:

I think it will sound a little better once there is some background music- I would like something  happy and light sounding.  I am quite happy with the look of the video though.

WEEK THIRTEEN: THE WORLD BECOMES VIRTUAL

map of the internet: source

One of the assumptions I have made in my future vision, is that by 2040, the entire world will be virtually connected.  Although some may argue that in third-world countries this is not going to happen, there is increasing evidence to support the fact that in many of these areas, although there has been no industrial revolution, a digital revolution is occurring. 

In Africa, for example, the mobile platform is being driven by social and commercial needs, making it the fastest growing region for mobiles in the world- and the biggest after Asia. Mobiles have fostered communication like never before, linking villages and allowing greater levels of information transfer. Although the continent still has the lowest global internet penetration at 15.6%, mobile penetration rates are far higher.

The proliferation of this mobile technology is also hoped to bring about more efficient disaster relief, cheaper energy and a faster route out of poverty.In 2008, google gave its support to a billion dollar plan to provide satellite internet access to emerging markets, including Africa and Asia, together with HSBC.

And it's not just Africa. In Bangladesh, "Info Ladies" traipse through the countryside by bike, armed with laptops and satellite internet connections, allowing those in remote areas to connect back to loved ones, the government and the rest of the world.  This trend is becoming increasingly apparent globally.

Mobile internet use, it seems, is moving faster than fixed usage, according to he findings are part of a comprehensive report released by the ITU's Broadband Commission for Digital Development. It states that by 2020, connected devices would outnumber connected individuals by a ratio of six devices to every person online.The report found that while household access was increasing at an acceptable rate, individual internet use was continuing to lag behind. The ITU said that mobile broadband could provide a platform for achieving an increase in individual use. By the end of 2011, the report said, new mobile broadband subscriptions were outstripping fixed connections by two to one.  This means that our use of virtual communication is becoming increasingly mobile, and that as a society, globally, people are becoming increasingly connected, more of the time.  This supports the idea that communication will become increasingly internet- or virtual- based, and that this would be an ideal way to enable those with communication issues to join.

As of September this year, 1/3 of the world is officially "online".


http://www.guardian.co.uk/world/2012/oct/30/africa-digital-revolution-mobile-phones
http://www.guardian.co.uk/activate/phones-revolution-developing-world
http://www.news.com.au/technology/bangladeshi-villages-use-info-ladies-to-deliver-the-internet/story-e6frfro0-1226509192221
http://www.computerweekly.com/news/2240086826/Google-backs-satellite-network-for-third-world-internet-access
http://www.aljazeera.com/news/americas/2012/09/2012923232111323871.html
http://www.smh.com.au/digital-life/digital-life-news/a-third-of-the-worlds-population-has-internet-un-20121012-27gr6.html

WEEK THIRTEEN: PANEL DEVELOPMENT

I decided to start on my panel early, to allow myself enough time to do my movie with limited stress.

I wanted a panel which explained my idea in it's entirety, as a stand-alone. I have always liked a mix of graphical and text-based information, so decided to go down the infographic route.

As I wanted to explain everything, I have divided the panel into 3 areas, looking at "why", "what + how" and "who".  

Below is a "progress" image of my panel:

The who section will include information about users, and those who will benefit from the system.

WEEK TWELVE: FEEDBACK

This week, in class, I presented my storyboard (as shown in yesterday's post).  The main feedback I received was in relation to outlining the role of the designer in this process.  I see my role, as a designer, in organising the differences between a software engineer, technicians, scientists and medical staff in the conceptualisation and implementation of the system.  My design skills would be used to problem-solve and find solutions during the R&D stage primarily, as there is a lot of co-ordination required between different facets of the system.

There was also a call for a slightly more "serious" panel, which I will begin working on next week.

Once I looked at everybody else's work, I began to get a little worried, as my ideas are quite far from all the others.  My design seems much "smaller" in scale, and my presentation style is quite different altogether.

WEEK TWELVE: STORYBOARD

In order to plan the best way to compile my video, I decided to first storyboard my ideas.  At this stage, I have decided to have a full animation, for a number of reasons.

1. I want to ensure my movie is respectful of those with disabilities
2. I want my video to explain what connect actually is and what it does, instead of just showing the interaction with it
3. I want my video to not become weighed down by the complexities of the technology involved.

I have, therefore, decided to tell a story through the video, in a few sections.

1. Firstly, I will set the scene by exploring the context
2. Outline the users' needs
3. Outline who has created connect
4. Outline what is required for connect to work
5. Explain what connect is
6. Explain who the users are
7. What does connect provide to users
8. How does connect provide this
9. What are the benefits?

Below is my initial storyboard (click through for a bigger view)

I have yet to storyboard what connect provides to users, but believe this to be: 

• For users, connect provides a connection to the rest of the world
• For carers and medical staff, connect provides a way to communicate with and monitor patients
• And for families, connect allows ease of communication, strengthened relationships and enhanced quality of life.

WEEK TWELVE: AFTER EFFECTS TAKE ONE

This week, I have decided to start having a look at adobe after effects, which is apparently the easiest way to edit movies and make animations.

As my current video editing skills are limited, I have been watching many youtube tutorials, and have created a video which was taken while I was on on holiday  recently, by cutting, combining and editing existing videos.

I have also decided that what I really want to achieve from my presentation is for people to really understand what connect is trying to do. I reached this conclusion after attempting to explain my concept to friends, classmates and my tutor, and having difficulty in explaining myself accurately. I have therefore, decided to use an informercial-style of expression, albeit still animated as an infographic.

One of the styles of presentation I prefer is "kinetic text", where words are show on screen at the same time as they are said, accompanied by some animations.  I like this style as it really ingrains the message in the viewers mind as it gives both auditory and visual cues.  I have watched some tutorials and experimented with this media, as shown below.

My next step for this week will be to have a look at a storyboard for my final presentation.

WEEK TWELVE: DESIGN THINKING REVISITED

I revisited past research on design thinking, and came up with the following statement:


Why would an Architect be the right person to create this solution? 

The answer lies in “Design Thinking”, an interpretation of the design process.  As a designer, one is charged with creating for use- they create buildings, products and spaces for use by other people.  Our designs are judged successful if they create emotion, or are functional- they are judged not for themselves, but for their impact on a user.  Designers possess the ability to examine problems at a variety of scales. Contextual analysis gives us insight into the future, as does our ability to see the "big picture". Designers possess the unique ability to visualise highly theoretical, conceptual problems and offer tangible solutions grounded in reality. The designer is one who, as second nature, considers people in their solutions at the outset, not for nobility, not for emotive or sentimental reasons, but because he has been trained to do so, and old habits die hard.

In the case of connect, the architect is the perfect designer, due to their simultaneous user and “big-picture” focus necessary to navigate the gap between a user with complex and specific needs, a system with vast possibilities for use, and the cutting edge technologies required.

In terms of architecture or urbanism, perhaps there is no real link, but I don't necessarily think there needs to be.  This project, for me, is about exploring how my trained thinking can be applied to non-conventional problems, to understand whether my skills can be carried across.  In this sense, I feel like so far, the project has been quite a success.  I have been able to look at a problem in a unique way, and through discovery of the solution, discover more and more about the problem itself, and propose the best solution possible.

WEEK ELEVEN: PRESENTATION AND FEEDBACK

My first issue for this weeks class was branding.  I decided to come up with a brand in order to better explain my concept- as the word "interface" was beginning to confuse some.  I chose the name "connect", because that is what the system does- it connects users to the world.

Firstly, I outlined my response to the CRA:

I then looked further into my branding, and created a logo.  The logo uses the infinity symbol with a super-imposed "C", which implies endless possibilities, using connect.

For my presentation, it was important for me to outline exactly what connect does, in a very simple way, so I compiled the following statements:

The easiest way to explain connect is as a computer operating system, which can be used on any computer.

Traditional input devices include keyboards and mice (or in AAC systems, can include eye trackers, breathing devices, joy sticks, etc).  Connect, therefore, allows a user to input using their thoughts only.  

Output devices was one area where I was pretty confused.  Initially, I had expected connect would output in the same way that it would input- directly into a users mind.  However, research into human consciousness proved that this would be quite difficult.  I then flirted with the idea of a lucid-dreaming state, however this seemed too close to creating a virtual reality setting, and I want to enhance communication for the user- not cut them off from the "real world" and implant them in the virtual.  The answer then, was simple.  As users can generally still hear and see, connect will simply output on visual and auditory devices- which may be as simple as a monitor and speakers, or include sophisticated technology including augmented contact lenses, holographs and implanted headphone devices.

The thing that sets connect apart is its ability to translate thoughts into commands, allowing users to navigate its graphic interface, instead of traditional AAC devices which just project sounds/text.

Users, at this point, are limited to the above, however in the future may be expanded to include those with limited mental functionality, however this would require an overhaul of the system

As each user has different thought patterns, brain shape and layout and needs, each system needs to be individually calibrated.  Users must also undergo regular re-calibration processes, given that though patterns often change spontaneously.

As the internet is the future of communications, connect allows users to communicate through this medium primarily

After this presentation, feedback included making sure to articulate exactly what it was that I am presenting and designing, and to touch upon design thinking again.

WEEK ELEVEN: AUGMENTED AND ALTERNATIVE COMMUNICATION DEVICES

Augmented and Alternative Communication Devices (AAC), are communication methods used to supplement or replace speech or writing for those with impairments in the production or comprehension of spoken or written language.  These are the systems which are generally used by those who have severe communication disabilities.

AAC systems are diverse, and aided approaches use external tools and range from pictures and communication boards to speech generating devices. The symbols used in AAC include gestures, photographs, pictures, line drawings, letters and words, which can be used alone or in combination. 

Body parts, pointers, adapted mice, or eye tracking can be used to select target symbols directly, and switch access scanning is often used for indirect selection. Message generation is generally much slower than spoken communication, and as a result rate enhancement techniques may be used to reduce the number of selections required.

Users include those with cerebral palsy, Intellectual impairment, Autism,Developmental dyspraxia,Traumatic brain injury, Aphasia, Locked-in syndrome Amyotrophic lateral sclerosis, MND, Parkinson's Disease and Multiple sclerosis, among others. 

In terms of this assignment, the interface would come under the umbrella of AACs, however what sets it apart is the fact that it allows for faster message generation, as well as integration with virtual technology- which these devices do not allow for at this stage.  Furthermore, the proposed interface is far more sophisticated in terms of its use- it can be used not only to send messages, but to allow users to search for information, entertainment, education- whatever they chose.  For those with cognitive disabilities, this may seem unnerving, however for those with complete cognitive abilities, it could open up the door to a previously unreachable world.

WEEK ELEVEN: USERS

This week I have also been looking at defining who my users are, what their needs are and how they would interact with the interface.

I have previously outlined that my users would be those with profound communication disabilities, but near complete mental abilities.  While there are many health issues which would present these symptoms, I will be concentrating on those with locked-in syndrome and motor-neuron diseases.

Locked in Syndrome is a condition in which a patient is aware and awake but cannot move or communicate verbally due to complete paralysis of nearly all voluntary muscles in the body except for the eyes.  Patients who have locked-in syndrome are conscious and aware, with no loss of cognitive function. 

There have been many studies which have attempted to allow those with these issues to communicate in the past, through means as varied as sniffing and eye-tracking using an assistive computer interface technology (such as Dasher).  These technologies allow a user to input via a pointing device as opposed to a keyboard. 

Further studies have involved direct brain interface mechanisms- but these are currently primitive and speculative (such as these).

Although there are no official statistics available, one estimate, which is based on National Institute of Health statistics on brain-stem strokes and survival information, puts the number at as many as 50,000 individuals in the United States alone (here).

Motor Neuron Diseases are a group of neurological disorders that selectively affect motor neurons, the cells that control voluntary muscle activity including speaking, walking, breathing, swallowing and general movement of the body. They are generally progressive in nature, and cause progressive disability and death.

Although MND is degenerative, it also presents the same communication issues for sufferers who maintain their consciousness and awareness, but lose their physical abilities.  Stephen Hawking is one of the most famous sufferers of MND, and he communicates using Dasher

WEEK ELEVEN: SCENES

SCENES refers to the communication of the value of the architectural fiction and looks at presence, identity, and the first person experience.


If the context is virtual communication, the interface fills the void of those who cannot connect to this communication sphere using traditional methods, by providing them a way to connect.

While the interface itself is virtual, interaction with it is somewhat physical. Users input information through their thoughts, as translated through a brain-scanning device. Users receive information via a graphic output device, such as a holographic screen or augmented contact lens.

WEEK ELEVEN: STAGE

STAGE refers to the architectural entity which is being presented.  This section was quite difficult for me to navigate as I am not creating "architecture" in it's traditional sense. The subsections of purpose, navigation and integrity helped me mold my response somewhat.

Communication satisfies the basic human need to relate to others. Those who
lack the ability to communicate have a real need which needs to be fulfilled.
The interface fulfills these needs by providing a way for users who lack these
abilities to communicate on the virtual level.

Navigation of the interface is performed through the use of brain scanning
technology. The computer program decodes user thoughts and converts these
to commands, which it then performs. These commands are view-able by the
user on a graphic interface which is displayed on a display medium.

The technology required for this is in its infancy, but is at the forefront of
current technological advancement.

WEEK ELEVEN: SCRIPT

I decided to take a step back and look at the requirements of the CRA in order to make sure I was addressing all that was needed within the assessment.  Generally, I try not to use the CRA as a checklist, but as the scope for our tutorial was so great, I need some boundaries.

SCRIPT looks at context in terms of reality and creativity, and requires a story to be constructed from these.

In terms of my project, I feel that my context is communication and relationships. Communication is the key to human relationships. Technological advancement has meant that people today are in communication with each other constantly, and it is commonly believed that this will only increase in the future. 

The internet has become central to human communication as it holds the data integral to communication technologies, meaning that physical communication is now falling second to virtual communication. My story is set in 2040, when I believe 99% of non face-to-face communication will involve internet-based virtual technology. This presents an opportunity for those who previously have not been able to communicate physically due to various disabilities, to communicate on a virtual level and join in the human arena.

WEEK TEN: TAKE A STEP BACK

This week my presentation  had to cover weeks nine and ten in terms of content (I was sick last week), and I was concentrating on the Communication Interface.

I then decided to research human consciousness in order to find a way for the interface to present information back to the user.  My issue was that although I could understand how user information was transferred to the interface and the  internet, I could not understand how to send it back. 

I came to a point where I could no go any further down this track, as it was beginning to get to the point of isolating the user from the real world and entering them into the virtual one only- which I did not want to do. I had to re-evaluate.

The above diagrams outline information transfer between the user, the interface and the internet.  The slides below go into further detail.

 During today's presentation, the main feedback I received was in regard to the fact that although I had a fair amount of research behind my idea, the idea itself did not really exist.

At first, I was a little concerned, but then I realised, I do have an idea- my idea is the interface, but the issue is that I have not communicated the idea properly.  For next week, then, I am going to have to look at my idea in terms of the CRA, as well as find a way in which to communicate exactly what my idea is in a simple way.

I think the first step to this would be to move away from the term "interface", but I'm not sure what to move to....

WEEK TEN: PRESENTATION IDEAS

In class, we have been encouraged to explore our ideas for the final presentation. From my understanding, we are to hand in an A1 panel, but the class seems somewhat obsessed with creating videos, and so I have decided to expand my skill base and do the same.  I guess, in creating a complex solution, as we are required to in this project, explaining using a video would be the most obvious response. 

My main concern is my lack of skills in this area, but I am armed with hours of youtube tutorials, coffee and a fair amount of sheer will and determination, so I hope I can make something of this.

I have done many hours of "research" (i.e. watching videos on youtube), in an attempt to find a style of presentation which would best explain my concept.  Initially, I wanted to show a person who was using the interface, however I am not sure this would give the auience a good understanding of what exactly it was, or how it worked, or what it aimed to provide.

I want a medium which is simple and easy to understand, in response to my concept which is, at times, difficult to follow and can be confusing, in an attempt to explain what I am trying to do.  After many hours of research, I came across the "animated infographic".

The first video I came accross was:

The style of this video really resonates with me- it has a playful quality to it, but is still informative.

I also really liked this video.  Although the style is similar to the AT&T animation, this one seems more "personable".  I like how these videos speak to the viewer, but the voice is secondary to the visual.

I liked the style of this short film, but feel like it may be too childish for my purposes.

This video was quite funny, but the style is maybe a little too light-hearted for my purposes.

This video was spectacularly beautiful and abstract, and presented an idea in a way I have not thought about before.

My next step is to understand how to animate text and vector images in aftereffects.

WEEK TEN: THE IMPORTANCE OF COMMUNICATION TODAY AND IN THE FUTURE

I have been finding it a little difficult to explain what exactly I am proposing, so thought it important to explain why I have chosen this path.  In order to do this, I will disucss the importance of communication to people.

Communication forms the basis of human relationships.  From an evolutionary point of view, communication was vital in avoiding predators and passing messages, and is used by both animals and humans alike.  Communication satisfies our constant need to relate to others, and have them relate to us.

Technological advancement has given us increased ways in which to communicate with each other, as shown in the video below:

Futurists have also postulated that in the future, our ways in which to communicate will increase dramatically.

The above video outlines one idea on a communication future, where experience will become the new reality, and where the internet will become the main holder of all communication and knowledge.

This video outlines both the past and future of mobile media, and describes 2.5billion users worldwide with mobile internet, and the implications of this.

The above video also outlines the future of technology.

It is important to outline one thing all of the videos have in common, and a commonality in a majority of future visions: the importance of communication.  Certainly, living in a world currently driven by the internet, communication is paramount.  Our access to knowledge and people is unprecedented, and with that has come an increased thirst for higher levels of communication with others.

There are, however, a number of people who cannot communicate with the outside world due to disability.  Although mentally, their minds are unaffected, their physical ability to communicate their thoughts and ideas is lacking.  Although technology is allowing the majority of people to increase their communication opportunities, these people seem to have been left behind. 

My idea, then, is to use the technologies I have previously mentioned, to allow these people to communicate in ways which have become second nature to the rest of us, in order to enable them to be part of the increasingly virtual world that we all live in.

http://communicationtheory.org/why-do-we-communicate/
http://www.blurtit.com/q8011353.html

WEEK TEN: WHAT IS THE INTERFACE?

The interface, in its simplest form, exists as a computer program which translates the brain activity of the user into data, which is then fed into the various outputs.  Similarly, the interface translates information from the outputs into images and sounds to be communicated to the user.

The interface exists as a GUI, which is controlled by specific commands of the user.  These commands would exist as specific thought patterns, which are interpreted by the scanner, and then translated into commands of the communication technologies.

A simplified example would be if a user was to send an email, they would perform the commands (thought patterns) to open the email interface, which would be presented to them graphically on their chosen display device.  The user would then compose the email using thought patterns, which would be displayed graphically, and then "send" the email.

When a reply email is received, the interface will display a graphic alert.  If the user then provides the command to view the email, it will be displayed at their request.

 The above graphic outlines the process.