Skip to content →

Author: cgerrish

Unemployed philosopher

Cognitive Science of the Real-time Web

Optical Illusion

I keep coming across bits and pieces of the picture of the human factors that will make up the real time web. This morning’s piece came from “Scientific American Mind.” On Sunday mornings I like to visit my local newsstand and look at magazines. Today it was the New York Review of Books for Samantha Power’s article on “The Democrats & National Security” and Scientific American for an article on “The Power of Stories.”

The question I’ve been thinking about is: what’s the minimum speed of the real-time web to create a smooth perceptual flow and enable natural conversation? This quote puts a piece in place:

The brain takes nearly one tenth of a second to consciously register a scene. But the scenery changes far more quickly than that when we move. How does our brain cope? By constantly predicting the future, posits Mark Changizi. This ability explains many visual illusions — The extra motion results from your brain estimating where the ellipses will be in several milliseconds.

The optical illusion at the top of this post works as follows: concentrate your attention on the dot in the center and then move your head toward the screen. And then pull back from the screen. There’s some extra perceptible motion that occurs. That’s the mind projecting future position.

You can view other optical illusions and some explanations here.

Comments closed

Modern Hieroglyphics: Writing Fluidly in a Picture Language

Hieroglyphs

What must the world be like in order for a person to understand what the phrase “copy and paste” means? As we look about us, we can distinguish between those things that can be “copied and pasted,” and those things that cannot. That bunch of flowers growing in the pot in my garden cannot be copied. I can grow similar flowers, but I can’t grow identical flowers.

While mechanical reproduction at the industrial level creates many seemingly identical products, the pen I write with, or the coffee mug from which I’m sipping– these things cannot be “copied and pasted.” As we continue to look about, our inclination would be to skip directly to the digital; for surely that’s the world from which “copy and paste” comes. But in our haste, we would be passing over vast continents.

“Copy and paste” makes sense to us because its most common usage is not digital. Its basis is in our language– both spoken and written. Language, words, can be quoted. I can copy a phrase, a prayer, a poem, a joke, a hint, an expression of emotion that I overhear somewhere and paste it into my speech. I can copy something identically, or I can make it my own by saying something similar. Our laws regarding copyright establish a legal and economic framework for the copying of language.

One of our primary activities as humans is to pass along news. “What’s going on in the world of politics today?” We scan through all the news we’ve consumed during the day– copying and pasting to create the story we want to tell. The filtering that takes place as we scan is both the discovery and creation of the value of information in the context of specific audiences.

As we turn to the digital, the obvious first stop is the editing program– the word processor. This tool augmented our ability to copy and paste text, to rearrange it, to treat it as a plastic medium. There’s a kind of flow to building and constructing that text editors make possible. Think about the much more mechanical process involved with using a fountain pen, typewriter, scissors and a glue pot.

The metaphor of editing has been extended to image, video and sound manipulation; and if we think about it, to the local file system itself. The desktop is an editor for pointers to files– here also, we copy, paste and delete. It’s with that editor that we’ve created ambiguity around the ownership status of digital media.

To preserve a particular economic algorithm, there’s an attempt to limit the file-system editor’s ability to “copy and paste” certain kinds of files. These kinds of limitations don’t exist with any other editor. Imagine a text editor that was prohibited from copying and pasting copyrighted material. Imagine a language that didn’t allow quotation.

When Ray Ozzie surfaced for a moment before being consumed by the organizational, political and directional turmoil of Microsoft, he developed and demo’d “copy and paste” at the level of the web. Live Clipboard was aimed at employing a simple metaphor for moving microformatted data from one place to another. Programs like Evernote allow me to copy sections of a web page with very loose HTML formatting, and paste them into my digital notebooks. In the world of social media we look at the social graph we’ve built and we’d like to copy it from this service and paste it into that service. Instead we find ourselves in the position of Medieval monk copying a manuscript with a quill pen.

We capture our thoughts and impressions through text, we scribble it in notebooks, we type it on sheets of paper and on to glowing screens. Our text becomes hypertext and the exoskeleton of structured markup encapsulates our language. Capturing sound, image and video used to be the province of professionals, but now most “telephones” can do this. Body language, gestures and intonation can now provide color to the messages we pass back and forth.

This is the point in time we need the pencil that Marc Canter created. Copy and paste are functions of an editor and they operate on pointers and abstractions to the world around us. We now have the Network and bandwidth to return to early days of multimedia and the toolsets that were developed for the production of CD-ROMs.

On the professional end, these tools have become more and more sophisticated. Apple has done a nice job providing tools for the consumer. Where Brian Eno had the insight that the recording studio could be a compositional tool, we now need a recording studio we can carry around with us and that resides on our (i)Phones. An initial model is the way the Flip Video Camera includes editing software on the hardware device. As we capture sound, narration, and still/moving images with our “telephones,” we need to be able to dash off a note in a picture/sound language. That device we carry around should be able to read, write and transmit over the Network. Actually, it already can. It already does. But there’s so much more.

Of course, literacy will always be an issue. But that’s why there are pirates:

6 Comments

The Guitar Makes Dreams Weep

Steinway Piano

Joan Nagano at the Piano

Joan Nagano and Kay Stern after the performance

It’s a distinct pleasure to see a musical performance of a very high level in the comfort of a home. Joan Nagano, piano, and Kay Stern, violin,  wanted to run through their program in front of an audience before performing at a chamber music festival in Tahoe. There were about 15 of us in this small preview audience. The program featured pieces by Boccherini, Paganini, Beethoven, Poulenc, Ben-Haim and Zarzycki.

The entire program was engaging and beautiful, but I want to focus on the Sonata for Violin and Piano by Poulenc. Before each piece, Kay Stern, who also serves as Concertmaster for the San Francisco Opera Orchestra, provided some context for the music. Here’s the text she read:

Several of Poulenc’s earlier attempts at writing violin sonatas and string quartets ended in the sewers of Paris, and the only string music of this nature which finally passed the composer’s fastidious scrutiny were the Sonata for violin and piano, and the Sonata for cello and piano (1948). The violin sonata was the result of pressures from the young violinist Ginette Neveu to write a violin piece.

Written during the German occupation of France, this work was boldly dedicated to the memory of Federico García Lorca – a Spanish poet murdered by fascist troops because of his liberal opinions and homosexuality. Poulenc had set three Lorca poems as songs in 1937. The violin sonata was intended as a personal statement on the poet’s senseless death. The middle movement was meant to be “vaguely Spanish” – evoking the distant guitars and Moorish cantilena of Lorca’s Spain. The concluding Presto tragico is as violent and brusque as Lorca’s death.

The chamber music of Poulenc is known for its melody and accessibility, this piece was challenging both in its construction and its emotional territory. The three movements take you on a emotional journey through darkness and violence. Perhaps there’s something about witnessing music like this in a domestic setting that sharpens the connections. For the duration of the performance there was crystal clear visibility into the haunting, tragic story of the murder of the poet and the tumultuous landscape of war. It was only as the last note rang out that the double parlor of a flat somewhere in San Francisco slowly came back into focus, and the audience was returned to their seats.

The Guitar
makes dreams weep.
The sobbing of lost souls
escapes from its round mouth.
 And like the tarantula
it weaves a giant star
to capture sighs
that float in its black
cistern of wood. 

Federico García Lorca

Comments closed