Composing With Media [MMDD396]

Review of course objectives, readings, assignments, projects, and grading.

Blogging as "hypomnemata": a medium for research, discourse, and documentation. Sign-up on Blogger.com.

"Collect the already-said... a means to establish as adequate and as perfect a relationship of oneself to oneself as possible." - Foucault

Max/MSP/Jitter from Cycling '74: resources, listserve, software

Exhibition: America's Grave, American University Museum

Reading Assignment (due 1/30): Dick Higgins, Intermedia; write blog summary.

Writing Assignment (due 1/30): What is Indeterminacy? Discuss in your blog the difference between real-time, non-linear media experience and recorded, linear media; prepare a discussion question.

Continue reading "Introductions" »

Posted by Randall at 12:34 PM | Permalink

The intermedial is the medium that lies between pure media, that connects the media, that reveals relationships between media and the way in which media interact with one another.

Discussion of Intermedia practice.

Overview of data translation, control strategies and algorithmic composition.

Project I: Intermedium - we will explore the fundamental relationship between sound and image through the translation of media.

Continue reading "Intermedial" »

Posted by Randall at 01:02 PM | Permalink | Comments (0)

Work on audio control of video exercise in Max/MSP/Jitter.

Reading Assignment (due 1/30): Blog summary of Sounds From Shapes, an article by Golan Levin. Also see Levin's Messa da Voce.

Project Assignment (due 2/2): Creation of original algorithmic composition using the following objects: sfplay~, jit.qt.movie, jit.brcosa. For additional help in Max, work through the first five Max Tutorials.

Exhibition Assignment (due 2/6): Blog Summary of Interface show, Fraser Gallery, Bethesda, prepare discussion question. Gallery is located at: 7700 Wisconsin Avenue, Suite E, Bethesda, MD, (301) 718-9651, Tuesday - Saturday: 11:30am - 6pm

Posted by Randall at 09:21 AM | Permalink

Discussion of algorithmic composition and intermedial interaction between sound and image.

"The responsive environment has been presented as the basis for a new aesthetic medium based on real-time interaction between men and machines." - Myron Krueger

Discussion of the essay Sounds from Shapes and the artwork Messa di Voce, Golan Levin. He presents virtual instruments that use the interior and exterior contours of hand silhouettes, as detected and analyzed by a computer vision system, to create and manipulate sound and animated imagery simultaneously. Here the body is used as a control instrument to initiate an interaction between sound and image.

Max/MSP/Jitter Assignment (due 2/2): Creation of original algorithmic composition using the following objects: sfplay~, jit.qt.movie, jit.brcosa, jit.rota

Viewing Assignment (due 2/6): Review the following interviews with artists from the Cycling 74 Website, and prepare questions for discussing their artistic approaches to Max/MSP/Jitter:
David Tinapple, video manipulation
Barney Haynes, machine control
Ali Momeni, sensor interfaces

Continue reading "Algorithmic Intermedial Composition" »

Posted by Randall at 09:27 AM | Permalink

Work on Max project and include rotation object. Use any one of the sound files passed out in class or one of your hand. Use the Bush video file or one of your own. Hand in final patch on Tuesday (2/6) on CD-ROM.

Posted by Randall at 02:48 PM | Permalink

Media art challenges the passive relationship between audience and artwork, introducing a participatory role for the viewer.

Despite some theories to the contrary, it is presumed that making art is active and viewing art is passive. Radical developments in communication technology, such as the marriage of image, sound, text, computers and interactivity, have challenged this assumption. - Lynn Hershman, from Fantasy Beyond Control

Update on Cycling '74 student software copies

Discuss Interface show at Fraser Gallery

Discuss Cycling '74 interviews with Max Artists

Reading Assignment (due 2/13): Fantasy Beyond Control by Lynn Hershman

Accessing the Audio Tech library: musictech.katzen.american.edu (see me for id, password)

Project II (due 2/13): Keyboard Music - exploration of viewer interaction and its impact on the conceptualization, creation and experience of the work. We will map the computer keyboard to a soundscape.

Project Assignment (due 2/9): sketch out a diagram that indicates how your Max patch will be constructed, basing your chart on the example handed out in class.

Blog Assessment (due 2/9): be sure your blog is up to date with summaries of readings, exhibitions, and any other thoughts related to composing with media. Be sure and incorporate relevant images and links. Here is an example from a previous Multimedia course.

Continue reading "Participatory" »

Posted by Randall at 01:21 PM | Permalink

Lab: work on Keyboard Music project

Additional description: the Keyboard Music project involves the mapping of sounds to the computer keyboard, creative an interactive environment that is intuitive and engaging. A viewer-participant will interact with the work. Use any set of sounds and map them to the keyboard, keeping in mind how the fingers move across the keyboard, ways of creating sequences of events, transposing with adjacent keys, such as in the example I gave. The fingers need to move easily through the soundscape, finding patterns, rhythms, relationships, juxtapositions.

Editing sounds with Quicktime Player

Posted by Randall at 02:48 PM | Permalink

Project III (due 2/20): Scratch Video - Involves the control of video via the mouse, emulating the scratch technique used by DJ's. A viewer-participant will interact with the work. Use any video and map mouse control to parameters that include frame rate, volume, jit.brcosa controls, and jit.rota controls , keeping in mind how viewer moves the mouse in the X / Y plane. There should be a logical gestural movement through video frames, sound and the manipulation of the parameters.

Projects II and III will be performed in class on 2/20.

Posted by Randall at 12:19 PM | Permalink

Finalize Max authorizations

Work on scratch video projects

Posted by Randall at 01:47 PM | Permalink

The word DADA symbolizes the most primitive relation to the reality of the environment; with Dadaism a new reality comes into its own. Life appears in a simultaneous muddle of noises, colours and spiritual rhythms, which is taken unmodified into Dadaist art, with all the sensational screams and fevers of its reckless everyday psyche and with all its brutal reality. - From my notes on the historical avant-garde.

DADA was an artistic movement in the Post World War I era of the 20th century that subverted the aesthetics and the techniques of the day. One of these techniques was collage, in which various texts and image were combined or "recombined" in a seemingly nonsensical or random manner. Since then, the collage technique has been used by the avant-garde, in part, for the appropriation and transformation of cultural imagery and mass media.

Assignment (Midterm project, due 3/6): Multimedia Combinatory Poems inspired by DADA

Exhibition Assignment (due 3/2): Visit the National Gallery of Art DADA show that just opened on Sunday. View the works with the notion of collage, appropriation, and transformation in mind, and write a summary of the exhibition, considering how the DADAists subverted artistic expression with these techniques. Consider why the artists referred to their work as "anti-art."

Reading Assignment (due 3/2): Review the National Gallery of Art DADA feature and write a summary specifically about the "techniques" section.

Continue reading "Recombinatory" »

Posted by Randall at 01:28 PM | Permalink

Dan Busey will give a lecture on DADA.

Posted by Randall at 07:22 AM | Permalink

Lab Session: work on projects.

Posted by Randall at 07:25 AM | Permalink

Lab session: work on projects

Posted by Randall at 07:28 AM | Permalink

Midterm Critique: review recombinatory projects

Notes on the critique: We have discussed a number of topics related to interactive media: gestural control, algorithmic composition, indeterminacy, data translation, etc. In our current midterm project, we are exploring the recombinatory aspects of sound, image, and text, using DADA sensibilities, technique and aesthetics to guide the process. With that in mind, how does your project explore/connect with these ideas? From the viewer's standpoint, how does the interaction draw them into the experience of the work? How does the computer function as a collaborator in the viewing/listening experience. What were your objectives in combining text, sound and image elements. What was the desired effect? Humor? Surprise? Dramatic impact? Absurdity? Nonsense? Political commentary? Satire? Comic relief? Any of these are valid or perhaps you had something else in mind. From a compositional perspective, we are interested in how the media elements interact with one another in relation to the viewer interaction. Your work and explanation of the work should take the dynamics of this interaction into account.

Midterm assignment (due 3/9): Blog entries of weekly readings/artworks/discussions are due for review. Please incorporate images and links wherever it is useful to illustrate your discussion. Write about concepts explored in each topic: how do the ideas presented in the readings explore/confront/elaborate inform and influence your media work with Max? How have compositional techniques explored in class related to the exhibitions? Have any of the works you have seen incorporated techniques of interactivity, algorithmic composition, indeterminacy, interdisciplinary thinking? Your entries need to include the following readings and exhibitions: America's Grave at AU Museum; Dick Higgins (Intermedia); Golan Levin (Sounds from Shapes); Interface Show at Fraser Gallery; Cycling '74 interviews; Lynn Hershman (Fantasy Beyond Conrol); DADA Show at the National Gallery of Art.

In your summaries cite references, links to sources, examples and Websites. Each summary should be approximately 150 - 300 words. Check spelling and grammar.

Posted by Randall at 01:34 PM | Permalink

Midterm Critique: complete presentation of recombinatory projects

Posted by Randall at 07:32 AM | Permalink

The behavioral in art is primarily motivated to initiate a dialogue with the viewer, to establish behavioral patters in the work that are fluid, changing, and dynamic.

"The necessary conditions of behaviourist art are that the spectator is involved and that the artwork in some way behaves." - Roy Ascott, Behaviourist Art and the Cybernetic Vision

Project V: Digital Self-Portrait - the final project explores the behavioral, the way the media composition "behaves," exhibits intelligent traits. For this project we will construct an environment in which the viewer can manipulate the digital self-portrait of the artist in both the visual and audio domains.

Examples:

Narcissus Well project (Randall Packer, et al): use of spherical mirrors coupled with real-time digital manipulation to transform the image of the viewer. In this project, Jitter is used to manipulate the position of the viewer's image captured live, and apply digital effects that extend the mirror distortions. The work explores the experience of dematerialized (disembodied) presence in the virtual domain.

Static by Brandon Morse (see exhibition assignment below): a complex systems that allow abstract elements to interact with one another. Each visual element exists within a set of rules and those elements exist within a virtual environment built by Morse. Only the element behaviors have been pre-determined and not the movements themselves.

Works by Brandon Morse, exploring the behavioral in video animation.

Reading: Behaviourist Art and the Cybernetic Vision by Roy Ascott

Exhibition: BRANDON MORSE : Static

March 17 - April 29, 2006
Conner Contemporary
1730 Connecticut Ave. NW. 2nd floor

Assignment: Research (due Mon. March 27) - exploration of ideas, concepts, readings, artworks, and technical capabilities to be considered for the project. The assignment will be to write a concept statement describing your project that takes into account the following: main concept (how will you present yourself, texts, sounds, etc.), user interaction (how will the viewer interact with the self-portrait, gestural control, etc.), behavioral elements (how will the portrait behave, what kind of transformations will occur, etc.), , technical execution (refer to the objects you will use, parameters invoked, how will the patch be constructed, how will data (in concept) move from viewer interaction to the visual and audio transformations, etc.

Continue reading "Behavioral : Digital Self-Portrait" »

Posted by Randall at 12:45 PM | Permalink

Discuss the Brandon Morse show at Conner Contemporary.

How does his use of algorithmic behavioral processes engage the viewer over time, as opposed to pre-recorded sequencing?

Reactive Self-Portraits by Mogens Jacobsen / Artnode DK Group - By using the term "sketch," I am not referring to the traditional drawing process in the visual arts. This series is an experiment in sketching software. I recreate the creative process by changing aspects of an algorithm, and then employ the same visual raw material to make the portrait.

Review project research, concepts, ideas, etc.

Final project discussion:

Transformation: we are looking at Max/MSP/Jitter objects that carry out a transformative interpretation of the original. In the audio domain, we are reviewing digital delay and variable sample playback to achieve time-based changes that involve the speed/rhythm of the sound in relation to how the sound is broken down into fragments. In the visual domain, we have looked at the chromakey effect which allows superimposition through transparency according to color. Our objective is to use these processes, in addition to the objects we have already studied, to introduce behavioral characteristics in the portrait that transform its original/natural state. How might the audio act on the visual and vice-versa, as we have seen with forms of data translation. How might the gestures of the viewer act on the behavioral characteristics of the portrait. It is through digital processing that we are able to apply a fluid, changing, transformative quality to our digital portraits.

Assignment: Design (due Mon. April 3) - Flow chart sketch of your Max patch, which objects will be used, how will they operate on one another, how does the viewer interaction function. This patch does not need to be fully functional but shows the general layout of how your objects will operate. Discuss how you intend or are interested in achieving specific behavioral qualities in your portrait. How do you imagine the transformations? Which objects will you use to achieve these transformations and how will they operate on the image/sound. Look back through previous handouts to refresh your memory of objects and processes already used. Look through the Tutorials (I have place them on the server) for ideas. Finally, write out in script form what you will read, do, execute in your video / audio material. Remember you don't need a lot of material to stretch your sound/video out. Less is more! Be very economical with the material, using interesting processes to extend the possibilities.

Posted by Randall at 11:37 AM | Permalink

Discussion of reading: Roy Ascott, Behaviorist Art and the Cybernetic Vision

"The dominant feature of art of the past was the wish to transmit a clearly defined message to the spectator as a more or less passive receptor, from the artist as a unique and highly individualised source... the vision of art has shifted from the field of objects to the field of behavior and its function has become less descriptive and more purposive." - Roy Ascott

"The necessary conditions of behaviorist art are that the spectator is involved and that the artwork in some way behaves." - Roy Ascott

The behavioral in art is more inclusive than "visual," it encompasses all the media and it takes into account the response of the viewer. There is a reciprocal dynamic that joins the viewer, artist, and artwork in a participatory relationship. How does this change the way we experience the work?

The artwork stays in a perpetual state of fluidity and transition, it is not fixed, it is not predictable, it is indeterminate in respect to its outcome (a departure from how previous artists might have used indeterminacy in respect to the work's creation). How might we then define a work created with algorithmic technique?

"The modern means of communication, of feedback and viable interplay - these are the content of art." The artwork then becomes a system of input/output, the operations of the viewer/performer act on the work and alter its outcome. How does this idea change the role of the viewer?

"The art of the organization of effects." What is meant by this? How does this describe our work with algorithmic processes using Max/MSP/Jitter.

Posted by Randall at 10:29 AM | Permalink

Review design concepts, flow charts, scripts, etc.

Assignment: Production Phase I (due Mon. April 10) - Begin constuction of patches, record video / audio material for projects. We will use class time to videotape, photograph, record your examples. Remember, you only need 1' - 2' of material so keep it very brief. Be sure you purchase mini-DV tape for video recordings and any other necessary supplies / equipment such as a Web cam. Video cameras will be made available from the New Media Center, but they need to be checked out in advance.

Posted by Randall at 11:42 AM | Permalink

Individual reviews of sketches / project descriptions

Construction of patches; record video / audio material for projects.

Note: all sketches and project descriptions are due today at the latest! The sketch needs to be handed in and will be considered as part of the final grade. I am looking for a strong conceptual foundation / technical concepts, which will be excuted in the realization of the project.

On Monday, April 10 we will have individual reviews of works-in-progres, I want to see progress with patch layout and media material to be used in the project.

Reminder: Mark Amerika, Monday, April 10, 4 pm, Katzen Recital Hall. Mandatory!

Posted by Randall at 10:12 AM | Permalink

Review of patches, recorded visual and audio material.

Assignment: Production Phase II (due Mon. April 17) - Construct your patch in modules so that you can experiment with the material you have generated, carrying out transformations, testing parameters, etc. This relates to the example I have been showing which contains various sub-patches, each of which can be tested and modified independently of one another.

Mark Amerika: 4:00 pm, Recital Hall, Katzen Arts Center
Required! Be there! It will turn your head around!!
250 word review posted on your blog is due Tuesday, April 11.

Posted by Randall at 11:44 AM | Permalink

Discussion of Mark Amerika's "Digital Personas" lecture. Question: What does Mark mean by digital personas in the context of on-line fiction. How is this different than characters developed in traditional fiction? See Grammatron and read about the character Abe Golam, for example.

Student Evaluations

Review of Listen object for speech recognition in Max.

Review of media material for digital self-portrait projects.

Assignment: have individual modules working for next Monday.

Posted by Randall at 01:01 PM | Permalink

Review individual modules and media material.
Setup appointments for individual tutorial sessions (critique only in class).

Assignment: Production Phase III (due Mon. April 24) - Integrate your patch so that you have all the modules working together.

Write blog summary about media works in AU Museum by Dan Busey and Holly Parker (MFA Thesis Exhibition, 1st Floor), as well as works by Lynn Hershman and Tamiko Thiel (Visual Politics : Art of Engagement, 3rd Floor). Public Opening, April 19, Artists Reception, Saturday, April 22, 6 - 9 PM.

Posted by Randall at 11:52 AM | Permalink

Preparation for submitting work to the Multimedia On-line Gallery.

The Multimedia program in the Department of Art is launching the Multimedia On-line Gallery to showcase student works. Each student enrolled in a multimedia course will participate by submitting a single work created during the semester. All submissions must be complete and uploaded no later than May 1, 2006.

Stage 1: Preparation (due Thursday, April 27)

(1) Select one of your works created during the Spring 06 semester.
(2) Write a 25 word short, concise summary of the work
(3) Write a 200 word long description of the work that gives a conceptual and technical overview
(4) Create a 350px X 350px .jpeg image that best represents the work
(5) Create a 75px X 75px .gif thumbnail image from the larger image (do not reduce, crop out)
(6) Optional: select any other graphical, audio, or video documentation. Audio or video files must not be larger than 5 Mb each. Graphics no larger than 640px X 480px and in .jpeg format. Write a 15-word caption for each media.

Posted by Randall at 09:16 AM | Permalink

Individual critiques of integrated projects with all media content in place. You need to be able to demonstrate overall concept and functionality of the patch for critical feedback.

Assignment: Production Phase IV (due Mon. May 1) - Present to the class a working version of your project for critique and feedback so that final changes and improvements can be made for the final critique on Mon. May 8.

Posted by Randall at 11:53 AM | Permalink

Individual critiques of integrated projects with all media content in place. You need to be able to demonstrate overall concept and functionality of the patch for critical feedback.

ssignment: Production Phase IV (due Mon. May 1) - Present to the class a working version of your project for critique and feedback so that final changes and improvements can be made for the final critique on Mon. May 8.

Posted by Randall at 09:53 AM | Permalink

Multimedia On-line Gallery
http://multimedia.american.edu/gallery

Instructions for project submission

Gallery created by John Keleher, graduate student in Computer Science (john.keleher@american.edu)
These instructions are located @ http://multimedia.american.edu/showcase/instructions.txt

Continue reading "Multimedia On-line Gallery" »

Posted by Randall at 12:59 PM | Permalink

Individual Critiques in preparation for Final Critique (due Mon. May 8)

Blogs must also be completed by Mon. May 8. Entries for 2nd half of the Semester:

(1) Roy Ascott, "Behavioral Art and the Cybernetic Vision" [Multimedia: From Wagner to VR]
(2) Brandon Morse show at Conner Contemporary
(3) Mark Amerika lecture: "Digital Persona"

Posted by Randall at 12:20 PM | Permalink

Critique of final projects.

Posted by Randall at 12:58 PM | Permalink | Comments (0)