Projection Mapping on Spatial Objects

What we do and who we are?

For the past years we have been working with different projects that usually involve

• Graphic design
• Programming
• Projection mapping
• Electronics

.. as well as creating art installations and

• VJ-ing
• Curating
• Organizing workshops
• And audiovisual events

Irina Spicaka

Irina holds BA and MA in Visual Communication and Audiovisual Arts, has studied at the Art Academy of Latvia and Brera Academy in Milan, Italy. In her MA thesis, she was focusing on projection mapping, generative art and audiovisual composition.

Irina works as a graphic designer, curator as well as journalist in fields related to art, business and technology.

Krisjanis Rijnieks

For the past few years, Krisjanis has been exploring different media, programming languages and uses of technology and finally has arrived to a point where he can see how to finally complete his MA studies.

He is a student at the New Media MA programme of the Aalto University of Art, Design and Architecture in Helsinki and also has a background in painting.

CodeBark and CC4AV

We run a small digital media studio CodeBark and are also developing the CC4AV (Creative Coding for Live Audio and Visuals) platform that works as a placeholder for workshops and other activities that we have done in Helsinki, Riga and Helsingor (Click Festival) so far.

We are also collaborating with

• School of Machines
• Fab Lab Berlin
• Betahaus Berlin

Projection Mapping

Multiple Meaning of Projection Mapping

The term mapping highlights the role of space in the context of visual art as this term includes a function – real time projections adjusted to spatial objects.

Projection mapping or real time projections adjusted to spatial objects is a recently created set of electronic audio visual media methods which allows to surpass standard-size projections multiplying the picture, as well as to adjust the picture for different surfaces.

Why It Has Been Invented?

The reason why the projection mapping technique was invented and developed further was a problem when there was no place for a screen at an event venue. The projector could also be put in a place somewhere in the room where the beam of light breaks partially on the ceiling, partially on one wall and plus on some other surface, thus being absolutely useless. There was no appropriate software at that time yet and specialists of the field worked out – if gamers had various advanced possibilities for using a room in 3D environment then VJs could use it dividing the room by walls and thus providing a more in-depth overview – getting beyond the classic rectangular screen.

In 2011 artists started using this method in their works and companies like Microsoft started experiments with it as a serious, progressive technology. Nowadays if you are skilled enough you can make your own app and use it in your work and share it with others.

How it can be categorized

Projection mapping can be subdivided into two basic types:

1) Projections meant for particular surfaces
2) Projections adjusted to the surfaces

By first subtype we usually understand installations, large scale projections on architecture, stage design and objects of art, as this subtype does not include in itself texturizing free spaces. The video material is prepared so that it can be shown in one go.

The second subtype is more experimental, suitable for real time performances and Vjing — the process of texturizing surfaces includes remixing samples, cutting out and adjusting fields to various surfaces.

Back to the first type it should be noted that when making projections for certain surfaces, the work is first done in 3D and animation software — classical animation methods are applied, such as lightning and special effects, narrative. The most classic example is projection mapping on architectural facades used at light festivals. The buildings are modeled first (or ready-made, modeled prototypes of them are used) and the story is created taking into consideration the design of the particular building. The process is connected with very accurate work where each mistake (let it be no more than a millimeter) both, in animation process or in the projection on the particular surface can be seen as a bias which looks like a defect. Therefore this process cannot be associated with real time performance.

Where projection mapping can be used?

• Stage Design involved in Vj-ing (inluding Light Mapping )
• Audiovisual Performance
• Art Installation
• Scenography and Motion Art
• Large Scale Projections on Architecture
• Window Display and Store Design

Tools

Decent software for creating media content and projection mapping.

3D Modeling tools

Projection Mapping

Visual programming languages

Text based programming languages

Game Engines

Frame-based animation

Protocols

Software that can bridge visual output from one software to another in real-time.

Tips and Tricks

Best practices from experience.

1 Test it first

Before becomming too artistic, test if the technology works as intended.

2 Backup working versions

If your solution works, save it somewhere safe so when you continue to add changes, you can always switch back to the version that actually did work.

3 Know your surface

The more precise you will know the projection surface, the better. Especially when mapping outdoors on buildings.

4 Sketching helps

Make sketches and storyboards before doing it for real. Going through the process that way initially will help you overcome difficulties before you encounter them in the production process.

5 Always have your own adaptors

And cables. It might save you as well as others. Always have an extra cable and adaptor. It can make you the hero of the day. Or night.

6 No screensavers

Switch off screensavers and sleep for both, power and battery modes, on your laptop.

7 Cold corners

Disable hot corners or Exposé as it ruins the magic when a spectator notices what operating system are you using or that you have the same mess on the desktop as you have.

8 No instant messaging

Disable Skype or any other kind of messenger or service that tends to irritate you when least necessary.

Workshop

What do we do now?

Summary

We are going to use our computers and available projectors to projection map a surface that has been prepared for this workshop.

A surface?

The surface for projection mapping has it's story on it's own. It has been created in Blender and then made real with the help of a lasercutter.

How is this going to work?

1. Split into groups.
2. Download and install software.
3. Create image or animation source.
4. Have fun with projection mapping!

Software

We are going to use MadMapper during this workshop. Demo version is free, but you won't be able to save your projects with it.

Use LPMT or VPT instead if you like free software.

MadMapper Cheatsheet

A couple of images that have been made to make the beginning of your mad mapping life easier.