Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns

Martin A. Giese; Barbara Knappmeyer; Heinrich H. Bülthoff

doi:10.1007/3-540-36181-2_54

Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns

Martin A. Giese, Barbara Knappmeyer, Heinrich H. Bülthoff

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

We present a method for the synthesis of sequences of realistically looking human movements from learned example patterns. We apply this technique for the synthesis of dynamic facial expressions. Sequences of facial movements are decomposed into individual movement elements which are modeled by linear combinations of learned examples. The weights of the linear combinations define an abstract pattern space that permits a simple modification and parameterization of the style of the individual movement elements. The elements are defined in a way that is suitable for a simple automatic resynthesis of longer sequences from movement elements with different styles. We demonstrate the efficiency of this technique for the animation of a 3D head model and discuss how it can be used to generate spatio-temporally exaggerated sequences of facial expressions for psychophysical experiments on caricature effects.

Original language	English
Title of host publication	Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings
Editors	Heinrich H. Bulthoff, Christian Wallraven, Seong-Whan Lee, Tomaso A. Poggio
Publisher	Springer Verlag
Pages	538-547
Number of pages	10
ISBN (Electronic)	9783540001744
DOIs	https://doi.org/10.1007/3-540-36181-2_54
Publication status	Published - 2002
Event	2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002 - Tubingen, Germany Duration: 2002 Nov 22 → 2002 Nov 24

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	2525
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002
Country/Territory	Germany
City	Tubingen
Period	02/11/22 → 02/11/24

Bibliographical note

Publisher Copyright:
© Springer-Verlag Berlin Heidelberg 2002.

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/3-540-36181-2_54

Cite this

Giese, M. A., Knappmeyer, B., & Bülthoff, H. H. (2002). Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns. In H. H. Bulthoff, C. Wallraven, S.-W. Lee, & T. A. Poggio (Eds.), Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings (pp. 538-547). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2525). Springer Verlag. https://doi.org/10.1007/3-540-36181-2_54

Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns. / Giese, Martin A.; Knappmeyer, Barbara; Bülthoff, Heinrich H.
Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. ed. / Heinrich H. Bulthoff; Christian Wallraven; Seong-Whan Lee; Tomaso A. Poggio. Springer Verlag, 2002. p. 538-547 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2525).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Giese, MA, Knappmeyer, B & Bülthoff, HH 2002, Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns. in HH Bulthoff, C Wallraven, S-W Lee & TA Poggio (eds), Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 2525, Springer Verlag, pp. 538-547, 2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002, Tubingen, Germany, 02/11/22. https://doi.org/10.1007/3-540-36181-2_54

Giese MA, Knappmeyer B, Bülthoff HH. Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns. In Bulthoff HH, Wallraven C, Lee SW, Poggio TA, editors, Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. Springer Verlag. 2002. p. 538-547. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/3-540-36181-2_54

Giese, Martin A. ; Knappmeyer, Barbara ; Bülthoff, Heinrich H. / Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns. Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings. editor / Heinrich H. Bulthoff ; Christian Wallraven ; Seong-Whan Lee ; Tomaso A. Poggio. Springer Verlag, 2002. pp. 538-547 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{3d3c501345444efd8d35e9bf62ff6ff7,

title = "Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns",

abstract = "We present a method for the synthesis of sequences of realistically looking human movements from learned example patterns. We apply this technique for the synthesis of dynamic facial expressions. Sequences of facial movements are decomposed into individual movement elements which are modeled by linear combinations of learned examples. The weights of the linear combinations define an abstract pattern space that permits a simple modification and parameterization of the style of the individual movement elements. The elements are defined in a way that is suitable for a simple automatic resynthesis of longer sequences from movement elements with different styles. We demonstrate the efficiency of this technique for the animation of a 3D head model and discuss how it can be used to generate spatio-temporally exaggerated sequences of facial expressions for psychophysical experiments on caricature effects.",

author = "Giese, {Martin A.} and Barbara Knappmeyer and B{\"u}lthoff, {Heinrich H.}",

note = "Publisher Copyright: {\textcopyright} Springer-Verlag Berlin Heidelberg 2002.; 2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002 ; Conference date: 22-11-2002 Through 24-11-2002",

year = "2002",

doi = "10.1007/3-540-36181-2_54",

language = "English",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "538--547",

editor = "Bulthoff, {Heinrich H.} and Christian Wallraven and Seong-Whan Lee and Poggio, {Tomaso A.}",

booktitle = "Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings",

}

TY - GEN

T1 - Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns

AU - Giese, Martin A.

AU - Knappmeyer, Barbara

AU - Bülthoff, Heinrich H.

N1 - Publisher Copyright: © Springer-Verlag Berlin Heidelberg 2002.

PY - 2002

Y1 - 2002

N2 - We present a method for the synthesis of sequences of realistically looking human movements from learned example patterns. We apply this technique for the synthesis of dynamic facial expressions. Sequences of facial movements are decomposed into individual movement elements which are modeled by linear combinations of learned examples. The weights of the linear combinations define an abstract pattern space that permits a simple modification and parameterization of the style of the individual movement elements. The elements are defined in a way that is suitable for a simple automatic resynthesis of longer sequences from movement elements with different styles. We demonstrate the efficiency of this technique for the animation of a 3D head model and discuss how it can be used to generate spatio-temporally exaggerated sequences of facial expressions for psychophysical experiments on caricature effects.

AB - We present a method for the synthesis of sequences of realistically looking human movements from learned example patterns. We apply this technique for the synthesis of dynamic facial expressions. Sequences of facial movements are decomposed into individual movement elements which are modeled by linear combinations of learned examples. The weights of the linear combinations define an abstract pattern space that permits a simple modification and parameterization of the style of the individual movement elements. The elements are defined in a way that is suitable for a simple automatic resynthesis of longer sequences from movement elements with different styles. We demonstrate the efficiency of this technique for the animation of a 3D head model and discuss how it can be used to generate spatio-temporally exaggerated sequences of facial expressions for psychophysical experiments on caricature effects.

UR - http://www.scopus.com/inward/record.url?scp=84931391538&partnerID=8YFLogxK

U2 - 10.1007/3-540-36181-2_54

DO - 10.1007/3-540-36181-2_54

M3 - Conference contribution

AN - SCOPUS:84931391538

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 538

EP - 547

BT - Biologically Motivated Computer Vision - 2nd International Workshop, BMCV 2002, Proceedings

A2 - Bulthoff, Heinrich H.

A2 - Wallraven, Christian

A2 - Lee, Seong-Whan

A2 - Poggio, Tomaso A.

PB - Springer Verlag

T2 - 2nd International Workshop on Biologically Motivated Computer Vision, BMCV 2002

Y2 - 22 November 2002 through 24 November 2002

ER -

Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example patterns

Abstract

Publication series

Other

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this