Bruce Gooch
Skip Abstract Section
Abstract
We present a method for creating black-and-white illustrations from photographs of human faces. In addition an interactive technique is demonstrated for deforming these black-and-white facial illustrations to create caricatures which highlight and exaggerate representative facial features. We evaluate the effectiveness of the resulting images through psychophysical studies to assess accuracy and speed in both recognition and learning tasks. These studies show that the facial illustrations and caricatures generated using our techniques are as effective as photographs in recognition tasks. For the learning task we find that illustrations are learned two times faster than photographs and caricatures are learned one and a half times faster than photographs. Because our techniques produce images that are effective at communicating complex information, they are useful in a number of potential applications, ranging from entertainment and education to low bandwidth telecommunications and psychology research.
- Akleman, E., Palmer, J., and Logan, R. 2000. Making extreme caricatures with a new interactive 2D deformation technique with simplicial complexes. In Proceedings of Visual'2000.]]Google Scholar
- Arend, L. and Goldstein, R. 1987. Lightness models, gradient illusions, and curl. Percept. Psychophys. 43, 65--80.]]Google Scholar
- Atick, J. J. and Redlich, N. A. 1992. What does the retina know about natural scenes? Neur. Comput. 4, 196--210.]] Google Scholar
- Benson, P. J. and Perret, D. I. 1991. Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images. European Journal of Cognitive Psychology 3, 1, 105--135.]]Google Scholar
- Benson, P. J. and Perret, D. I. 1994. Visual processing of facial distinctiveness. Perception 23, 75--93.]]Google Scholar
- Biederman, I. and Kalocsai, P. 1998. Neural and psychological analysis of object and face recognition. In Face Recognition: From Theory to Applications. Springer-Verlag, New York, 3--25.]]Google Scholar
- Blommaert, F. J. J. and Martens, J.-B. 1990. An object-oriented model for brightness perception. Spatial Vis. 5, 1, 15--41.]]Google Scholar
- Boff, K., Kaufman, L., and Thomas, J. P. 1986. Handbook of Perception and Human Performance. Wiley, New York.]]Google Scholar
- Brennan, S. E. 1985. Caricature generator: The dynamic exaggeration of faces by computer. Leonardo 18, 3, 170--178.]]Google Scholar
- Burt, P. J. and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2, 4, 217--236.]] Google Scholar
- Canny, J. F. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intel. 8, 769--798.]] Google Scholar
- Cohen, M. A. and Grossberg, S. 1984. Neural dynamics of brightness perception: Features, boundaries, diffusion and resonance. Percept. Psychophy. 36, 5, 428--456.]]Google Scholar
- Davies, G., Ellis, H., and Shepperd, J. 1978. Face recognition accuracy as a function of mode of representation. J. Appl. Psych. 63, 2, 180--187.]]Google Scholar
- Durand, F., Ostromoukhov, V., Miller, M., Duranleau, F., and Dorsey, J. 2001. Decoupling strokes and high-level attributes for interactive traditional drawing. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering. Eurographics, 71--82. ISBN 3-211-83709-4.]] Google Scholar
- Ellis, H. D. 1986. Introduction to aspects of face processing: ten questions in need of answers. In Aspects of Face Processing, H. Ellis, M. Jeeves, F. Newcombe, and A. Young, Eds. Nijhoff, Dordrecht, 3--13.]]Google Scholar
- Gauthier, I., Tarr, M. J., Anderson, A. W., Skudlarski, P., and Gore, J. C. 1999. Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects. Nat. Neurosci. 2, 6 (June), 568--573.]]Google Scholar
- Gilchrist, A. L. Ed. 1994. Lightness, Brightness, and Transparency. Erlbaum, Mahwah, N.J.]]Google Scholar
- Gove, A., Grossberg, S., and Mingolla, E. 1995. Brightness perception, illusory contours, and corticogeniculate feedback. Vis. Neurosci. 12, 1027--1052.]]Google Scholar
- Hagen, M. A. and Perkins, D. 1983. A refutation of the hypothesis of the superfidelity of caricatures relative to photographs. Perception 12, 55--61.]]Google Scholar
- Hansen, M. H. 1959. Effects of discrimination training on stimulus generalization. J. Exper. Psych. 58, 3221--3334.]]Google Scholar
- Hansen, T., Baratoff, G., and Neumann, H. 2000. A simple cell model with dominating opponent inhibition for robust contrast detection. Kognitionswissenschaft 9, 93--100.]]Google Scholar
- Jernigan, M. E. and McLean, G. F. 1992. Lateral inhibition and image processing. In Non-linear vision: Determination of neural receptive fields, function, and networks, R. B. Pinter and B. Nabet, Eds. CRC Press, Chapter 17, 451--462.]]Google Scholar
- Land, E. H. and McCann, J. J. 1971. Lightness and retinex theory. J. Opt. Soc. Am. 63, 1, 1--11.]]Google Scholar
- Lewis, M. B. and Johnston, R. A. 1998. Understanding caricatures of faces. Quart. J. Exper. Psych. 50A, 2, 321--346.]]Google Scholar
- Marr, D. 1982. Vision, A Computational Investigation into the Human Representation and Processing of Visual Information. W H Freeman and Company, San Fransisco, Calif.]] Google Scholar
- Marr, D. and Hildreth, E. C. 1980. Theory of edge detection. Proc. Roy. Soc. London, B 207, 187--217.]]Google Scholar
- Mauro, R. and Kubovy, M. 1992. Caricature and face recognition. Mem. Cogni. 20, 4, 433--440.]]Google Scholar
- Ostromoukhov, V. 1999. Digital facial engraving. Proceedings of SIGGRAPH 99. ACM, New York, 417--424.]] Google Scholar
- Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. The MIT Press, Cambridge, Mass.]]Google Scholar
- Pearson, D. E., Hanna, E., and Martinez, K. 1990. Computer-generated cartoons. In Images and Understanding. Cambridge University Press, Cambridge, Mass.]]Google Scholar
- Pearson, D. E. and Robinson, J. A. 1985. Visual communication at very low data rates. Proc. IEEE 73, 4 (April), 795--812.]]Google Scholar
- Pessoa, L., Mingolla, E., and Neumann, H. 1995. A contrast- and luminance-driven multiscale network model of brightness perception. Vis. Res. 35, 15, 2201--2223.]]Google Scholar
- Ramachandran, V. and Hirstein, W. 1999. The science of art a neurological theory of esthetic experience. J. Conscious. Stud. 6, 6--7, 15--51.]]Google Scholar
- Redman, L. 1984. How to draw caricatures. In Aspects of Face Processing. Contemporary Books, Chicago Ill.]]Google Scholar
- Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. In ACM Transactions on Graphics, Proceedings Siggraph 2002. http://www.cs.ucf.edu/∼reinhard/cdrom/, ACM, New York.]] Google Scholar
- Rhodes, G., Brennan, S., and Carey, S. 1987. Identification and ratings of caricatures: Implications for mental representations of faces. Cogn. Psych. 19, 473--497.]]Google Scholar
- Rhodes, G. and Tremewan, T. 1994. Understanding face recognition: caricature effects, inversion, and the homogeneity problem. Vis. Cogn. 1, 2/3.]]Google Scholar
- Rhodes, G. and Tremewan, T. 1996. Averageness, exaggeration, and facial attractiveness. Psych. Sci. 7, 2 (Mar.), 105--110.]]Google Scholar
- Salisbury, M., Anderson, C., Lischinski, D., and Salesin, D. H. 1996. Scale-dependent reproduction of pen-and-ink illustrations. In SIGGRAPH 96 Conference Proceedings. ACM, New York, 461--468.]] Google Scholar
- Salisbury, M. P., Anderson, S. E., Barzel, R., and Salesin, D. H. 1994. Interactive pen-and-ink illustration. In Proceedings of SIGGRAPH 94. ACM, New York, 101--108.]] Google Scholar
- Salisbury, M. P., Wong, M. T., Hughes, J. F., and Salesin, D. H. 1997. Orientable textures for image-based pen-and-ink illustration. In Proceedings of SIGGRAPH 97, ACM, New York, 401--406.]] Google Scholar
- Sousa, M. C. and Buchanan, J. W. 1999. Observational model of blenders and erasers in computer-generated pencil rendering. In Graphics Interface '99. ACM, New York, 157--166. ISBN 1-55860-632-7.]] Google Scholar
- Stevenage, S. V. 1995. Can caricatures really produce distinctiveness effects? Brit. J. Psych. 86, 127--146.]]Google Scholar
- Sweller, J. 1972. A test between the selective attention and stimulus generalisation interpretations of the easy-to-hard effect. Quart. J. Exper. Psych. 24, 352--355.]]Google Scholar
- Tanaka, T. and Ohnishi, N. 1997. In Painting-like Image Emphasis based on Human Vision Systems. In Proceedings of Eurographics '97 16, 3 (Aug.), 253--260.]]Google Scholar
- Tversky, B. and Baratz, D. 1985. Memory for faces: Are caricatures better than photographs? Mem. Cognit. 13, 45--49.]]Google Scholar
- Valentine, T. 1991. A unified account of the effects of distinctiveness, inversion and race in face recognition. Quart. J. Exper. Psych. 43A, 2, 161--204.]]Google Scholar
- Wandell, B. A. 1995. Foundations of Vision. Sinauer Associates, Inc.]]Google Scholar
- Winkenbach, G. and Salesin, D. H. 1994. Computer-generated pen-and-ink illustration. In Proceedings of SIGGRAPH 94. ACM, New York, 91--100.]] Google Scholar
- Wong, E. 1999. Artistic rendering of portrait photographs. M.S. thesis, Cornell University.]]Google Scholar
- Yarmey, A. D. 1973. I recognize your face but I can't remember your name: Further evidence on the tip-of-the-tongue phenomenon. Mem. Cogn. 1, 287--290.]]Google Scholar
- Young, A. W., Hay, D. C., and Ellis, A. W. 1985. The face that launched a thousand slips: Everyday difficulties and errors in recognizing people. Brit. J. Psych. 76, 495--523.]]Google Scholar
Index Terms
- Human facial illustrations: Creation and psychophysical evaluation
Recommendations
Facial marks: soft biometric for face recognition
ICIP'09: Proceedings of the 16th IEEE international conference on Image processingWe propose to utilize micro features, namely facial marks (e.g., freckles, moles, and scars) to improve face recognition and retrieval performance. Facial marks can be used in three ways: i) to supplement the features in an existing face matcher, ii) to ...
Human-Computer Interaction Using Emotion Recognition from Facial Expression
EMS '11: Proceedings of the 2011 UKSim 5th European Symposium on Computer Modeling and SimulationThis paper describes emotion recognition system based on facial expression. A fully automatic facial expression recognition system is based on three steps: face detection, facial characteristic extraction and facial expression classification. We have ...
Comments