Douglas L. Vail
ABSTRACT
Activity recognition is a key component for creating intelligent, multi-agent systems. Intrinsically, activity recognition is a temporal classification problem. In this paper, we compare two models for temporal classification: hidden Markov models (HMMs), which have long been applied to the activity recognition problem, and conditional random fields (CRFs). CRFs are discriminative models for labeling sequences. They condition on the entire observation sequence, which avoids the need for independence assumptions between observations. Conditioning on the observations vastly expands the set of features that can be incorporated into the model without violating its assumptions. Using data from a simulated robot tag domain, chosen because it is multi-agent and produces complex interactions between observations, we explore the differences in performance between the discriminatively trained CRF and the generative HMM. Additionally, we examine the effect of incorporating features which violate independence assumptions between observations; such features are typically necessary for high classification accuracy. We find that the discriminatively trained CRF performs as well as or better than an HMM even when the model features do not violate the independence assumptions of the HMM. In cases where features depend on observations from many time steps, we confirm that CRFs are robust against any degradation in performance.
- J. Hammersley and P. Clifford. Markov fields on finite graphs and lattices, 1971.Google Scholar
- K. Han and M. Veloso. Automated robot behavior recognition applied to robotic soccer. In J. Hollerbach and D. Koditschek, editors, Robotics Research: the Ninth International Symposium, pages 199--204. Springer-Verlag, London, 2000.Google Scholar
- H. Kitano, editor. RoboCup-97: Robot Soccer World Cup I. Springer-Verlag, London, UK, 1998. Google ScholarDigital Library
- S. Kumar and M. Hebert. Discriminative random fields: A discriminative framework for contextual interaction in classification. In ICCV '03: Proceedings of the Ninth IEEE International Conference on Computer Vision, page 1150, Washington, DC, USA, 2003. IEEE Computer Society. Google ScholarDigital Library
- J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning, pages 282--289. Morgan Kaufmann, San Francisco, CA, 2001. Google ScholarDigital Library
- L. Liao, D. Fox, and H. Kautz. Hierarchical Conditional Random Fields for GPS-based activity recognition. In Proc. of the International Symposium of Robotis Research (ISRR 2005). Springer Verlag, 2005.Google Scholar
- D. C. Liu and J. Nocedal. On the limited memory bfgs method for large scale optimization. Math. Program., 45(3):503--528, 1989. Google ScholarDigital Library
- A. Y. Ng and M. I. Jordan. On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 841--848, Cambridge, MA, 2002. MIT Press.Google Scholar
- L. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257--286, February 1989.Google ScholarCross Ref
- D. A. Ross, S. Osindero, and R. S. Zemel. Combining discriminative features to infer complex trajectories. In ICML '06: Proceedings of the 23rd international conference on Machine learning, pages 761--768, New York, NY, USA, 2006. ACM Press. Google ScholarDigital Library
- P. Rybski and M. Veloso. Using sparse visual data to model human activities in meetings. In Modeling Other Agents from Observations Workshop (MOO 2004), 2004.Google Scholar
- F. Sha and F. Pereira. Shallow parsing with conditional random fields. In NAACL '03: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, pages 134--141, Morristown, NJ, USA, 2003. Association for Computational Linguistics. Google ScholarDigital Library
- C. Sminchisescu, A. Kanaujia, Z. Li, and D. Metaxas. Conditional models for contextual human motion recognition. In IEEE International Conference on Computer Vision (ICCV 2005), pages 1808--1815, 2005. Google ScholarDigital Library
- G. Sukthankar and K. Sycara. Robust recognition of physical team behaviors using spatio-temporal models. In Proceedings of Fifth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), May 2006. Google ScholarDigital Library
- C. Sutton and A. McCallum. An introduction to conditional random fields for relational learning. In L. Getoor and B. Taskar, editors, Introduction to Statistical Relational Learning. MIT Press, 2006. To appear.Google Scholar
- H. Wallach. Efficient training of conditional random fields. Master's thesis, University of Edinburgh, 2002.Google Scholar
Index Terms
- Conditional random fields for activity recognition
Recommendations
Conditional random fields for activity recognition in smart environments
IHI '10: Proceedings of the 1st ACM International Health Informatics SymposiumOne of the most common functions of smart environments is to monitor and assist older adults with their activities of daily living. Activity recognition is a key component in this application. It is essentially a temporal classification problem which ...
Triangular-Chain Conditional Random Fields
Sequential modeling is a fundamental task in scientific fields, especially in speech and natural language processing, where many problems of sequential data can be cast as a sequential labeling or a sequence classification. In many applications, the two ...
Semi-Markov conditional random fields for accelerometer-based activity recognition
Activity recognition is becoming an important research area, and finding its way to many application domains ranging from daily life services to industrial zones. Sensing hardware and learning algorithms are two important components in activity ...
Comments