Exploring the role of gaze behavior and object detection in scene understanding
Public Deposited- Creator
- Yun, Kiwon
- Peng, Yifan
- Samaras, Dimitris
- Zelinsky, Gregory J.
- Berg, Tamara L.
- Abstract
- We posit that a person's gaze behavior while freely viewing a scene contains an abundance of information, not only about their intent and what they consider to be important in the scene, but also about the scene's content. Experiments are reported, using two popular image datasets from computer vision, that explore the relationship between the fixations that people make during scene viewing, how they describe the scene, and automatic detection predictions of object categories in the scene. From these exploratory analyses, we then combine human behavior with the outputs of current visual recognition methods to build prototype human-in-the-loop applications for gaze-enabled object detection and scene annotation.
- Date of publication
- 2013
- Keyword
- DOI
- Identifier
- PMCID: PMC3854460
- Publisher DOI: https://doi.org/10.3389/fpsyg.2013.00917
- Onescience id: e30253d24bc0412321662d5ddacb14b0a9cc67b3
- PMID: 24367348
- Resource type
- Article
- Rights statement
- In Copyright
- Journal title
- Frontiers in Psychology
- Journal volume
- 4
- Language
- English
- ISSN
- 1664-1078
Relations
- Parents:
- In Collection:
This work has no parents.
Items
| Thumbnail | Title | Date Uploaded | Visibility | Actions |
|---|---|---|---|---|
|
|
EuropePMC-PMC3854460.pdf | 2020-10-30 | Public | Download |