Examination of Logical Structure in Photo Series Using Electroencephalography and Eye Tracking Techniques
Abstract
Creating a photography series has strong importance in photography but the aesthetic properties in photo series have different behavior than standalone images by well-known photographers. Since the invention of photography in the early 1800s, yet there is no specific structural way for its aesthetic management rules. This paper is proposing a scientific method which is connecting the photography’s aesthetic principles with the cognitive subconscious. At this estimating method, tracking the eyes' movement and its relationship with the electroencephalography, which is a “technique for recording and interpreting the electrical activity of the brain.” In particular, the relationship between eye-tracking and electroencephalography has been tested empirically in the two sets of images. The first set was a photography series (Broken Manual by Alec Soth), and the second set, standalone images of various photographers. Thirty art were students involved in measuring delta, theta, alpha, and beta waves through electroencephalography and also tracking the eyes' movements within Convolution Neural Networks (CNN). The final result of the data that has been found in this research area, illustrates that, in contrast to the second set, there is meaningful relationship between the photographs of the first set and also there are relevant differences between the two sets. (0.001=p). This work will advance the growing literature on the producing photography series and aesthetic management measure in visual arts.
Supporting Institution
Tabriz Islamic Art University
Project Number
1
Thanks
Many thanks to the students of Tabriz Islamic Art University for the academic year 2019 who helped us to carry out this research.
References
- Skopik, Steven. “Digital Photography: Truth, Meaning, Aesthetics.” History of Photography 27, no. 3 (2003): 264–71.
- Darling A. Storytelling with photographs: How to create a photo essay. Amazon.com: Kindle edition. 2014.
- Wells Liz, Photography: a critical introduction Abingdon, Oxon ; New York : Routledge, 2015.
- Kobre K. Photojournalism: The professionals' approach. Routledge; 2008 Feb 5.
- Muybridge E. Horses and other animals in motion: 45 classic photographic sequences. Courier Corporation; 1985.
- Andersen, T., 2018. Eadweard Muybridge. Comparative Cinema, 6(11), pp.10-16.
- Michals Duane, Duane Michals: Photographs, Sequences, Texts, 1958-1984 Museum of Modern Art: the University of California, 1984.
- Zeki Semir, Ishizu Tomohiro, The “Visual Shock” of Francis Bacon: an essay in neuroesthetics” Frontiers in human neuroscience Switzerland: Frontiers Media S.A., 7. 2013.
- Cornia, Marcella, Lorenzo Baraldi, Giuseppe Serra, and Rita Cucchiara. "Predicting human eye fixations via an lstm-based saliency attentive model." IEEE Transactions on Image Processing 27, no. 10 (2018): 5142-5154. DOI: 10.1109/TIP.2018.2851672.
- Hansen, Hans & Ropo, Arja & Sauer, Erika. Aesthetic Leadership. The Leadership Quarterly. 18. (2007): 544-560. DOI: 10.1016/j.leaqua.2007.09.003 https://doi.org/10.1080/03087298.2003.10441252.
- Davies, Stephen, David E. Cooper, and Robert Hopkins. Companion to Aesthetics. Hoboken: Wiley, 2009.
- Plato, Bloom Allan, The Republic of Plato: Second Edition, United States: Basic books, 1991.
- Barthes Roland, Camera Lucida Reflections on Photography, New York: Hill and Wang, 1981.
- Tolstoy L. What is art?. Penguin UK; 1995 Aug 31.
- Starr Gabrielle, Feeling Beauty: The Neuroscience of Aesthetic Experience Cambridge: The MIT Press, 2013.
- Minissale, Gregory. "Conceptual Art: A Blind Spot for Neuroaesthetics?" in Leonardo 45, no. 1 (2012): 43-48.
- Lee, Haeinn, Jungtae Lee, and Ssanghee Seo. "Brain response to good and bad design." In International Conference on Human-Computer Interaction, pp. 111-120. Springer, Berlin, Heidelberg, 2009.
- Bruce, Amanda S., Rebecca J. Lepping, Jared M. Bruce, J. Bradley C. Cherry, Laura E. Martin, Ann M. Davis, William M. Brooks, and Cary R. Savage. "Brain responses to food logos in obese and healthy weight children." The Journal of Pediatrics 162, no. 4 (2013): 759-764.
- Ohme, Rafal, Dorota Reykowska, Dawid Wiener, and Anna Choromanska. "Application of frontal EEG asymmetry to advertising research." Journal of economic psychology 31, no. 5 (2010): 785-793.
- Kenning, Peter, and Hilke Plassmann. "NeuroEconomics: An overview from an economic perspective." Brain research bulletin 67, no. 5 (2005): 343-354.
- Vecchiato, Giovanni, Fabio Babiloni, Laura Astolfi, Jlenia Toppi, Patrizia Cherubino, Jounging Dai, Wanzeng Kong, and Daming Wei. "Enhance of theta EEG spectral activity related to the memorization of commercial advertisings in Chinese and Italian subjects." In 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 3, pp. 1491-1494. IEEE, 2011.
- Zhang, Jianming, and Stan Sclaroff. "Saliency detection: A boolean map approach." In Proceedings of the IEEE international conference on computer vision, pp. 153-160. 2013.
- Ettinger, Ulrich, Veena Kumari, Trevor J. Crawford, Robert E. Davis, Tonmoy Sharma, and Philip J. Corr. "Reliability of smooth pursuit, fixation, and saccadic eye movements." Psychophysiology 40, no. 4 (2003): 620-628.
- Vidal, Mélodie, Jayson Turner, Andreas Bulling, and Hans Gellersen. "Wearable eye tracking for mental health monitoring." Computer Communications 35, no. 11 (2012): 1306-1311.
- Takahashi, Ryo, Hiromasa Suzuki, Jouh Yeong Chew, Yutaka Ohtake, Yukie Nagai, and Koichi Ohtomi. "A system for three-dimensional gaze fixation analysis using eye tracking glasses." Journal of Computational Design and Engineering 5, no. 4 (2018): 449-457.
- Salehin, Md Musfequs, and Manoranjan Paul. "A novel framework for video summarization based on smooth pursuit information from eye tracker data." In 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 692-697. IEEE, 2017.
- Schrom-Feiertag, Helmut & Schinko, Christoph & Settgast, Volker & Seer, Stefan. (2014). Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment. CEUR Workshop Proceedings. 1241. 62-66.
- Zhang, Xuebai, and Shyan-Ming Yuan. "An eye tracking analysis for video advertising: Relationship between advertisement elements and effectiveness." IEEE Access 6 (2018): 10699-10707.
- Zhang, Luming, Yue Gao, Rongrong Ji, Yingjie Xia, Qionghai Dai, and Xuelong Li. "Actively learning human gaze shifting paths for semantics-aware photo cropping." IEEE transactions on image processing 23, no. 5 (2014).
- Xu, Juan, Ming Jiang, Shuo Wang, Mohan S. Kankanhalli, and Qi Zhao. "Predicting human gaze beyond pixels." Journal of vision 14, no. 1 (2014): 28-28.
Examination of Logical Structure in Photo Series Using Electroencephalography and Eye Tracking Techniques
Abstract
Fotoğraf serisi oluşturmak fotoğrafçılıkta büyük önem taşır, ancak fotoğraf serilerindeki estetik özellikler, tanınmış fotoğrafçıların bağımsız görüntülerinden farklı davranışlara sahiptir. 1800'lerin başında fotoğrafın icadından bu yana, estetik yönetim kurallarının henüz belirli bir yapısal yolu yoktur. Bu makale, fotoğrafın estetik ilkelerini bilişsel bilinçaltıyla ilişkilendiren bilimsel bir yöntem önermektedir. Bu tahmin yönteminde, göz hareketlerinin izlenmesi ve bunun “beynin elektriksel aktivitesini kaydetme ve yorumlama tekniği” olan elektroensefalografi ile ilişkisi izleniyor. Özellikle, göz izleme ve elektroensefalografi arasındaki ilişki, iki görüntü setinde ampirik olarak test edilmiştir. İlk set bir fotoğraf serisiydi (Broken Manual by Alec Soth), ikinci set ise çeşitli fotoğrafçıların bağımsız görüntüleriydi. Otuz sanat, elektroensefalografi yoluyla delta, teta, alfa ve beta dalgalarını ölçmek ve ayrıca Evrişim Sinir Ağları (CNN) içinde göz hareketlerini izlemekle ilgilenen öğrencilerdi. Bu araştırma alanında bulunan verilerin nihai sonucu, ikinci setin aksine, ilk setin fotoğrafları arasında anlamlı bir ilişki olduğunu ve ayrıca iki set arasında anlamlı farklılıklar olduğunu göstermektedir. (0,001=p). Bu çalışma, görsel sanatlarda fotoğraf serileri üretme ve estetik yönetim ölçütü üzerine büyüyen literatürü ilerletecektir.
Project Number
1
References
- Skopik, Steven. “Digital Photography: Truth, Meaning, Aesthetics.” History of Photography 27, no. 3 (2003): 264–71.
- Darling A. Storytelling with photographs: How to create a photo essay. Amazon.com: Kindle edition. 2014.
- Wells Liz, Photography: a critical introduction Abingdon, Oxon ; New York : Routledge, 2015.
- Kobre K. Photojournalism: The professionals' approach. Routledge; 2008 Feb 5.
- Muybridge E. Horses and other animals in motion: 45 classic photographic sequences. Courier Corporation; 1985.
- Andersen, T., 2018. Eadweard Muybridge. Comparative Cinema, 6(11), pp.10-16.
- Michals Duane, Duane Michals: Photographs, Sequences, Texts, 1958-1984 Museum of Modern Art: the University of California, 1984.
- Zeki Semir, Ishizu Tomohiro, The “Visual Shock” of Francis Bacon: an essay in neuroesthetics” Frontiers in human neuroscience Switzerland: Frontiers Media S.A., 7. 2013.
- Cornia, Marcella, Lorenzo Baraldi, Giuseppe Serra, and Rita Cucchiara. "Predicting human eye fixations via an lstm-based saliency attentive model." IEEE Transactions on Image Processing 27, no. 10 (2018): 5142-5154. DOI: 10.1109/TIP.2018.2851672.
- Hansen, Hans & Ropo, Arja & Sauer, Erika. Aesthetic Leadership. The Leadership Quarterly. 18. (2007): 544-560. DOI: 10.1016/j.leaqua.2007.09.003 https://doi.org/10.1080/03087298.2003.10441252.
- Davies, Stephen, David E. Cooper, and Robert Hopkins. Companion to Aesthetics. Hoboken: Wiley, 2009.
- Plato, Bloom Allan, The Republic of Plato: Second Edition, United States: Basic books, 1991.
- Barthes Roland, Camera Lucida Reflections on Photography, New York: Hill and Wang, 1981.
- Tolstoy L. What is art?. Penguin UK; 1995 Aug 31.
- Starr Gabrielle, Feeling Beauty: The Neuroscience of Aesthetic Experience Cambridge: The MIT Press, 2013.
- Minissale, Gregory. "Conceptual Art: A Blind Spot for Neuroaesthetics?" in Leonardo 45, no. 1 (2012): 43-48.
- Lee, Haeinn, Jungtae Lee, and Ssanghee Seo. "Brain response to good and bad design." In International Conference on Human-Computer Interaction, pp. 111-120. Springer, Berlin, Heidelberg, 2009.
- Bruce, Amanda S., Rebecca J. Lepping, Jared M. Bruce, J. Bradley C. Cherry, Laura E. Martin, Ann M. Davis, William M. Brooks, and Cary R. Savage. "Brain responses to food logos in obese and healthy weight children." The Journal of Pediatrics 162, no. 4 (2013): 759-764.
- Ohme, Rafal, Dorota Reykowska, Dawid Wiener, and Anna Choromanska. "Application of frontal EEG asymmetry to advertising research." Journal of economic psychology 31, no. 5 (2010): 785-793.
- Kenning, Peter, and Hilke Plassmann. "NeuroEconomics: An overview from an economic perspective." Brain research bulletin 67, no. 5 (2005): 343-354.
- Vecchiato, Giovanni, Fabio Babiloni, Laura Astolfi, Jlenia Toppi, Patrizia Cherubino, Jounging Dai, Wanzeng Kong, and Daming Wei. "Enhance of theta EEG spectral activity related to the memorization of commercial advertisings in Chinese and Italian subjects." In 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI), vol. 3, pp. 1491-1494. IEEE, 2011.
- Zhang, Jianming, and Stan Sclaroff. "Saliency detection: A boolean map approach." In Proceedings of the IEEE international conference on computer vision, pp. 153-160. 2013.
- Ettinger, Ulrich, Veena Kumari, Trevor J. Crawford, Robert E. Davis, Tonmoy Sharma, and Philip J. Corr. "Reliability of smooth pursuit, fixation, and saccadic eye movements." Psychophysiology 40, no. 4 (2003): 620-628.
- Vidal, Mélodie, Jayson Turner, Andreas Bulling, and Hans Gellersen. "Wearable eye tracking for mental health monitoring." Computer Communications 35, no. 11 (2012): 1306-1311.
- Takahashi, Ryo, Hiromasa Suzuki, Jouh Yeong Chew, Yutaka Ohtake, Yukie Nagai, and Koichi Ohtomi. "A system for three-dimensional gaze fixation analysis using eye tracking glasses." Journal of Computational Design and Engineering 5, no. 4 (2018): 449-457.
- Salehin, Md Musfequs, and Manoranjan Paul. "A novel framework for video summarization based on smooth pursuit information from eye tracker data." In 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 692-697. IEEE, 2017.
- Schrom-Feiertag, Helmut & Schinko, Christoph & Settgast, Volker & Seer, Stefan. (2014). Evaluation of Guidance Systems in Public Infrastructures Using Eye Tracking in an Immersive Virtual Environment. CEUR Workshop Proceedings. 1241. 62-66.
- Zhang, Xuebai, and Shyan-Ming Yuan. "An eye tracking analysis for video advertising: Relationship between advertisement elements and effectiveness." IEEE Access 6 (2018): 10699-10707.
- Zhang, Luming, Yue Gao, Rongrong Ji, Yingjie Xia, Qionghai Dai, and Xuelong Li. "Actively learning human gaze shifting paths for semantics-aware photo cropping." IEEE transactions on image processing 23, no. 5 (2014).
- Xu, Juan, Ming Jiang, Shuo Wang, Mohan S. Kankanhalli, and Qi Zhao. "Predicting human gaze beyond pixels." Journal of vision 14, no. 1 (2014): 28-28.
Details
| Primary Language | English |
|---|---|
| Subjects | Engineering |
| Journal Section | Articles |
| Authors | |
| Project Number | 1 |
| Publication Date | July 31, 2021 |
| Submission Date | July 1, 2021 |
| Published in Issue | Year 2021 Volume: 5 Issue: 1 |
