Hello, I am an Associate Professor in the Department of Electrical and Computer Engineering at the University of Patras, Greece, where I lead the Interactive Technologies Laboratory. I also serve as an expert member of the International Federation for Information Processing (IFIP), contributing to the TC-13 Human-Computer Interaction Group.
My research is related to the design, development and evaluation of information systems with an emphasis in human-computer interaction, usable-security, human cognitive modeling and cultural heritage. We have published research papers in top-ranked scientific venues, which received awards, (co-) supervised Ph.D. and M.Sc. students, and coordinated several EU-funded and National research projects. I am fluent in German, English and Greek.
Email: fidas AT upatras.gr :: LinkedIn Profile: https://www.linkedin.com/in/fidas
National and EU Funded :: #vishing #cybersecurity #artifical intelligence
Sub 1.1. Excellence CRES Call, Greece - Topic: Digital Technologies - CyberSecurity: Design, Development, and Evaluation of an Integrated Information System and Real-Time Services for the Detection of Telephone Fraud (Vishing)
(€1,630,000, 2025-2027, Project Coordinator & Principal Investigator). Funding Agency: Hellenic Ministry of Education & NextGenerationEU
National Project AILA :: #phishing #cybersecurity #artifical intelligence #legal advice #information systems
Artificial Intelligence-driven Framework and Legal Advice Tools for Phishing Prevention and Mitigation in Information Systems
(€160,000, 2023-2025, Project Coordinator & Principal Investigator ). Funding Agency: Hellenic Foundation for Research and Innovation (H.F.R.I.).
EU Project CREAMS :: #mixedreality #augmentedreality #virtualreality #artstudents #exhibitions
Scaffolding Creativity of Arts Students: Framework, Toolchain, and Educational Material on how to Create their Own Virtual Exhibitions
(€382,644, 2022-2025, Project Coordinator & Principal Investigator ). Funding Agency: European Commission.
More info: CREAMS Project Website
National Project CogniX :: #electroencephalography #eyetracking #cognition
Electroencephalography and Eye Gaze-driven Framework for Intelligent and Real-Time Human Cognitive Modelling (€194,295, 2022-2024, Project Coordinator & Principal Investigator ).
Funding Agency: Hellenic Foundation for Research and Innovation (H.F.R.I.).
More info: COGNIX Project Website
EU Project TRUSTID :: #cybersecurity #userauthentication #biometrics
Intelligent and Continuous Online Student Identity Management for Improving Security and Trust in European Higher Education Institutions
(€291,310, 2021-2023, Project Coordinator & Principal Investigator ). Funding Agency: European Commission.
More info: TRUSTID Project Website
National Project DeAR Museum :: #mixedreality #virtualreality #culturalheritage
Development and production of augmented and virtual reality applications supporting narrative tours at the Tomato Industrial Museum in order to convey a
personalized experience to the visitors of an old factory (€300,000, 2021-2023, Principal Investigator).
Funding Agency: Research-Create-Innovate.
More info: DeAR Museum Project Website
[Publication - Oct 2024]
“The Regulation of Large Language Models (LLMs) in Regulation (EU) 2024/1689 on Artificial Intelligence and the GDPR”
This study introduces the legal issues arising from the regulation of Large Language Models (LLMs) in Regulation (EU) 2024/1689 on Artificial Intelligence and the General Data Protection Regulation. It highlights that with technological advancements, the capabilities of dialogue models are continuously improving, allowing them to generate more accurate and complex responses. However, ethical and transparency issues remain regarding how they are used and the impacts they may have on society, especially concerning privacy protection and ensuring objectivity in the processing of personal data.”
Download the article (in Greek)
[Research Prototype - August 2024]
“CogniX: Electroencephalography and Eye Gaze-driven Framework for Intelligent and Real-Time Human Cognitive Modelling”- Funding Agency: Hellenic Foundation for Research and Innovation (H.F.R.I.).
We have finalized the research prototype at a TRL-4 of CogniX. This work investigates human cognitive styles and factors, which are essential for creating systems that adapt dynamically to individual users. By leveraging EEG and eye-gaze analysis, this approach enables a deeper understanding of user cognition, offering insights into how individuals process information and make decisions. Modeling these factors allows for the development of personalized user interfaces, facilitating more effective information processing and tailored decision support. These cognitive models further inform the design of user experiences that cater to diverse cognitive styles, a valuable strategy across educational and cultural domains, where adaptable interaction with information systems enhances engagement and personalization.
[Best Demo Paper Award - July 2024]
We received the ACM UMAP Best Demo Award of 2024 for our paper entitled "CulturAI: Exploring Mixed Reality Art Exhibitions with Large Language Models for Personalized Immersive Experiences": ACM - Digital Library.
Abstract: Mixed Reality (MR) technologies have transformed the way in which we interact and engage with digital content, offering immersive experiences that blend the physical and virtual worlds. Over the past years, there has been increasing interest in employing Artificial Intelligence (AI) technologies to improve user experience and trustworthiness in cultural contexts. However, the integration of Large Language Models (LLMs) into MR applications within the Cultural Heritage (CH) domain is relatively underexplored. In this work, we present an investigation into the integration of LLMs within MR environments, focusing on the context of virtual art exhibitions. We implemented a HoloLens MR application, which enables users to explore artworks while interacting with an LLM through voice. To evaluate the user experience and perceived trustworthiness of individuals engaging with an LLM-based virtual art guide, we adopted a between-subject study design, in which participants were randomly assigned to either the LLM-based version or a control group using conventional interaction methods. The LLM-based version allows users to pose inquiries about the artwork displayed, ranging from details about the creator to information about the artwork’s origin and historical significance. This paper presents the technical aspects of integrating LLMs within MR applications and evaluates the user experience and perceived trustworthiness of this approach in enhancing the exploration of virtual art exhibitions. Results of an initial evaluation provide evidence about the positive aspect of integrating LLMs in MR applications. Findings of this work contribute to the advancement of MR technologies for the development of future interactive personalized art experiences.
[Publication - March 2024] "A Systematic Review and Research Challenges on Phishing Cyberattacks from an Electroencephalography and Gaze-based perspective", co-authored by George Thomopoulos and Dr. Lyras Dimitrios, in Personal Ubiquitous Computing - Springer.
Abstract:
Phishing is one of the most important security threats in modern Information Systems causing different levels of damages to end-users and service providers such as financial and reputational losses. State-of-the-art anti-phishing research is highly fragmented and monolithic and does not address the problem
from a pervasive computing perspective. In this survey, we aim to contribute to
the existing literature by providing a systematic review of existing experimental
phishing research that employs EEG and eye-tracking methods within multi-
modal and multi-sensory interaction environments. The main research objective of this review is to examine articles that contain results of at least one EEG-based
and/or eye-tracking based experimental setup within a phishing context. The database search with specific search criteria yielded 651 articles from which, after
the identification and the screening process, 42 articles were examined as per the
execution of experiments using EEG or eye-tracking technologies in the context
of phishing. This survey is approaching the subject across the following pillars: a)
the experimental design practices with an emphasis on the applied EEG and eye-
tracking acquisition protocols; b) the artificial intelligence and signal preprocessing techniques that were applied in those experiments and finally c) the
phishing attack types examined. We also provide a roadmap for future research
in the field by suggesting ideas on how to combine state-of-the-art gaze-based
mechanisms with EEG technologies for advancing phishing research. This leads to a discussion on the best practices for designing EEG and Gaze-based frameworks.
[Publication - January 2024] " A Comprehensive Survey of EEG Preprocessing Methods for Cognitive Load Assessment", in IEEE Access journal. We are grateful for the support provided by the Hellenic Foundation for Research and Innovation (H.F.R.I.). (Grant Number: 3849 - Eye Gaze driven Framework for Intelligent and Real-Time Human Cognitive Modeling - CogniX).
Abstract: Preprocessing electroencephalographic (EEG) signals during computer-mediated Cognitive Load tasks is crucial in Human-Computer Interaction (HCI). This process significantly influences subsequent EEG analysis and the efficacy of Artificial Intelligence (AI) models employed in Cognitive Load Assessment. Consequently, it stands as an indispensable procedure for developing dependable systems capable of adapting to users’ cognitive capacities and constraints. We systematically analyzed fifty-seven (57) research papers on computer-mediated Cognitive Load EEG experiments published between 2018 and 2023. The preprocessing methods identified were multiple, controversial, and strongly dependent on the particularities of each experiment and the derived experimental dataset. Our investigation involved the meticulous classification of preprocessing methods based on distinct parameters, namely the degree of user intervention, the noise level, and the subject pool size. Particular attention was paid to semi-automated denoising technology since conventional methods, advanced approaches, and standardized pipelines overwhelm research, but no optimum solution is available yet. This survey is anticipated to provide a valuable contribution to the rising demand for an efficient and fully automated preprocessing approach in EEG-based computerized Cognitive Load experiments.
[Publication - September & October 2023]
We announce the publication of the following two research papers which were conducted as part of the CREAMS project:
a) Title:
From Physical to Virtual Art Exhibitions and Beyond: Survey and some Issues for Consideration for the Metaverse
in Journal of Cultural
Heritage .
Abstract:
This manuscript addresses the increasing importance of Extended Reality (XR) in art exhibitions. It elaborates on the technologies employed, design issues, pertinent aims, and evaluation metrics. The main research questions concern the types of technologies currently used, the primary design considerations, and the ways user experience can be enhanced in accordance with the artists’ and curators' vision, as well as visitors' needs. Moreover, the paper also examines relevant evaluation criteria. The manuscript reviews the types of technologies used for virtual art exhibitions and examines their design characteristics and pertinent issues on interfaces, resources, and affordances. Furthermore, an analysis of the use of virtual humans as a model for increased engagement follows a discussion of a comparison between virtual versus physical exhibitions. Moreover, the parameters that affect user experience are discussed thoroughly, given their pivotal importance in such exhibitions. Finally, the paper concludes with a discussion of the above-mentioned aspects of XR exhibitions with an emphasis on optimizing design for art-related content and offering informed suggestions for future directions. The overall scope of this paper is to examine ways to exploit XR as a creative medium rather than merely replicate physical exhibitions. In this context, the papers’ discussion includes the Metaverse.
b) Title:
Comparison of extended reality platforms and tools for viewing and exhibiting art."
, in
Digital Applications in
Archaeology and Cultural
Heritage.
Abstract:
The rapid evolution of mobile smart devices and the development of inexpensive immersive devices (VR googles, google box etc.) in the past two decades have brought opportunities in the field of curating, storing, and viewing art. These new ways of experiencing art with the help of the latest technologies extend from physical to the virtual space, and any combination of the two. This paper presents a comparative study of selected existing Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) Platforms and Tools for viewing and exhibiting Art. This study explores the key features of each platform, whether the platform is open source or a commercial product, the enabling of interactivity between the users within each platform, and finally the strong and weak points of each. To conclude, this study explores how such platforms and tools can transform the field of curating and exhibiting art.
[Publications - July 2023] We will be participating at the 2nd International Conference of the ACM Greek SIGCHI Chapter. (CHIGREECE 2023) with three paper publications. The titles of our papers are: 1. Investigating Applicability Heuristics of Answer Set Programming in Game Development: Use Cases and Empirical Study. 2. Use of XR technologies for enhancing visitors' experience at industrial museums. 3. Methodologies and Ethical Considerations in Phishing Research: A Comprehensive Review.
[New Project & Research Funding - June 2023] We are excited for the approval of our research proposal, "AILA: Artificial Intelligence-driven Framework and Legal Advice Tools for Phishing Prevention and Mitigation in Information Systems", which has been granted funding of €160,000.00 from the Hellenic Foundation for Research and Innovation (H.F.R.I.) .
Info: This project is a collaboration with the Law School of the Aristotle University of Thessaloniki. This project will explore the use of artificial intelligence (AI) and legal advice tools to prevent and mitigate phishing attacks in information systems. Our goal is to develop a comprehensive framework that can detect and respond to phishing attacks more effectively, ultimately improving the security and reliability of information systems. As part of this project, we will be recruiting two PhD students to join our team. The successful candidates will have the opportunity to work on cutting-edge research, contribute to the development of a new cybersecurity framework, and collaborate with experts in artificial intelligence, law, and information systems.
[Publications - May 2023]
We announce that our lab will be participating at the 19th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT 2023) with three paper publications. The titles of our papers are:
1. Extending User Interaction with Mixed Reality through a Smartphone-based Controller
2. Exploring the Potential of Metaverse Apps for Real-World Applications: A Case Study with CALEND_AR
3. Influences of Cognitive Styles on EEG-based Activity: An Empirical Study on Visual Content Comprehension (Poster)
[Publication - May & July 2023]
We announce the publication of the following two research papers which were conducted as part of the TRUST-ID project. It is a culmination of our efforts in the project, which has now successfully concluded.
a) Title: "Ensuring Academic Integrity and Trust in Online Learning Environments: A Longitudinal Study of an AI-Centered Proctoring System in Tertiary Educational Institutions", in Education Sciences. To learn more, please check out the full article https://doi.org/10.3390/educsci13060566.
Abstract: The credibility of online examinations in Higher Education is hardened by numerous factors and use-case scenarios. This paper reports on a longitudinal study, that spanned over eighteen months, in which various stakeholders from three European Higher Education Institutions (HEIs) participated, aiming to identify core threat scenarios experienced during online examinations, and to, accordingly, propose threat models, data metrics and countermeasure features that HEI learning management systems can embrace to address the identified threat scenarios. We also report on a feasibility study of an open-source intelligent and continuous student identity management system, namely TRUSTID, which implements the identified data metrics and countermeasures. A user evaluation with HEI students (n = 133) revealed that the TRUSTID system is resilient and effective against impersonation attacks, based on intelligent face and voice identification mechanisms, and scored well in usability and user experience. Aspects concerning the preservation of privacy in storing, retrieving and processing sensitive personal data are also discussed.
Abstract: The worldwide shift to distance learning at Higher Education Institutions (HEIs) during the COVID-19 global pandemic has raised several concerns about the credibility of online academic activities, especially regarding student identity management. Traditional online frameworks cannot guarantee the authenticity of the enrolled student, which requires instructors to manually verify their identities, a time-consuming task that compromises academic quality. This article presents a comprehensive review of existing efforts around continuous user identification, focusing on intelligent proctoring systems and automatic identification methods, as well as their applicability in this domain. We conclude that there is a clear need for continuous user identification technology by HEIs, but existing systems lack agile system integration models that combine many inputs, such as face, voice and behavioural data in a practical manner, and encounter numerous barriers related to data protection during implementation.
[Workshop Chair - April 2023] We announce the 1st International Workshop on Accessibility and Multimodal Interaction Design Approaches in Museums for People with Impairments, which is set to take place alongside the MobileHCI 2023 conference.
Workshop Abstract:
This workshop focuses on methods, tools, and techniques to design and
develop mobile museum applications for people with impairments. More
specifically, the research that will be presented will relate to technological
solutions that support museum visitors with visual, motor, dexterity, hearing,
and cognitive impairments. The rationale for the workshop is premised on the
significance of providing meaningful and engaging museum experiences to
visitors through mobile applications with customized interfaces adapted to
the characteristics of various groups of people with special needs.
Furthermore, the use of Mixed Reality, i.e., the combination of real and virtual
worlds, will be addressed in connection with the quest to foster access and
inclusion with regard to museums, and empowerment of people with
impairments. The workshop's primary goal is to bring together leading experts
to discuss the field's challenges and propose solutions concerning methods,
tools, and techniques in HCI, present their research on user requirements, and
system design to advance knowledge with the view to optimizing uses of
emerging technologies for enhancing cultural inclusion.
We are delighted to have Alan Dix as one of our invited speakers, who will share valuable insights and perspectives. We invite submissions from the research community to contribute their innovative ideas, empirical studies, and design approaches in this important domain. This workshop promises to be an engaging platform for knowledge exchange, collaboration, and the advancement of accessible and multimodal museum interaction design.
[More info]
[Opening to Society Activity - March 2023] We share that the we hosted a group of 29 third-grade students from the High School - L.T. Farron , providing them with a unique opportunity to learn about our research in Brain Computer Interaction. As part of the visit, we demonstrated our state-of-the-art Mixed Reality apparatus, which received great interest and engagement from the young students.
[Publication - February 2023] We announce the publication of our research paper: Title: "A Review of EEG-Based User Authentication: Trends and Future Research Directions", in IEEE ACCESS. To learn more, please check out the full article https://10.1109/ACCESS.2023.3253026.
Abstract: Recently, the use of Electroencephalography (EEG) in scientific research on User Authentication (UA) has led to cutting-edge experiments that seek to identify and authenticate individuals based on their brain activity in particular usage scenarios. Utilizing EEG signals, derived from brain activity, might provide innovative solutions to contemporary security issues in traditional knowledge-based user authentication, including the threat of shoulder surfing. In this review paper, we analyze 108 different EEG-based user authentication experiments based on the following perspectives: a) the user experimental setup, with an emphasis on the applied EEG- protocols; b) the artificial intelligence techniques employed and finally c) the security and privacy preservation aspects. The reviewed papers cover a broad time frame from 1998 to 2022 and include various experimental protocols and algorithms used for classifying EEG signals. Additionally, the majority of the referenced works report findings from multiple experiments that incorporate distinct approaches and configurations. This leads to a discussion on best practices for EEG-based User Authentication and conclusions suggesting future research directions that consists, among others, of considering homomorphically encrypted biometric templates for information leakage prevention through federated learning approaches in decentralized architectures. We anticipate that the present literature review will provide a roadmap for future research by considering efficiently and effective EEG-based User Authentication methods while at the same time preserving privacy.
[Keynote Speech - November 2022] Happy to share my Keynote Speech at the 17th IEEE International Workshop on Semantic and Social Media Adaptation & Personalization.
Summary: Scientific evidence underpins that humans differentiate in their inherent way to perceive and process visual information and that these differences in visual information processing immensely affect user experience and task execution in various application domains. This becomes even more relevant within virtual or mixed interaction contexts and applications which by definition necessitate from end-users to perform advanced visual information processing tasks that entails visual attention, search, processing and comprehension. In this talk we will present our recent research efforts which are focused on understanding the interplay among human cognition, visual behaviour and user experience within virtual and mixed reality interaction contexts. By doing this, we aim at building human cognition-centered user models based on users visual behaviour patterns that can serve as a basis for personalizing user interaction aiming to improve user experience within virtual or mixed reality applications.
[Publication - August 2022]
Our longitudinal research that spanned over two years and embraced three public European healthcare organizations, with 169 participants,
has been published at ACM Transactions on Computing for Healthcare.
Title: "Security and Usability of a Personalized User Authentication Paradigm: Insights from a Longitudinal Study with Three Healthcare Organizations"
DOI: https://doi.org/10.1145/3564610
Abstract: This paper proposes a user-adaptable and personalized authentication paradigm for healthcare organizations, which anticipates to seamlessly reflect patients episodic and autobiographical memories to graphical and textual passwords aiming to improve the security strength of user-selected passwords and provide a positive user experience. We report on a longitudinal study that spanned over two years in which three public European healthcare organizations participated in order to design and evaluate the aforementioned paradigm. Three studies were conducted (N=169) with different stakeholders: i) a verification study aiming to identify existing authentication practices of the three healthcare organizations with diverse stakeholders (N=9); ii) a patient-centric feasibility study during which users interacted with the proposed authentication system (N=68); and iii) a human guessing attack study focusing on vulnerabilities among people sharing common experiences within location-aware images used for graphical passwords (N=92). Results revealed that the suggested paradigm scored high with regards to users' likeability, perceived security, usability and trust, but more importantly it assists the creation of more secure passwords. On the downside, the suggested paradigm introduces password guessing vulnerabilities from individuals sharing common experiences with the end-users. Findings are expected to scaffold the design of more patient-centric knowledge-based authentication mechanisms within nowadays dynamic computation realms.
[Publication - July 2022]
We announce that our paper "Supporting People with Visual Impairments in Cultural Heritage: Survey and Future Research Directions" has been accepted at the International Journal of Human-Computer Interaction, 2022.
- Impact Factor: 4.920
Authors: Sylaiou S., Fidas C. (2022)- DOI: https://doi.org/10.1080/10447318.2022.2098930
Abstract: This literature review surveys published research that aims to foster blind and visually impaired (VI) people's engagement with cultural heritage. Fifty (50) papers are included in this survey, published between 2008 and 2021. They mostly focus on multisensory, multimodal, and interdisciplinary, ICT-based assistive human- centered computing approaches. These methods often optimize the user experience of VI-user's through an effort to gain an in-depth understanding of this special group's needs and accordingly design adaptive and adaptable interaction workflows. Moreover, several publications include user evaluations and empirical studies. Findings suggest that approaches tend to become more complex, multimodal, and multidisciplinary as time progresses. This leads to a discussion and conclusions suggesting future research directions in this domain. The proposed way forward relates to a synthesis of methodologies, scientific domains, and approaches into a more holistic, comprehensive, and synergetic model.
[Research Equipment - May 2022] We announce further extension of our laboratory research infrastructure by acquiring cutting-edge equipment with a total amount >50K. Among others, we obtained a state-of-the-art 41-channel Electroencephalography (EEG) device, a mixed-reality hands-free controllable headset and couple of eye-tracking lens. We aspire to design and conduct EEG multi-modal experiments to measure cognitive traits within innovative breakthrough interaction realms like MR/AR and VR and gesture control along with visual and/or acoustic stimuli. Moreover, we aim to develop and evaluate an electroencephalography based framework for intelligent real-time modeling of user cognitive intentions, thus laying the ground for ground-breaking advancements in various Brain Computer Interaction research fields. More info: COGNIX Project Website
[view more]In this work, we have designed and developed CogniX, an extensible tool for human cognitive modeling. This work investigates human cognitive styles and factors, which are essential for creating systems that adapt dynamically to individual users. By leveraging EEG and eye-gaze analysis, this approach enables a deeper understanding of user cognition, offering insights into how individuals process information and make decisions. Modeling these factors allows for the development of personalized user interfaces, facilitating more effective information processing and tailored decision support. These cognitive models further inform the design of user experiences that cater to diverse cognitive styles, a valuable strategy across educational and cultural domains, where adaptable interaction with information systems enhances engagement and personalization.
In this work, we have designed and developed CogniKit, an extensible tool for human cognitive modeling. It is based on the analysis, classification and visualization of eye tracking data such as gaze points, fixation count and duration, saccades, gaze transition and stationary entropy, heat maps, areas of interests, etc. These are further processed, analyzed and classified for detecting higher level human cognitive factors such as cognitive processing styles and abilities. CogniKit comprises of two main components: i) a software application that collects and processes low- and high-level eye gaze data metrics in real-time; and ii) an extensible interactive workbench for storing, analyzing, classifying and visualizing the collected eye gaze data.
Relevant paper: ACM WI 2019, ACM IUI 2020
Mixed reality technologies embrace hand gesture-based interaction modalities, which can be leveraged by picture passwords, as they require users to draw secret gestures on a background image. In this work, we have designed and developed HoloPass, a novel mixed reality application that utilizes the Microsoft HoloLens device that allows users to directly interact with picture-based holograms in order to perform user authentication tasks. The current prototype was developed in Unity 3D, using C# and Microsoft's Mixed Reality Toolkit for HoloLens, and follows implementation guidelines of Microsoft Windows 10 Picture Gesture Authentication in which users draw three secret gestures on a background image that acts as a cue.
Relevant papers: ACM CHI 2019, INTERACT 2019
This work aims at scaffolding end-users in improving the security of graphical passwords through a playful interaction design in mixed reality. For doing so, we elaborated on a playful interaction de-sign framework and developed, based on it, an experimental mixed reality (MR) application that deployed multi-modal and playful user interaction experiences. A user evaluation woth 30 participants revealed that introducing playful characteristics in the design of MR graphical passwords had a catalyst effect on the security of user generated passwords and simultaneously affected significantly end-users' perceptions and understanding related to security semantics of graphical passwords.
Associate Professor (2023-) at the Department of Electrical and Computer Engineering, University of Patras
Assistant Professor (2021-2023) at the Department of Electrical and Computer Engineering, University of Patras
Assistant Professor (2016-2020), Tenure-track Lecturer (2013-2016) at the Department of Cultural Heritage and New Technologies, University of Patras
Visiting Assistant Professor at the Department of Computer Science, University of Cyprus (2011-2013)
Adjunct Lecturer at the University of Patras, University of Ioannina, Technical Institute of Patras (2004-2011)
I am always happy to discuss with prospective students new research endeavors in the areas of Information Systems and Culture, Modelling Human Cognition in Interactive Systems, and Usable Security. If you are interested to discuss your research idea please don't hesitate to contact me at fidas AT upatras.gr
Suggested Topics for Ph.D.