Human–computer interaction - Contextual Foundations and Resources

Human-Computer Interaction: Key Concepts and Frameworks Introduction Human-Computer Interaction (HCI) is the study of how people interact with computers and how to design technology to be more usable, useful, and enjoyable. This field sits at the intersection of computer science, psychology, design, and social science. Understanding HCI means recognizing both the technological innovations that enable new interaction possibilities and the human factors that determine whether those innovations actually improve people's lives. The outline provided covers several critical areas: what drives changes in how we interact with technology, theoretical frameworks that guide design decisions, emerging technologies like augmented reality, and the methods we use to evaluate whether our designs actually work. Factors Driving Change in Human-Computer Interaction Changes in how humans interact with computers are driven by two main forces: technology and society. Technological Drivers Technological innovation creates new possibilities for interaction. Beyond the traditional mouse and keyboard, innovative input techniques—such as voice recognition, gesture recognition, and digital pens—have significantly expanded who can use computers and how they use them. Why does this matter? Different people have different abilities and preferences. Someone who has limited use of their hands might rely on voice commands, while someone working in a hospital might use gesture-based interfaces to avoid contaminating sterile surfaces. These input methods don't just add features; they can be transformative for accessibility. They increase computer adoption by making technology available to broader populations, including people with disabilities and in different cultural contexts where traditional interfaces may not be practical. Social Drivers Beyond what's technically possible, social concerns and values shape how technology develops and who gets access to it. Wider societal awareness about digital inequality and inclusion has pushed technology companies and designers to prioritize access for disadvantaged groups. This might include designing interfaces in multiple languages, ensuring websites work on low-bandwidth connections for developing regions, or creating accessible features for people with disabilities. Social drivers are powerful because they reflect what we collectively decide matters—they're driven by movements, advocacy, policy changes, and cultural values about equity. Theoretical Foundations in HCI HCI relies on several key theoretical frameworks that guide how designers think about their work. Value Sensitive Design Value Sensitive Design (VSD) is a framework developed by Batya Friedman, Peter H. Kahn Jr., and Alan Borning (among others) that emphasizes deliberately integrating human values into information systems from the start, rather than treating values as an afterthought. This framework asks designers: What values should this system embody? Whose values matter? How do our design choices reflect (or fail to reflect) what we care about? For example, a social media platform might claim to value user privacy, but if the underlying architecture collects extensive behavioral data by default, the actual system values data collection over privacy. VSD forces designers to make these tensions explicit and intentional. The critical insight here is that technology is never neutral. Every design decision—from which data gets collected to how algorithms rank information—reflects choices about what matters. Value Sensitive Design makes those choices visible and deliberate. Human-Centered Artificial Intelligence As AI systems become more prevalent, Ben Shneiderman's framework of Human-Centered AI places human users at the core of AI development, rather than treating humans as secondary to algorithmic optimization. This matters increasingly because AI systems influence important decisions: hiring, loans, healthcare diagnoses, content recommendations. Human-centered approaches ask: Can humans understand why the AI made a particular decision? Can they intervene or override it? Does the system respect human autonomy? These aren't just nice-to-haves—they're essential for building AI systems that actually serve human needs rather than replacing human judgment indiscriminately. Augmented, Mixed, and Extended Reality Augmented reality (AR), mixed reality (MR), and extended reality (XR) represent a shift in how we think about the boundary between digital and physical worlds. Understanding Augmented Reality Augmented Reality overlays virtual (computer-generated) objects onto the real physical world. Ronald T. Azuma's foundational 1997 survey defined AR as systems that: Combine real and virtual elements Allow real-time interaction Register virtual and real objects in 3D space Common examples today include Snapchat filters (virtual glasses overlaid on your face), IKEA's furniture preview app (seeing how a digital couch would look in your room), or navigation arrows overlaid on city streets. The key distinction: AR enhances reality with digital information, but the primary focus remains the real world. The Mixed Reality Continuum Paul Milgram's 1994 taxonomy introduced an important conceptual framework: mixed reality exists on a continuum. At one end is the completely real environment; at the other end is a fully virtual environment. Everything in between—where real and virtual elements coexist and interact—is mixed reality. <extrainfo> This continuum helps clarify terminology: "augmented reality" is specifically the portion of the continuum closer to the real world, while "virtual reality" sits at the far end of complete virtuality. </extrainfo> This framing is important because it shows that AR and VR aren't completely different categories—they're points on the same spectrum. Presence and Immersion in Virtual Environments Mel Slater's research on place illusion and plausibility explains how immersive experiences actually work: Place illusion: The sense that you're actually in a particular location (your brain believes you're "there") Plausibility illusion: The sense that events happening in the virtual world are actually happening (your brain believes it's "real") Together, these two experiences create realistic behavior responses. If you design a virtual experience where you're standing on a narrow plank above a cliff, your body responds as if it's real—even though logically you know you're safe. This matters for training (flight simulators, surgical training) and design: understanding how presence works tells us what elements are necessary to create convincing experiences. Social and Psychological Aspects of HCI Humans don't interact with computers as purely rational processors of information. We bring our social instincts to our interactions with technology. Do Computers Act Like Social Actors? Clifford Nass and colleagues discovered something surprising: people unconsciously apply social rules to computers, treating them with politeness, responsibility, and reciprocity—even when people consciously know computers aren't social agents. In their 1996 research, participants rated a computer more favorably when it flattered them or they had previously been taught by it, just as they would with a human teammate. In a 2000 follow-up study, people responded to on-screen agents with social responses typically reserved for humans. Why does this matter? It means that interface design choices influence how people feel and behave in ways we might not expect. A rude chatbot might frustrate users not just because it's unhelpful, but because it activates genuine social offense mechanisms in our brains. The critical insight: User psychology matters as much as user task completion. People don't interact with interfaces purely functionally; social and emotional responses shape the experience. User Modeling and Adaptive Interfaces Different users have different needs, expertise, and goals. How can systems adapt to this diversity? User Modeling Fundamentals User modeling involves systems maintaining internal representations of who the user is—their goals, knowledge level, preferences, and constraints. Gerhard Fischer's foundational work establishes that effective HCI requires understanding: What users know: A beginner needs different guidance than an expert What users are trying to do: The same system serves different purposes for different people What users prefer: Interface preferences vary by personality, culture, and ability What constraints users face: Someone on a phone faces different constraints than someone at a desktop The practical application: Adaptive interfaces adjust themselves based on user models. Your phone learns your frequently-used apps and prioritizes them. Email clients learn which emails are spam. Recommendation systems adapt based on your behavior patterns. This creates a design tension: systems need to collect and analyze user data to personalize effectively, but that raises privacy concerns (which connects back to Value Sensitive Design). Good user modeling respects user autonomy and transparency. Research Methods and Design Approaches in HCI How do we actually know if our HCI designs work? Systematic Evaluation HCI research and evaluation (as outlined in resources like Jonathan Lazar's 2017 textbook) relies on systematic methods to understand how humans interact with technology and whether designs achieve their goals. These methods include: User testing: Observing real people using your system Surveys and interviews: Understanding user perceptions and experiences Behavioral metrics: Measuring task completion, error rates, time on task A/B testing: Comparing different design variations to see which works better The crucial principle: Make claims about user experience based on evidence, not assumptions. Designers often think they know what users want, but research frequently reveals surprising insights. Design Patterns HCI design patterns are reusable solutions to common interaction problems. Rather than reinventing how to design a navigation menu or a form every time, designers document successful solutions that work across different contexts. For example, a "breadcrumb" pattern (showing the path Home > Products > Category > Item) helps users understand where they are. Once this pattern is documented and shared, multiple teams can implement it consistently, improving overall usability because users encounter familiar patterns across different applications. Patterns create consistency, reduce cognitive load, and improve user experience by letting people apply knowledge from one interface to another. Foundational Knowledge: Classic HCI Resources <extrainfo> The outline references several classic HCI textbooks and handbooks that provide foundational knowledge. While these specific texts may not be directly examined, understanding the core principles they introduced is essential: Key foundational works include: Card, Moran, and Newell's "The Psychology of Human–Computer Interaction" (1983): Introduced formal cognitive models for understanding human performance with computers, including theories about how users process information and make decisions. Donald Norman's "The Psychology of Everyday Things" (1988): Emphasized fundamental principles of usability like mental models, feedback, and constraints. Norman's concept of the "affordance" (visual cues about how something should be used) became central to design thinking. Dix, Finlay, Abowd, and Beale's "Human–Computer Interaction" (2003): A comprehensive textbook covering theory and practice, used widely in HCI education. Jef Raskin's "The Humane Interface" (2000): Proposes that interfaces should be designed around human psychology and limitations, not forcing humans to adapt to technology. Comprehensive Handbooks (Jacko, Sears): Large-scale references collecting contemporary research and best practices. These resources matter because they establish the intellectual tradition that HCI is built on—the idea that technology should be designed around how humans actually think and work, not the reverse. </extrainfo> Key Takeaways Understanding HCI means recognizing that: Technology changes drive interaction possibilities, but social values drive what gets implemented for whom Theoretical frameworks like Value Sensitive Design and Human-Centered AI guide ethical, effective design decisions New technologies (AR/MR) create new interaction possibilities that still rely on understanding human perception and psychology Humans bring social instincts to technology interactions, which designers must account for User diversity requires adaptive systems and thoughtful user modeling Evidence-based evaluation should guide design decisions, not assumptions Design patterns create consistency and improve user experience across systems