Top

How GenAI Impacts User Experiences—Even Beyond AI

December 2, 2024

Generative AI (GenAI) is already changing our digital world. From helping people to write or rewrite their email messages to creating images, GenAI is poised to influence a broad spectrum of product user experiences—even those that are not directly driven by artificial intelligence (AI).

GenAI can alter users’ expectations, shift the ways in which they interact with digital products, and introduce new behavioral patterns. The resulting changes are likely to impact how users engage with products in indirect, but meaningful ways. In Part 3 of our series on UX research (UXR) for GenAI, we’ll share our thoughts on why we think it’s crucial for UX researchers to start updating our approaches to UXR now, even if GenAI isn’t on your near-term product roadmap.

Champion Advertisement
Continue Reading…

Evolving User Journeys Demand New Research Approaches

As GenAI becomes more common, user journeys are adapting, integrating AI-driven features in potentially unexpected ways. For example, traditional, linear user journeys might give way to more dynamic, conversational user journeys as AI responds to users’ inputs in real time.

To get ahead of this shift, map your current user journeys and identify opportunities for GenAI to improve or simplify user interactions. Begin predicting, as best you can, the points in a user journey at which you could add, eliminate, or expand features to leverage GenAI. Doing this should rely on both looking at users’ painpoints and identifying moments that could give humans joy. Identifying the painpoints could be especially beneficial in automating a user journey using AI, while figuring out how to maximize or magnify the moments of joy might deliver true delight and build loyalty and trust.

Use this opportunity to study the potential impacts of GenAI and consider how these user experiences might evolve. Then, identify what UX research you might need to conduct to maximize the value of UX research within the context of GenAI. Wherever possible, think about how users might react to these AI changes and what adoption challenges might arise, then try to leverage human-centered, AI best practices to build trust with users. By understanding these intersections early, you’ll be better able to anticipate how users’ expectations might change for your specific industry domain.

Spotting Areas of Opportunity—Not Simply Adding AI for AI’s Sake

Integrating AI simply because it’s a hot trend could lead to unnecessary product complexity and actually detract from users’ satisfaction. This could ultimately influence their levels of usage and trust. Instead, take a strategic approach: Once you’ve analyzed meaningful user data, map out where GenAI could genuinely add value, taking a user-centered point of view. Analyzing your user journeys to identify high-friction painpoints, then evolving them would be a great place to start.

Remember, GenAI needs to solve real user needs—not just be included as a novelty feature. You must consider the additional costs that using GenAI incurs—both the literal, financial costs of creating calls and tokens and the costs of implementing high-risk use cases or scenarios for which the technology might not yet be ready. For example, critical domains in which privacy and security are paramount such as healthcare, banking, and human resources (HR) would likely have additional requirements for performance and transparency, require mapping out edge cases to determine risk tolerance, and require that you conduct extra testing. We all have a role and responsibility in considering these costs. For UX researchers, this requires being honest and transparent about when and where AI can bring value from a user’s perspective.

Building Rigor into Our Research to Address Anticipated Changes in Users’ Perceptions and Trust

GenAI introduces new dimensions of user perception and trust. Questions about transparency, data use, and authenticity will likely arise as users interact with AI, even indirectly. Conduct preemptive UX research into users’ feelings about AI-driven products and assess their comfort levels with potential new features. Recognize the importance of each use case and compare AI-driven experiences with users’ current experiences when completing their tasks or use cases manually. For example, consider the experience of an employee who is performing a task within an existing, all-manual work setting versus that of a consumer who already uses GenAI.

Developing a robust, trust-centered approach to UX research can help you to anticipate changes in users’ perceptions and levels of trust. This can also help you to anticipate questions that users might have about where and how you’re leveraging AI, even if they don’t interact with the AI directly.

Strengthening Cross-Functional Collaboration Skills

Working with GenAI typically requires working closely with a broader, cross-functional team of stakeholders than the typical Design, Product, and Engineering teams. GenAI teams might also include data scientists, machine-learning (ML) engineers, quality engineers (QEs), linguists, and backend-focused product managers.

Identifying these key stakeholders and strengthening your relationships with them is critical to ensuring that your team can effectively translate user insights into AI-driven features that are also realistic in terms of the current state of the technology and data. Begin fostering these relationships now—even if your current work doesn’t yet directly involve AI. Building a solid foundation of cross-functional collaboration can help you more seamlessly advocate for users’ needs whenever AI becomes a part of your product roadmap.

Experimenting with Emerging, AI-Friendly Research Methods

GenAI can also transform traditional research methods. For example, using AI-powered sentiment analysis, conducting surveys using chatbots, and employing AI-driven data analysis tools can provide rapid user insights at scale. Start experimenting with these methods now, even on non-AI projects, to familiarize yourself with their strengths and limitations. Through practice, you’ll be better prepared to use these tools more effectively when the time comes, and you’ll have your toolkit ready for both AI and non-AI contexts. Nevertheless, you must always make sure that you adhere to company policies regarding what tools have been approved for use with company data—for example, on your intranet.

Adapting Our Toolkits and Mindsets

Even if GenAI is not currently your focus, proactively evolving your UX research approach now can help future-proof your UX design process. By identifying key areas of impact, expanding and refining cross-functional collaboration, and experimenting with AI-enabled research methods, you can prepare for the ripple effects that GenAI will inevitably have on the digital-experience landscape. In the fast-evolving field of GenAI, adapting early can ensure that you’ll stay at the forefront of user-centered design (UCD) and be ready to address the new challenges and opportunities that AI brings. 

Read the earlier parts of this series:

Senior UX Research Manager, AI/ML, at ServiceNow

Ogden, Utah, USA

Katie SchmidtAfter graduating with a Master’s in Experimental Psychology and publishing in the field of psychology and law, Katie began her UX career at Northrop Grumman where she was a lead UX researcher for enterprise experiences. She helped form the first team for enterprise UX at the company, then went on to manage several cross-functional teams focusing on internal and external products and experiences. Katie joined ServiceNow in 2022 as the manager for the Artificial Intelligence/Machine Language (AI/ML) UX Research team. Under her leadership, the team has grown in size and business influence, participating in history-making product roll outs for Generative AI. Her team has also emerged as a strong voice for the role of UX research in responsible AI and human-centered AI ethics. Katie values transparency, human connection, and loyalty as both a people leader and a voice in the field of AI.  Read More

Senior UX Researcher, AI/ML, at ServiceNow

Montreal, Quebec, Canada

Hayley MortinAs a Senior UX Researcher on the Platform Artificial Intelligence/Machine Language (AI/ML) team at ServiceNow, Hayley started her journey in AI working as a Data Annotator, where she learned about the AI development lifecycle while creating datasets for training computer vision. This foundational experience paved the way for her transition into UX Research, a move that was inspired by her academic background in Psychology and Behavioral Science. Today, she focuses on understanding how users perceive and approach adopting AI/ML technologies, and she explores ways to build trust with users through explainable AI design.  Read More

Manager & Strategist of AI UX Research at ServiceNow

San Diego, California, USA

Jessa AndersonJessa has over 15 years of experience researching human behaviors and needs, with a PhD in Health & Human Behaviors, and nearly five years focusing specifically on helping to understand the user experience of artificial intelligence (AI) in enterprise settings. She is a champion for humans and elevating the role of the human in the unique interplay between AI technology and users, across a variety of personas, from non-technical to highly technical. Outside of work, she is busy being a mom and soaking up the sun in San Diego.  Read More

Other Articles on Artificial Intelligence Design

New on UXmatters