AI in Action: Your Questions about AI Coaching, Skills Training, and Workflow Enhancements…Answered!

L&D innovators are making extraordinary strides in adding AI to their learning strategies and solutions, sparking questions about AI coaching, and they’re eager to show their work.

We helped a few of our own client-partners do just that at a recent Training Industry Tech Talk. Our whirlwind tour showcased seven projects that leverage generative AI (genAI) in three different ways: 

 

AI-Driven Learning Experiences: Using genAI to create highly personalized, adaptive learning solutions tailored to each learner

 

AI Workflows and Research: Leveraging AI to streamline an L&D team’s internal processes to improve productivity, while also conducting research to continually evaluate the accuracy and effectiveness of AI-powered learning experiences (above)

 

AI Training Programs: Creating training programs about AI that help to equip an enterprise workforce with the skills and knowledge they need to thrive in the rapidly changing age of AI

 

 

Gen AI L&D Playbook

 

Below are the questions that came up during this rapid-fire review (now with answers!): 

 

 

 

 

 

What programs do you use to create AI-driven learning experiences?

We’re technology-agnostic and are able to adapt our solutions based on the unique needs and organizational contexts of our clients. We’ve successfully integrated both Claude by Anthropic and ChatGPT by OpenAI into our solutions. Using a more varied toolbox helps us recommend the most effective solutions for their organization’s needs and existing infrastructure. We’ll work—and evolve—with the AI infrastructure, tools, and policies already in place.

Question two - Icon

 

 

 

 

 

Is genAI coaching technology best for individual or group training sessions?

First, a quick recap of Hilton’s genAI-powered, immersive Delivering on Our Customer Promise guest service skills coaching experience. It’s created with WebXR, a browser-based virtual reality (VR) technology that can be accessed via headset, computer, tablet, or smartphone. 

Learners—hotel team members—land in a digital twin of a Hilton property where they meet a concerned 3D-animated “guest” who expresses an issue with their stay. 

Learners must resolve the guest’s issue using Hilton’s five-step problem resolution model, HEART, and speaking their response into their device’s microphone. (Experience a scenario in this video excerpt from the Training Industry Tech Talk.)  

On the back end, a large language model (LLM) transcribes the learner’s speech into text and compares the content against a rubric. Learners then receive detailed feedback and a pass/fail “grade” on each step of the HEART model (See Q3 below for details on how we “trained” this LLM.) All feedback is delivered by VIC, Hilton’s knowledgeable, endearing robot emcee and coach. 

Delivering on Our Customer Promise makes for great individual practice because it gives learners a safe space to put nuanced conversational skills to the test. With its in-depth analysis of each learner’s responses and very personalized feedback based on what they said, this solution was designed expressly as an individual experience.

As custom content creators, we can also help a client-partner create a group-based immersive genAI coaching experience. For example, one learner’s interactions within the scenario might be screencast to the larger group, with a facilitator encouraging dialogue and reflection on each learner’s experience. We can create materials like a facilitator and/or participant guide to ensure a great discussion every time—with no prep needed!

Question three - Icon

 

 

 

 

 

How do you train AI coaches like Hilton’s?

We’ve already touched on the LLM behind Hilton’s Delivering on Our Customer Promise immersive coaching experience (Q2 above). Here’s how we crafted the prompt that powers VIC, the robot coach and emcee of the experience: 

  • 1. Creating a Knowledge Database: We considered the vast stores of knowledge and context an expert brings to a coaching interaction: a thorough knowledge of how to apply the five-step HEART model of problem resolution and coach team members to do the same, along with a wealth of examples of what good, great, and not-so-great look like. 

We then added this expert knowledge to a database that helps to increase the context for every prompt and also helps prompts to generate “relevant, accurate, and useful” results. This process, known as retrieval-augmented generation (RAG), extends the LLM’s capabilities in specific domains, such as an organization’s internal knowledge base.

  • 2. Role and Goal: We then told the LLM who it was and how it should behave. This LLM is a manager of a Hilton hotel, and its goal is to ensure that hotel team members are resolving each guest’s problem by correctly following the HEART model. This step gives the LLM a personality, backstory, and communication style that feels authentic, not mechanical—and contributes to the “story” that unfolds in each immersive scenario. We also fed this Role and Goal information back into the Knowledge Database (above) to provide further context for the prompt.
  • 3. Step-by-Step Instructions: Here, we provided additional context to the LLM by breaking down each step of the HEART model with very specific written descriptions. We then began to feed it with examples of desired responses to help clarify how learners should perform. 

This step is essential for an experience focused on nuanced skills like showing empathy: To respond accurately, the LLM needs numerous examples of what “good” sounds like. (As we hone the LLM’s understanding of a good response, we feed new iterations back into the Knowledge Base.)

  • 4. Constraints: To prevent the LLM from acting in unexpected ways, we worked with Hilton SMEs to define nonexamples. That is, responses that are inappropriate—for example, offering a free night’s stay. You guessed it: We feed these back into the Knowledge Base to provide additional context. 
  • 5. Pedagogy: Here, we conditioned the LLM to give feedback on the learners’ performance to help them reflect on their successes and opportunities—and correct their missteps during their next attempt. As we refine this part of the prompt, it, too, is fed into the Knowledge Base.   
  • 6. Testing: In this vital step, we engage Hilton’s SMEs to create further examples (and nonexamples) of potential HEART model applications and increase the quality of the feedback learners receive. On a continuous basis, SMEs test the scenarios and provide the development team with additional knowledge and context…which, in turn, is fed back into the Knowledge Base for further refinement.

 

Gen AI L&D Playbook

 

Question four - Icon

In terms of digital accessibility, do you have any experience or use cases in using AI to assist with ensuring we are meeting accessibility (WCAG 2.2) guidelines?

Yes! Our Accessibility team created a chatbot to use as a source of quick information about WCAG compliance. We “trained” the LLM via a similar process to that described above in Question 3; however, it worked less as a coach and more as an information-retrieval tool. Our team began by adding a Knowledge Base composed of detailed accessibility checklists, documents, and websites containing WCAG guidelines. The chatbot’s Role and Goal was to serve as an expert member of a learning team who had deep knowledge of accessibility. Because its function was to search existing information to provide answers to team members’ questions, it didn’t need to act as a coach or provide feedback on our team’s performance—though it certainly could be trained to do so!

Question five - Icon

How engaged do stakeholders need to be in an AI-powered experience like Hilton’s, versus a more traditional instructor-led training (ILT) or video instructor–led training (VILT)?

It takes a very collaborative process to create an experience like Hilton’s Delivering on Our Customer Promise. We needed Hilton stakeholders to go through the experience multiple times to help us vet the accuracy of the AI coach’s responses and refine the prompt accordingly. In more traditional modalities, such as ILTs, VILTs, videos, or eLearning modules, stakeholders only need to review milestone deliverables like presentation materials, storyboards, prototypes, and the final build. With AI simulations like these, though, more robust stakeholder involvement is required to ensure accuracy.

Question six - Icon

My company has banned ChatGPT for employee use. How prevalent is that stance, and how have you worked around it?

Quite prevalent, in fact! Cisco’s 2024 Data Privacy Benchmark Report finds that 27% of companies have banned GenAI applications altogether, at least for the time being. And with so many folks entering sensitive data into these applications—including confidential employee information and intellectual property—it’s not surprising that they’re feeling cautious. 

We don’t recommend working “around” a ban! If you’re curious about an AI tool, check it out—on a personal device, with non-work-related data. Meanwhile, we recommend that you ask your organization’s leaders about their security and ethical concerns and what’s at stake. What, if any, measures would need to be in place for them to consider an AI tool? Where could an AI tool help you shave budgets or timelines?

Knowing where your leaders are coming from and sharing your team’s AI aspirations empowers you to play an active role in your organization’s conversation. You’ll need an expert (or two) at the table to help you work through the many considerations and concerns every organization should address before leveraging any AI tool. We’re happy to help guide that conversation and even offer a customizable workshop that can help you and your stakeholders shake out their needs, concerns, and wishlists. (Wondering about this workshop? Check out this video excerpt.)

Question seven - Icon

When an AI learning solution is delivered to the customer, are you using a closed AI system?

Let’s start with a quick level-set on the distinction between open and closed AI systems in the eLearning landscape:

  • Open AI Systems: These platforms openly share their underlying code and training methodologies. This transparency allows the broader community to contribute improvements, customize the system, or even build entirely new applications upon it.
  • Closed AI Systems: These systems keep their code and training processes confidential, typically restricting access to a select group. In the eLearning context, this could mean limiting access within an organization to protect proprietary data or maintain control over the learning experience.

All of our AI-powered learning solutions are built upon closed AI systems. Doing so ensures the highest level of security for your data and allows us to tailor the solution precisely to your organization’s unique needs.



SweetRush Plunges Into 3rd Year as No. 1 Immersive Learning Provider

Since 2021, SweetRush’s leading-edge approach to immersive learning has earned first place on eLearning Industry’s list of Top Content Providers for Immersive Learning.

San Francisco, Calif., August 14, 2024SweetRush, a leading provider of innovative custom learning solutions, celebrates its third year at the top of eLearning Industry’s Top Content Providers for Immersive Learning. 

Christopher Pappas, eLearning Industry Founder, cites SweetRush’s technology agnosticism, L&D-first mindset, and expertise in AI-powered simulations for “deeper engagement, knowledge retention, and real-world skill application” as leading factors in its resounding success in immersive learning.

Adrián Soto, SweetRush Director of Immersive Technologies, exclaims, “Three consecutive wins! This is a victory we share as a team. Every line of code, every creative spark, every late-night brainstorming session has led us here. I’m incredibly proud of what we’ve achieved together.”

Danielle Silver, SweetRush Solution Architect, adds, “Winning this award for the third consecutive year is an incredible honor. It reflects our team’s dedication to experimenting with emerging technologies and pushing the boundaries of what’s possible in immersive learning. As the technology continues to advance, we’re able to craft even more authentic, personalized, and impactful learning experiences that encourage deep skill practice.”

Over the past year, the SweetRush XR team has been focused on generative AI-powered immersive simulations, which offer learners a more immediate and impactful experience. 

Leveraging its expertise in upskilling, AI tools, and experiential learning, the SweetRush XR team helps world-class client partners scale high-quality, personalized learning and coaching experiences to a distributed enterprise audience. At a recent Training Industry Tech Talk, the team showcased its winning combination of natural language processing (NLP) technology, authentic voice-driven avatar interactions, web-based immersive learning (WebXR) content, and innovative data systems. The result: personalized, adaptive immersive learning experiences that enhance learners’ skill development through authentic practice and feedback. 

The power duo of immersive learning and generative AI provides learners with the rich experiences, practice, and reflection that contributes to their personal and professional development—with zero “noise” from irrelevant information. Thanks to responsive, adaptive generative AI interactions, coaching, and feedback, learners encounter a wider range of situations and challenges than they could experience in real life, with plenty of space for reflection and restarts. Discover more about the VR + genAI pairing in the team’s latest eBook, The GenAI Playbook: An L&D Innovator’s Guide to Leading-Edge Learning Transformation

With a process founded in beginning-to-end consulting, or strategy mapping, the SweetRush XR team crafts custom solutions that meet every client’s specific needs, use cases, work environments, and infrastructure. Remaining technology-agnostic allows team members to work with a more varied toolkit and, in the words of one client-partner, create learning solutions that work “with, through, over, around, and under” existing technology and learning ecosystems. 

Clients describe the SweetRush team as “great thought leaders willing to push, and be pushed, in new and exciting ways” who “execute quickly to a high standard” and are skilled in digital transformation. With 130 (and counting!) Brandon Hall Group Gold Awards, 10 Chief Learning Officer Gold Awards, and top placement on numerous industry lists, SweetRush’s award-winning immersive learning solutions span a wide range of industries, roles, and skilling needs.

To discover more about how to enhance your learning portfolio with leading-edge immersive and generative AI-powered learning experiences, please reach out to Danielle Silver, XR Solution Architect

About SweetRush

SweetRush is trusted by many of the world’s most successful companies to help them improve the performance of their employees and extended enterprise. SweetRush is known for exceptionally creative and effective solutions that combine the best of learning experience design with highly engaging delivery. 

SweetRush services include custom L&D solution design and development, high-performing staff-augmentation talent, certification development, and innovative learning technologies such as VR, AR, and AI. SweetRush’s work has earned a long list of awards and accolades in collaboration with its world-class clients. Discover more at www.sweetrush.com

Our Clients’ Top 5 Priorities for AI in Learning and Development

Generative AI is rapidly advancing in capabilities and features. And just as quickly, L&D leaders are moving from research and initial experiments with AI to proof-of-concept projects and larger initiatives.

Exciting times—and a lot to keep up with!

We’re fortunate to work with clients across multiple industries, from hospitality to consumer goods, which gives us a great vantage point to see the top focus areas for AI in learning and development. 

Read on to find out how your peers are prioritizing and investing in AI, including real-world examples:

#1: Rolling Out AI Tools to Your Company and Teams

L&D leaders know that right on the heels of approving new technology, the next question from business leaders will be: When can we get the training?

Training isn’t limited to across-the-board basics—every team will have specialized training needs depending on how they use AI tools. Every department and business unit will have unique opportunities and risks, which means a LOT of custom training needs.

Here are two projects we’ve recently wrapped for clients to help them address specific, urgent needs for AI training.

Large online retail organization: Inclusive and responsible gen AI

As our client prepares for extensive discussions and promotions surrounding the expanded use of AI within the organization and in its products, it recognizes AI’s potential risks, especially to marginalized and vulnerable communities. 

Our client is committed to advocating for the implementation of safeguards and ethical considerations within AI technologies in addition to promoting its product. The training we are creating with this client is a key step toward achieving that goal.

Through this training, we’re equipping sales and marketing teams with a comprehensive understanding of responsible AI practices. The training’s focus is to upskill the audience on how to look for potential issues regarding fairness, privacy, inclusivity, equity, and diversity when using generative AI with the goal of helping customers use AI responsibly. 

Consumer lending company: Embracing the benefits of AI

The AI revolution is pushing everyone in every field to reconsider how they’ve been working and to embrace the possibilities that AI holds. In finance, AI can shift decisions that in the past were based on personal judgment to a place of greater fairness and equity. 

Moving beyond the tried-and-true old ways of doing things is not easy, and our client is supporting finance professionals in making this shift. The training we are helping to produce includes certification training on AI basics, its applications in credit assessment, and detailed learning on how to navigate ethical considerations, with high-quality video from experts in the field.

Rollouts of AI tools are moving quickly—if you need support in creating training for global or specialized needs, reach out and we’ll connect you with an expert Solution Architect.

 

#2: Creating High-Impact Learning Experiences

What gets our clients really excited about the use of AI for learning? The ability to create completely tailored learning experiences that adapt to text and voice input from learners. 

No more awkward role plays. No more ineffective multiple-choice questions. Learners can interact with training in unprecedented ways—and AI is making the dream of adaptive learning a cost-effective reality.

We’re working with multiple clients to create AI-powered training, including: 

  • Problem resolution and service recovery for a major hospitality client
  • Customer service for text-based response via a concierge chatbot
  • Coaching skills for leaders of a top consumer goods brand

These simulations harness advanced technology in dynamic training scenarios, and they offer secure settings to practice essential skills.

And, fitting skills practice into a busy schedule is now possible with AI-powered training.

Some of the key features include:

  • Speech-to-text technology: Learners engage with realistic avatars by using their own voices to drive the conversation. 
  • Dynamic conversations: We’ve evolved our AI technology from a single interaction point to the ability to have a dynamic back-and-forth conversation between the learner and the avatar. 
  • AI feedback tool: This tool provides personalized feedback to all learners individually based on how they responded and how well they applied their skills.
  • Sentiment analysis: This technology allows us to assess the delivery of how each learner responds. We can give learners real-time feedback on how friendly, confident, or aggressive their responses sound.
  • Playback functionality: Learners can play back an audio recording of their responses, giving them an opportunity for self-reflection.
  • Immersive WebXR technology: This technology creates a fully immersive, highly engaging experience that can be accessed via desktop or VR headset, enabling scaling to our clients entire enterprise

Check out this video of our work with Hilton creating high-impact, AI-powered coaching simulations.

 

#3: Streamlining Learning Content Creation with AI

Among the most sought-after expected benefits of AI in learning and development are the abilities to create content faster, improve efficiency, and reduce costs1. No doubt you’re looking to do the same!

We’re working on multiple clients on projects that include using gen AI to help:

  • Analyze content
  • Create learning objectives
  • Develop scenarios
  • Formulate assessment questions

In addition to text-based content development, we’re using artificial intelligence to create multimedia. In a recent project, we were able to create a rich, immersive environment by creating background graphics using AI tools. And for our online training client, we significantly reduced production costs while keeping engagement high.

Online training company: Generating video avatars using AI

Video content is particularly expensive and time-consuming, and it runs the risk of additional costs (reshoots!) if the course needs to be updated. 

Our client, a top provider of online training, wanted to streamline video development (no more onsite filming!), reduce total production costs, and capitalize on learning curiosity around AI. 

Utilizing AI, our subject matter expert quickly crafted their avatar, fine-tuning it for lifelike realism. Once created, the course scripts were seamlessly integrated, generating talking-head-style videos within minutes. 

These videos were then ready for post-production treatment with the SweetRush team and dramatically reduced our timeline—a game-changer! Not only did we deliver our top-notch SweetRush content, but we also delivered substantial savings in production costs, passed on to our client. To top it off, learners remained captivated as they witnessed AI in action. 

Interested in proven strategies for using AI to improve speed to market and reduce costs? Get in touch!

 

¹ https://donaldhtaylor.co.uk/research_base/focus02-talk-to-action/

 

#4: Quality Matters! Optimizing the Combo of HI (Human Intelligence) and AI

The race is on to find the best use cases for AI in learning and development, and yet we can’t brush real challenges under the rug in our eagerness to reap the benefits. Accuracy is still a real concern as the debate continues—can “hallucinations” be engineered away?²

Another concern that we and our clients are grappling with is the quality of content produced by Large Language Models (LLMs) versus that crafted by humans.

SweetRush is pioneering explorations in this area by conducting modern iterations of the Turing Test³; we are analyzing whether LLM-generated content stands on par with human-generated material. 

Through these studies, we harness the deep industry knowledge of Subject Matter Experts and Learning Experience Designers to pinpoint the respective traits of human and AI outputs. Is a “soul,” worldview, or authentic human perspective absent in AI-generated text, and if so, how might this impact the overall quality and reception of the content (i.e. if it were integrated into a training program, for instance)? 

Our approach ensures a balanced evaluation, creating scenarios that channel the strengths of both AI and human input, from deep factual knowledge to rich personal insights.

 

https://www.theverge.com/2024/5/15/24154808/ai-chatgpt-google-gemini-microsoft-copilot-hallucination-wrong

³ https://plato.stanford.edu/entries/turing-test/ 

 

#5: Securing Talent with AI Expertise

The war for talent has reached the AI shores. Research conducted by Randstad found a 2,000% increase in roles requiring artificial intelligence skills in 2023⁴. In some US states, there are more than 10 job ads for every AI professional.⁵

Yet our clients need talent—and in the early stages of adoption, they need specialized talent with the expertise to consult on AI policies, governance, roadmaps, and application. You are likely in a similar place, navigating a lot of new territory and needing help to cut through the confusion and keep your company and teams on track.

Experienced consultants can help you answer mission-critical questions, such as:

  • How can your people use AI? (And what’s off limits?)
  • What tools are you allowing your team to use? 
  • How are you mitigating risks of copyright infringement and issues of confidentiality? 
  • What about accuracy, ethics, and bias?
  • How are you discovering how to bring efficiencies and innovation by using AI? 

To get your arms around these issues and others, you need the expertise and support of an AI consultant, and we’ve built a bench of experts ready to support our clients.

 

https://www.unleash.ai/artificial-intelligence/randstad-chro-demand-for-gen-ai-skills-up-2000-in-2023/

https://www.ox.ac.uk/news/2023-10-09-expert-comment-ai-demand-booming-right-skills-and-technology-glue-guys

 

Navigating Exciting and Disruptive Times

Did these priorities resonate with you? There’s no doubt they will continue to evolve at pace with the rapid advancements in AI technology. 

We’re helping so many clients address their unique challenges with targeted AI solutions and expertise, and we’d be honored to help you as well. Please reach out and let’s discuss your needs!

 

 

Generative AI + Immersive Training: SweetRush’s Power Duo for Effective, Engaging Guest Service Training at Hilton

An insider’s look at leading-edge learning innovation at Hilton

We’re entering our second year of generative AI buzz, but organizations are just beginning to scratch the surface, with most using the technology to create first drafts, identify data patterns, and summarize lengthy texts. Meanwhile, they’re leaving nuanced human pursuits like critical thinking, creativity, relationship building, ethics, and navigating complex and ambiguous situations to…well, their humans. 

Training is another pursuit that’s been left to humans: None of the 1,600+ respondents to a global survey on the state of generative AI called out training as a use case. 

This vast, virtually untapped opportunity is what makes generative AI so exciting for L&D innovators—like our friends at Hilton. Read on to discover how the Hilton-SweetRush team set out on an exploratory mission into the heart of generative AI… and emerged with a leading-edge immersive learning experience.

Generative AI: Hilton’s L&D Use Case

With a robust portfolio of effective, engaging WebXR and native VR learning solutions, the Hilton-SweetRush team were already veteran immersive learning creators. Amazing experiences such as Hotel Immersion and Exceed with Empathy (see below) place learners in someone else’s shoes—and drop them into interactive, day-in-the-life scenarios that help them gain insight and empathy.

 

Generative AI: Hilton’s L&D Use Case by SweetRush

Learner Audience: Newly hired team members 

Purpose: Help learners gain empathy for hotel operations team members.

The Experience: The Hilton-SweetRush team wanted newly hired team members to experience a day in the life of the hotel operations team members who drive results via brand standards. In this energetic simulation, learners land in a Hilton hotel—and work against the clock to assemble room-service trays, clean a guest room, and check guests in at the front desk. Learners access this experience via a headset, which gives them the freedom to move around and interact with objects in these 3D spaces.

Generative AI: Hilton’s L&D Use Case by SweetRush

Image: 94% of learners reported increased empathy for hotel operations team members as a result of their Hotel Business Immersion experience

Learner Audience: Hotel operations team members

Purpose: Help learners develop empathy for guests. 

The Experience: Learners step into the shoes of a guest waiting in a long line to check in, after hours of travel; a guest who’s served the wrong order at the restaurant; and another who finds that the conference room they’ve booked is improperly set up. After each experience, they reflect on their mood, gain greater insight into the guest experience, and discover how to exceed guest expectations.

Image: 95% of learners agree they had more empathy for hotel guests as a result of their Exceed with Empathy experience.

In spring 2023, the team began to wonder how they might leverage generative AI to take Hilton’s immersive learning game up a notch. The timing was right, and so was the learning need: Create an engaging, effective, and scalable immersive experience to help hotel operations staff practice their guest service skills. 

Read on for background about the business and learning needs—and how the team met them with creativity, ingenuity, and industry-first technology. 

Hilton’s Business Need: Deliver a Reliable and Friendly Stay

Guest feedback shared the wish for a reliable, consistent, and friendly stay, where team members treat every guest like a friend. Thus the powerful impetus for Hilton’s leading-edge guest service skills training was born. 

This impactful learning journey, called Make It Right, features a variety of bite-sized eLearning modules, pre-shift team meetings, videos and more.  

One part of Make It Right focuses on service recovery with HEART, Hilton’s five-step problem-resolution model (see below). 

Service recovery offers Hilton team members a powerful opportunity to show guests how much they care-and can even elicit more guest loyalty than delivering a perfect stay in the first place (a phenomenon known as the Service Recovery

Generative AI: Hilton’s L&D Use Case by SweetRush

At this stage in the learning journey, Hilton team members are equipped with a good understanding of HEART. But knowing the five steps and their purpose and putting them into practice—especially under pressure—are two different things. 

Like so many interpersonal skills, service recovery requires plenty of trial, error, and feedback before learners achieve competency. While role-plays are one way to achieve this, Hilton chose a virtual environment to build confidence with their teams during their training process.  

Would this catch-22 derail the opportunity for hands-on practice of the HEART model? Not for the Hilton-SweetRush team!


WebXR and Generative AI: Scalable Immersive Learning for Hilton’s Global Audience

The Hilton-SweetRush team rose to the challenge by creating a capstone experience that brought hands-on HEART practice to team members across all its hotels

How? By leveraging WebXR, a super-scalable virtual reality learning technology. 

Because WebXR content lives on a web browser and can be accessed by learners with or without a headset, it’s an ideal modality to bring the benefits of virtual learning to a distributed global audience like Hilton’s. 

Generative AI: Hilton’s L&D Use Case by SweetRush

Helping Hilton team members speak from the heart was the perfect learning use case for WebXR. To practice these vital service recovery skills, they created the Delivering on Our Customer Promise experience. This WebXR- and AI-powered simulation drops learners into three different scenarios with concerned guests, each of whom explains their problem and waits expectantly for a response.

 

Artificial Inteligence Training by SweetRush

These scenarios make learners sweat a little, just as real service recovery situations do. Yet rather than risk real relationships with Hilton guests, they find their feet—and voices—within a safe, authentic virtual practice space.

 

Generative AI: Hilton’s High-Tech Human Skills Coach

Hilton’s Delivering on Our Customer Promise WebXR adventure was already a leading-edge learning experience—but the team’s addition of generative AI lands it among L&D industry firsts. 

Here’s how generative AI helps learners make it right: After listening to the guest explain their problem, learners speak their response into their device’s microphone, using the HEART steps they’ve learned.

The simulation records their response, converts it into text, and feeds the text of the response into a Large Language Model (LLM). On the back end, the LLM, which has been carefully “trained” by SweetRush SMEs, creates a response to the learner’s attempt. (Discover how SweetRush’s exacting SMEs systematically trained the LLM to evaluate learner input and deliver relevant, actionable feedback.)

Artificial Inteligence Training by SweetRush
Learners receive feedback and a grade of pass or fail on each step of Hilton’s HEART model. Though most learners can tackle the HART, most find the E, or Empathize, to be a challenge.

After completing each scenario, learners can then reattempt it as many times as they like, receiving targeted feedback each time.

Learner Experience (LX): Designed by Experts, Hosted by VIC

To create the greatest impact, the team focused the WebXR experience on three different scenarios, all based on top guest problems: 

  • Room climate controls
  • Food and beverage options
  • Special room requests not met

Using their best storytelling and dialogue-writing practices, the team built branching scenarios featuring a guest interaction in different areas of the hotel. These in-room, front-desk, and breakfast-area conversations could end with positive, negative, or neutral results based upon the learner’s input. 

The instructional designer worked closely with Hilton SMEs to craft realistic guest scenarios—and responses that matched Hilton’s high standards and signature service recovery methods.

 

Artificial Inteligence Training by SweetRush
This guest visits the front desk to express frustration with the air conditioning unit in her room. It rattled all night, and she didn’t get any sleep. The learner’s challenge: Respond with HEART.

 

Artificial Inteligence Training by SweetRush
This guest has been working on a presentation all morning and missed breakfast. Learners think on their feet to offer a heartfelt resolution.

 

Artificial Inteligence Training by SweetRush
This guest hasn’t received the in-room amenities he requested when he made his reservation. The learner has only moments to Make It Right.

Making It Look, Sound, and Feel Right: Designing in 3D

Appearance matters for a 360° immersive experience, and a realistic setting is an important part of creating an authentic immersive scenario. The team custom-created these lifelike settings by taking photographs at real Hilton properties—and the SweetRush extended reality (XR) team built depth and detail into each scene. 

The guests’ avatars needed to be as diverse and expressive as Hilton’s guests are in real life, with the tone of voice, gestures, facial expressions, and posture that reflects their mood and level of satisfaction. 

Why this painstaking care? To truly immerse learners, they need to feel that they’re face to face with a real guest in a real Hilton hotel.

Because of the complexity of the scenarios and their different potential outcomes, the creative director, instructional designer, and XR team worked closely together to ensure that the content, audio, and visual treatment informed one another. 

Artificial Inteligence Training by SweetRush


Like any great guest experience, the HEART model training
experience needed a great host who would encourage learners and serve as their guide throughout all three scenarios. VIC, Hilton’s friendly robot emcee (and breakout star of previous VR experiences), was up to the task, hovering in the scene with helpful instructions, a HEART walkthrough, and learner feedback. (Join us for a demo of this leading-edge immersive AI coaching experience at Training Industry’s Leader Talk: Using AI to Transform Content Development.) 


Leading-Edge Learning at Your Organization: Leverage Generative AI Coaching and Immersive Training for Your Unique Needs

Feeling inspired by Hilton’s generative AI-powered, immersive learning VICtory? We’re with you!

We’ve loved sharing the story of how one innovative client-partner leveraged the leading-edge powers of WebXR and generative AI to meet Hilton’s deeply human business need: a warm welcome and friendly stay for every guest. 

If you’re curious about how to apply WebXR and generative AI to your organization’s unique needs and learners, we’ve got you covered! 

SweetRush Ranked #1 Top Content Provider With AI Tools Expertise

As one of the Top Content Providers With AI Tools Expertise, SweetRush employs a multifaceted and holistic framework approach, leveraging AI’s capabilities – such as for AI coaching – and consulting with clients on how to successfully scale AI-driven projects to their enterprise.

San Francisco, Calif., April 8, 2024 – SweetRush is honored to top the eLearning Industry’s Top Content Providers With AI Tools Expertise list in 2024. 

Best known for its learner-centric custom learning solutions that blend instructional design best practices with agency-level creative design, SweetRush has been disrupting the L&D industry since 2001 and has been judged by many as the world’s most innovative learning provider.

Says Adrian Soto, SweetRush Director of Immersive Technologies, “These days I spend a good deal of my time helping clients make sense of all the technology-fueled changes that are happening in our field, and AI certainly tops the list. I would add that everyone is excited but also afraid of falling behind, and so for me this moment has allowed us to go deeper with clients and go beyond the more traditional capabilities demo.”

The real power of SweetRush’s approach to utilizing AI — for AI-driven coaching, for example — is to view development in a holistic manner, recognizing that AI implementation takes a recipe to work and all the ingredients have to be present and in balance. While AI prompt engineering is important and gets a lot of attention, all “ingredients” are essential. Beyond training the AI, for an AI project to be successful, teams must consider visual design, learning-experience design, project management, development architecture and integration, user testing, and prototyping. And IT and security concerns have risen to the surface and need serious attention and due consideration. 

“What I have observed is that clients are eager to jump in and engage AI, but more than ever they are choosing to work with us because of trust,” says Dani Silver, SweetRush’s Solution Architect. “The array of capabilities have to be present, but when you are marching off together into an ever-changing landscape, the trust element has become paramount.”

Empowering Learning: SweetRush’s AI Solutions and Immersive Experiences

SweetRush recently rolled out an AI-driven coaching experience for Hilton based upon three customer problems that require a response from the learner and then real-time feedback from an AI coach. Based on the success of the program, 19 more scenarios are now in development. For another client, SweetRush is incorporating advanced voice sentiment analysis and is looking at eye tracking on its technology roadmap.  

To effectively scale and roll out an AI program to an enterprise, SweetRush has led the industry in WebXR implementation, which enables immersive experiences to be taken with a VR headset or on a desktop computer. SweetRush has tools to deliver these experiences and connect to its client’s LMS, all the while tracking essential data. This versatility enables scaling and validates the upfront development costs while enabling SweetRush’s clients to leverage the power of AI. 

Says eLearning Industry Founder Christopher Pappas, “In today’s digital landscape, businesses are constantly vying for attention amidst a sea of training content and vendor options. Standing out requires more than just creativity; it demands strategy fueled by cutting-edge technology. And using AI tools like a pro is a must. This is where teaming up with one of the top content providers boasting AI expertise becomes not just advantageous but imperative.”

As a life-centered company, SweetRush is honored to work with client-partners who share a passion for building a better world and for creating learning experiences that touch lives, empower people, and create connections. Through SweetRush’s La Maestra initiative, every learning project also leaves a lasting legacy in the form of trees planted in Costa Rica’s Limón province.

About SweetRush

SweetRush is trusted by many of the world’s most successful companies to help them improve the performance of their employees and extended enterprise. SweetRush is known for exceptionally creative and effective solutions that combine the best of learning experience design with highly engaging delivery. 

SweetRush services include custom L&D solution design and development, high-performing staff-augmentation talent staffing, certification development, cultural alignment, and innovative learning technologies such as VR, AR, and AI. SweetRush’s work has earned a long list of awards and accolades in collaboration with its world-class clients. Discover more at www.sweetrush.com.

Experience Required: How Virtual Reality Supports Learning and Skilling in a VUCA World

Designing Effective Learning for Interesting Times

It’s no secret that our world is in flux—in fact, “flux” is a bit of a euphemism. 

The convergence of geopolitical, economic, social, health, and climate emergencies makes for a volatile, uncertain, complex, and ambiguous (VUCA) global environment, also known as a polycrisis. Polycrisis occurs when numerous “shocks, deeply interconnected risks and eroding resilience” add up to an impact exponentially greater than that of any single factor alone. 

No wonder so many of us are feeling a “pervasive sense of unease and uncertainty.” 

How Virtual Reality Supports Learning and Skilling in a VUCA World

We face an additional layer of uncertainty at our workplaces in the form of rapidly evolving technology, procedures, and client expectations. (Exhibit A: The impact AI has had in the span of a few months). 

As much as we L&D folks value professional growth, it can be overwhelming to consider how much we need to learn and adapt just to keep current…and we’ve got to do it all while building solutions that help learners do the same. 

Antidotes to Unease: Agility, Adaptability, and Resilience

Learning the ins and outs of any one technology isn’t the answer: L&D leaders need a change-friendly mindset and nuanced skills to help us identify “patterns among the noise” and “look at the world through multiple stakeholder perspectives.” 

L&D professionals recognize this need, citing agility and adaptability as the No. 1 skills in demand at their organizations in 2022 and 2023. 

Adaptability and agility are vital to learning teams and the learner audiences they serve…and they have a prerequisite: resilience. This ability to detach from reactivity and switch on the higher-order thinking we need to navigate our VUCA workplaces and world. And we need to cultivate it before we even think about adding role-specific skills and knowledge to our own to-do lists…or those of our learners.  

But here’s the conundrum: During VUCA times, when humans are most in need of new ideas, mindsets, and competencies, we’re least able to take them in.

How can we help our learners (and ourselves) grow as people and acquire needed skills and knowledge, when uncertainty takes such a high cognitive toll?

Friends, we need to go vertical. 

Going Vertical: Growing Resilience 

It’s no secret that the stress of a VUCA environment decreases our capacity to take in new skills, knowledge, and methods. This type of learning, known as horizontal development, is the type of professional development offered by most workplace learning solutions. 

In contrast, vertical development helps us cultivate the personal adaptability, agility, and resilience that expand our minds and create the space to accommodate those new skills, knowledge, and methods. 

Vertical development expert Nick Petrie describes the relationship between vertical and horizontal development as akin to a cup and water: Whereas horizontal development fills our “cup” with more concepts, techniques, and skills, vertical development enlarges the capacity of the cup. 

How Virtual Reality Supports Learning and Skilling in a VUCA World

We grow our cups, or develop vertically, over the course of encountering, navigating, and reflecting upon a wide range of life experiences—an open-ended process that requires time and perspective. 

Yet learners need future-ready skills…yesterday. Here’s how to grow their capacity without overfilling their cups. 

Virtual Reality: Experience and Perspective, from Concentrate

What if we could speed up the learning process by distilling life’s most teachable moments and allowing learners to go back and replay?

That may sound like the stuff of science fiction, but plenty of L&D leaders are doing just that…with virtual reality (VR).

Learning in VR provides learners with the rich experiences, practice, and reflection that contribute to vertical development—with zero “noise” from irrelevant information. And when delivered via a headset with hand controls, VR experiences help learners shut out the pings, tasks, news alerts, and other distractions that shrink their “cup.” 

In VR, learners can be transported into a digital twin of their workspace, an emergency situation, a fraught interaction, or an impossible scenario—and the 360-degree environment gives them the illusion of “being there,” or a sense of presence. Because it’s more like our 3D physical world than a 2D screen, VR learning content also helps to boost learning transfer. 

The (VUCA) reality is that the skills learners need most are the ones that they (and their organizations) can least afford to get wrong. Yet learning requires practice, trial, and error. 

L&D teams, too, are under pressure to find ways to upskill learners faster and better, without risks to safety, property, or relationships. VR helps minimize these risks by providing a safe practice environment where learners can practice, get feedback, and refine their skills at their own pace.

Here’s a fun paradox: The self-paced nature of VR learning experiences actually reduces time to proficiency. A PwC study focused on empathy training found that learners trained in VR develop new skills four times faster and feel 40% more confident in applying what they’ve learned

This level of competence and confidence would normally take months or years to acquire. However, VR content empowers learners to confront a wider range of situations and challenges than they could experience in real life, at a pace that allows for the vital reflection that supports their vertical development. 

The (Virtual) Reality Principle: Common Obstacles to a VR Learning Strategy

Here’s another reality of learning and skilling in a VUCA world: L&D leaders are increasingly asked to do more with less, and faster. Though they recognize the benefits of learning in virtual reality, they face a few common obstacles to implementing a VR learning strategy. These include: 

  • Scalability: VR works well with a smaller learner population, but can be a challenge to distribute to a large global audience. The hardware investment can be prohibitive, as can the learning curve in how to use VR headsets and hand controls. 
  • LMS compatibility: For better or worse, many organizations are married to a specific LMS or LXP, and all learning content needs to live under the same roof for reasons of security, practicality, and/or maintenance. 
  • Data analytics: Tracking learner completion and performance is another must-have, especially for compliance training and other high-stakes content. L&D teams, too, need access to the data to respond to learners’ needs, refine learning experiences, and demonstrate the ROI of learning solutions. 

Read on to discover a solution that empowers L&D leaders to overcome all of these challenges and bring the benefits of VR to every learner. 

Introducing WebXR: The Gateway to Immersive Learning

Meet WebXR, the web-based immersive learning solution that empowers L&D teams to create immersive experiences for every learner, with or without a headset. It’s also great for augmented reality (AR) and mixed reality (MR) content—but, for now, we’ll focus on VR. (Looking for an in-depth introduction to WebXR? Check out our comprehensive guide.) 

Here’s how WebXR helps us clear those common hurdles: 

  • Scalability: WebXR experiences live on a server, like any website or web application. Learners can access them via a headset, for a fully immersive experience, or via their laptop or desktop computers, for an engaging, first-person video game-style experience. There’s no need to invest in hundreds (or thousands) of headsets up front; your organization can ramp up its immersive learning strategy over time. 
  • LMS compatibility: Thanks to our LMS Integration Tool (LIT), WebXR content can live happily in your LMS. Learners can even launch WebXR experiences from existing eLearning courses for a seamless experience. 
  • Data analytics: Immersive learning content generates rich data far beyond scores and seat time. Thanks to LIT’s customized Analytics Dashboard, your LMS and your WebXR experiences can “talk” to each other and capture the learner performance data that matters most to you and your stakeholders.  

If you’re like lots of L&D leaders, you might be wondering how WebXR content looks on a desktop computer versus a headset, how it compares to a native VR application, and whether you’ve got a use case. We’ve got answers to these questions and more!

If you’re looking for a full walkthrough of WebXR, our expert hosts are here for you with this comprehensive webisode

WebXR: Brought to Us by Interesting Times

Our current VUCA moment has some silver linings: As L&D leaders and innovators rise to meet it, we’re discovering new ways to meet the skilling needs of our organizations and learners. These strides in learner-centered design aren’t just effective; they’re also engaging, enjoyable, and a welcome respite from the traditional training to-do list. 

As learners, technology, and the workplace continue to co-evolve, WebXR content empowers us to bring growth experiences to more of our people and help them build skills and resilience amid rapid change. It also empowers us to serve our learners better by providing them a virtual practice space where it’s safe to try, reflect, and try again—all while preserving their time and bandwidth.  

Looking for ways to start the conversation about meeting evolving workplace needs with WebXR content? Inspire your stakeholders and leaders with talking points from our in-depth guide to this versatile learning technology. You’ll find a rainbow of use cases, success stories from fellow learning innovators, and details about WebXR’s data and LMS superpowers.

Frequently Asked Questions about Immersive Learning with WebXR Content

Or: Why No Headset = No Problem

L&D leaders and innovators are more aware than ever of the benefits of immersive learning: Who wouldn’t want to upskill learners faster, better, and for the long term

But even the most forward-thinking L&D folks can face challenges to implementing their immersive learning strategy. Here are a few we heard from our client-partners: 

How can we scale to our vast, distributed workforce? We’re not quite ready to invest in thousands of headsets. Our LMS doesn’t play well with immersive learning. We need to track data on learners’ skills and progress.

Friends, we’re happy to introduce a learning solution that clears all of these hurdles: WebXR. 

If you’re anything like our client-partners, you probably have a million questions! Let’s start with 18 of the most frequently asked questions they ask us about WebXR. (Prefer to stump us straightaway? Reach out! We love a challenge.) 

1. What is WebXR? And what’s the difference between WebXR and native VR?

Let’s start with the ”XR” part of WebXR, which is short for “extended reality.” XR is an umbrella term that covers virtual reality (VR), augmented reality (AR), and mixed reality (MR) experiences. See the image below for a tutorial on the five types of reality.

The reality continuum webxr

Now let’s talk about the “web” part of WebXR—as you may have guessed, WebXR technology gives us the ability to create VR, AR, or MR experiences that can be accessed via the web, no special equipment required.

Though WebXR technology can be used to create any type of digital environment, we’ll focus our Q&A on VR learning experiences created in this versatile immersive technology. 

So, what’s the difference between Native VR and WebXR?

  • Native VR applications offer a fully immersive experience delivered via an application that must be downloaded and installed on a headset
  • With WebXR, learners access immersive content either via a VR headset or via a laptop or desktop computer. A headset offers full immersion, just as native VR application would; a computer offers an engaging 3D experience much like a first-person game.

This flexibility is the main reason learning leaders are leveraging WebXR—and why we’ve affectionately nicknamed WebXR “the gateway to immersive learning” (See Questions 3 and 4 for more details).  

2. What types of experiences are best for learners new to immersive technology?

Immersive technology allows us to create a safe, authentic 3D practice environment that lends itself to a wide range of use cases, from hands-on to heartfelt. That covers everything from hazardous waste cleanup and machinery maintenance to difficult conversations. 

Once upon a time, technical training was the dominant use case for VR. Imagine a native VR application featuring a digital twin of a manufacturing environment where learners could get the hang of specialized equipment, machinery, and procedures—all without harming people or property. 

That’s still a great use case! The safe, immersive practice environment speeds learners’ time to proficiency, reduces errors, and enhances retention.

But as workplaces and job roles continue to evolve, learning innovators are embracing VR solutions for a wider spectrum of use cases, including nuanced interpersonal skills like empathy and de-escalation. 

In the most immersive VR learning experiences, features such as voice recognition, movement tracking, and eye tracking can help learners review and learn from missteps. But all levels of immersion can help learners walk (or work) a mile in someone else’s shoes. VR_A_Rainbow_of_Use_Cases

3. My organization isn’t quite ready to invest in headsets for our distributed learner audience. Can I still use WebXR? 

Absolutely! Many of our client-partners face challenges with headset logistics but still want to leverage immersive 360° content for a more engaging, authentic learning experience. We launched WebXR to help them overcome that challenge.

Unlike native VR applications, which need to be downloaded and installed on a headset, WebXR learning experiences live on the web (See Question 1). Learners can access these experiences either through a headset or their laptop or desktop computers. (That’s how we’ve developed our reputation for saying, “No headset? No problem!”)

We recently worked with a global retailer who shared this concern: We partnered with them on a WebXR solution that they distribute to their learners via tablets and mobile phones. The experience is much like an advanced web simulation: Learners click through to explore the virtual space, engage with activities, and receive feedback as they upskill and apply their newfound knowledge. 

4. Which devices can be used with WebXR content?

Learners have the choice of accessing WebXR experiences via a VR headset or a laptop or desktop computer. We call this choice device optionality, and it’s one of the reasons WebXR works so well for organizations looking to gradually ramp up their immersive learning strategy…without investing in thousands of VR headsets all at once.

5. How do the hand controls work on the desktop? 

Learners use a mouse, trackpad, or keyboard to move around the experience, just as they would any website or application. The desktop experience offers a level of immersion much like that of a first-person game or an advanced web simulation (See Question 2.) 

6. Can learners access WebXR experiences from my LMS? Can it track data?

Yes, they can! Thanks to our leading-edge LMS Integration Tool (known to fans and friends as LIT), your WebXR experiences can live in, and launch from, your LMS—all while gathering, storing, and displaying the learner performance data you and your stakeholders care most about. 

With LIT, learners can launch a WebXR experience directly from an existing eLearning course. When it launches, it cues learners to choose the device they’ll be using: headset or computer. They then proceed seamlessly to the WebXR experience. 

While they’re immersed, LIT and the LMS share data about learners’ identities and performances; The WebXR experience “reads” learners’ identities from the LMS and reciprocates by bringing in-experience performance data back to the LMS. 

LIT WebXR

What kinds of performance data, you ask? We’ll work with you to customize what matters most to you and your stakeholders. Say you’re interested in sentiment analysis to help your learners improve their communication skills within a customer service interaction. 

Chances are, your LMS doesn’t know how to process these metrics. But LIT solves that problem with its handy sidekick: the LIT Analytics Dashboard. The Dashboard captures and displays a customized set of learner performance data. 

Your next question is probably, Will LIT work with my LMS? From our experience deploying content on hundreds of LMSs, our working answer is “yes.” We’ll work with you to help your immersive learning content build a beautiful relationship with your LMS.

7. In terms of data analytics, can we track the users’ movements, gaze, etc., within the experience? 

This question is a bit of a “yes, and”: It depends on several other pieces of the immersive learning puzzle. 

The “yes”: We’ll absolutely work with you to customize the learner performance data you collect to provide insight on the metrics that matter most, from tone-of-voice analytics to gaze tracking and reaction time. 

The “and”: The data you need to track and the skills you need learners to master will influence the type of immersive experience we build together. We describe these variables in terms of three levels of activity:

  • Active: Learners need full presence to interact physically with objects within the 3D environment: for example, to learn how to operate a machine. Active experiences are best as native VR applications, in which learners use a headset and hand controllers to interact with objects in a fully immersive 3D environment. With an active experience, you can track performance data that help you track the learners’ responses to their full environment, from gaze to gesture to physical posture. 
  • Semi-Active: Learners have some agency to move around, explore, and identify items within the 3D environment: for example, identifying hazards in a manufacturing environment. Semi-active experiences work well in either WebXR format or as a native VR application. 
  • Passive: Learners observe the environment and interactions around them as they travel through a 3D environment: for example, by taking a virtual tour or making decisions. Passive experiences work well in both WebXR and native VR formats. 

When we create an immersive experience for the web, we need to design for what Adriȧn Soto, Director of Immersive Technologies, calls the ”least common denominator” (LCD), or the lowest level of immersive technology learners might use to access the experience. 

In the case of WebXR experiences, the LCD is the mouse and trackpad, which limits the level of immersion and interactivity we can offer. WebXR is the perfect choice if our goal is to create a great conversational simulation that doesn’t require full-body interaction with the environment. 

But if we need to create an experience to teach full-body, fine motor skills such as machine operation or hazardous waste removal, our LCD can’t go any lower than the VR headset and controllers. That’s why active experiences call for a native VR application: there’s simply no way to learn these skills via a laptop or desktop experience.

Three_Types_WebXR

8. Are voice analytics available in the desktop experience, or just within the headset? 

They’re available in both! In a recent WebXR project with our client-partner Hilton, we used a built-in AI voice recognition tool to coach learners through high-stakes interactions with dissatisfied guests. This amazing tool provides real-time feedback not only on the words learners choose and their strategy for solving guests’ issues, but on their tone of voice as they connect with the guest and express empathy. Best of all, they’ve got unlimited attempts to get it right: In WebXR-world Hilton, there’s no risk to real guest relationships as learners practice thinking on their feet (and with their hearts). 

9. How are the scenarios, characters, and interactions in a VR experience created?

Though we love geeking out over new technology, we’re learning experience designers first and foremost. We start with curiosity about you and your learners: We’ll analyze your existing content, talk to your subject matter experts (SMEs), and clarify the learning need and performance objective(s). All of this analysis culminates in (drum roll)…a high-level design document.

Once we’ve landed on a high-level design, we’ll storyboard your immersive experience and build the scenarios that will give the learner firsthand experience of how it looks, sounds, and feels to get things right (or wrong!). Then we script those out, creating periodic demos and prototypes for your review. Once we’ve landed on the right design and experience, we literally sprint into production. 

It takes a village to produce an alpha version of an immersive learning experience, and our team of 3D tech artists, 3D animators, developers, and engineers rise to the occasion by building custom 3D assets and interactions using the tools and software that best fit your needs. 

Then, User Experience and User Interface (UX and UI) specialists review the overall experience to ensure that the overall flow—and the position and placement of instructions, controls, and other elements—are intuitive. Because many learners will be new to immersive learning, onboarding them to the technology is a vital part of the learning experience. 

SweetRush_development_process

10. How does low bandwidth affect a WebXR solution’s performance?

Like any web content stored and accessed from a server, WebXR content relies heavily on internet connection and speed. If bandwidth will be a challenge, a native VR application might be a better fit. It can be downloaded and installed on a headset in a location with a strong signal and utilized anywhere the headset can travel. (Of course, you’d need to repeat this process for any updates.) Striking a balance between scalability and bandwidth can be complex—we’d love to help you figure it out!

11. How could WebXR be used in employee engagement activities?

A multiuser WebXR environment can help us collaborate, enjoy more engaging learning experiences, and meet the next generation of workers with the level of technology they expect. We love building multi-user WebXR spaces that help people gather in real time to whiteboard, brainstorm, prototype, and workshop ideas. 

In these immersive “third spaces,” we can mingle naturally with one another and experience more of one another’s unique personalities (dare we say quirks?). But they’re not just for goofing off: They also allow us to get curious about what our peers are doing, tag along, and learn from them. 

We can also use WebXR for more structured multi-learner experiences. One of our favorite modalities is what we call Virtual Reality Instructor-Led Training (VR-ILT). VR-ILT not only brings us together for the live learning experiences we’ve all been missing, it also provides immediate opportunities to practice new skills and receive real-time feedback. 

In VR-ILT, the instructor has the ability to control variables in the environment and use real-time data to differentiate instruction for every learner. These data also show when learners have reached proficiency and when they need additional practice (pp. 32–34).

12. Can WebXR be used for marketing and trade? 

Absolutely–that’s a great use case! In fact, many of our client-partners find plenty of creative ways to share and leverage their 3D digital assets across teams and functions at their organizations. 

To help them maximize the ROI of their 3D assets, we use an end-to-end consulting process called strategy mapping. Together, we explore potential use cases that could add value to the employee, client, and community member experience. 

Here’s an example of how a hospitality client might leverage a digital twin of a hotel: 

Four_ways_of_looking_at_virtual_Hotel

13. How many learners can use a particular WebXR solution at a time? 

The number of simultaneous users a WebXR experience can support depends on server capacity. Project scope (and budget) grows with server capacity needs.

Need to strike the perfect balance between server capacity and scope? We can help!

14. Where is WebXR content hosted? 

WebXR experiences are hosted by a server, like any website or web application. Unlike native VR applications, WebXR content does not need to be downloaded and installed on a headset. 

15. What about privacy?

Like so many variables in WebXR solutions, the security of proprietary content and learner data depends upon your organization’s privacy policy. Our default stance is not to handle personally identifiable learner information—unless a client-partner absolutely needs us to do so. In those situations, we work together to build safeguards into the WebXR solution to protect both learners and the organization. Because privacy and security measures can significantly impact a WebXR project’s complexity, scope, and budget, we start that conversation early…and revisit it often!

16. Does everything need to be custom-built? Are there off-the-shelf WebXR learning experiences, or would we need to partner with a third party?

As with traditional eLearning, the choice to buy, build, or blend has everything to do with the learning content and experience you want to offer your learners—as well as your timeline, budget, branding, and creative needs.

Off-the-shelf WebXR content can be great to meet a general skilling need. For example, if you’d like to upskill your employees in public speaking, our client-partner Coursera offers a highly engaging course featuring nail-bitingly realistic experiences that deliver real-time feedback on learners’ ability to engage an audience. 

Custom WebXR content might be the best answer for a skilling need involving an industry-, environment- or brand-specific process and finely honed learner performance data points related to that process. For example, if you’d like to upskill your employees in your branded consultative sales model, you’ve got a case for a custom solution.

See below for our helpful buy/build/blend cheat sheet. It works for WebXR experiences, eLearning…any learning content at all!

Buy_Build_Blend

17. Can L&D leaders and practitioners create their own WebXR experiences using a tool, or do we need an external vendor-partner?

Unlike traditional eLearning, which can be created in an authoring tool by one person, it takes a village to create amazing WebXR experiences (See Question 8)…and each villager uses highly specialized skills and tools to do their part. To name a few, our 3D artists create the environment and characters using 3D creation tools; our animators use their respective animation tools to bring avatars to life, and programmers use another software entirely to put the build together and create the interactions. 

If you have the in-house tools and talent to assemble your own WebXR content creation village, go for it! If not, and you have a complex learning need that requires a custom solution, we’d recommend channeling that carpe diem spirit into a relationship with a vendor who can rally their ready-made village to support you.

18. What about updates and maintenance?

Once again, how you choose to handle these depends on your needs, in-house talent, and tools. Our process is that, at the conclusion of every project, the files belong to the client-partner. If they want to maintain them in-house and have the coding expertise on their team to do that, they’re off and running! If not, we can create a maintenance package to manage periodic or as-needed content updates. 

Thanks to our Talent Solutions service, we can also offer a third option: Finding a professional with the skills to manage immersive learning maintenance and updates. Our recruiters have placed hundreds of purple squirrels in highly specialized temporary, permanent, and seasonal L&D roles and have earned the satisfaction and trust of our world-class client-partners. 

We’re so glad you’re getting curious about WebXR and its many superpowers! We’re incredibly excited about this opportunity to bring highly effective and engaging immersive learning experiences to more learners than ever before. 

What we love most about our partnerships with our world-class clients is the opportunity to increase access to high-value skills and knowledge…and do more good in the world. 

If you’re looking for a deeper dive into WebXR’s learning, LMS integration, and data analytics superpowers, download our comprehensive guide, No Headset? No Problem! Launch Your Immersive Learning Strategy with WebXR. 

If you’re curious about the opportunities in your world or are looking to talk shop about WebXR or immersive learning in general, we’re all ears!

What You Should Know About XR and Immersive Learning in 2023

An interview with Adrian Soto, Director of Immersive Technologies, and Danielle Silver, XR Solution Architect

The promise of immersive learning using XR technologies has been building for several years—and it’s now at a massive pivot point with the revamp of WebXR. WebXR is solving the challenges of validating and scaling VR, making these immersive experiences available to large audiences with or without a headset.

And that’s just one thing you need to know about XR and immersive in 2023. We talked with immersive learning experts Adrian and Danielle to get their insights.

What’s the state of XR and immersive learning in L&D right now?

Danielle: From a technology perspective, XR has matured to a point where it’s more familiar. Headsets are easier to access than even two years ago. In the past, VR was thought of as a novelty—something cool and shiny to add to a learning portfolio to get attention or simply increase engagement.

But now, our clients have realized the value of XR. They’re saying, how can we integrate immersive technology more intentionally? We’re finding the use cases that really shine as a VR application, where people apply what they’ve learned and put their skills to the test. This is often part of a learning journey where knowledge-based content will be eLearning or video, and then VR is the skills application.

What are the use cases for XR that clients are seeking out?

Danielle: In the past, we were seeing predominantly technical training use cases. Imagine a manufacturing environment where using your body for hands-on practice in a safe environment can offer incredible ROI—faster time to proficiency and fewer errors, which can be very unsafe and expensive. And this is still a great use case for VR.

But now we’re seeing interest in immersive technology across a whole spectrum of use cases, from human skills, DEIB (diversity, equity, inclusion, and belonging), and leadership to those harder technical skills. Think about things like onboarding, a day in the life, empathy-based experiences. One of the powers of virtual reality is putting yourself in the shoes of another and getting to explore different perspectives. 

We’re now able to track how people are responding in challenging situations, like delivering and receiving feedback, or having difficult conversations. Not just the words they’re using but the sentiment that they’re using as well in their tone. That’s really powerful for both skill-building and assessment.

Quote 1 - XR and Immersive Learning in 2023

One of the big challenges learning leaders face is understanding, vetting, and creating a strategy to pilot and adopt new learning technologies. How do you consult with clients and help them navigate this?

Adrian: We try to meet clients where they are when they come to us. It’s easy to get overwhelmed as you start your research. There’s so much information out there. We also talk to folks who are starting from zero. We’ve put a lot of effort into translating our research and knowledge about these technologies into the language of L&D, and creating workshops and ways clients can experience XR.

The technology is proven now. It works. So the question we’re helping clients with is, how is my organization going to adopt it? We’re helping them design a strategy or a roadmap. Not to become early adopters but to become embracers of this technology and really understand what it means for learning.

XR seems to evoke a combination of excitement and confusion—wanting to get these new tools to learners but not knowing where to start. How might instructional and learning experience designers think about getting started if they’re overwhelmed? 

Danielle: Technology is always changing and will continue to change. What stays somewhat the same is the science of learning and the principles of adult learning. If you have a solid understanding of how your audience likes to learn and what strategies you can use to impact knowledge, retention, and behavior change, that’s 80% of what you need to know. Technology is 20%. 

The biggest adjustment is shifting away from linear learning experiences, your “click next to continue” learning. Even branching scenarios are somewhat linear in an eLearning scenario. Now you’re moving to the 3D volumetric space where the branching “nodules” are endless. 

Making this shift is completely attainable, and the first step is experiencing it yourself, then starting to understand how this technology works and how to leverage it in your design. Using your foundation in human-centered design and learning science is essential.

Quote 2 - Quote 1 - XR and Immersive Learning in 2023

What does the design and development experience look like for XR? What can clients expect?

Danielle: It’s really a new level of collaboration. The first part of our job is equipping clients with the information they need to make informed decisions about the experience. For example, a 360-degree filmed experience versus a CGI experience. We center on the learning objectives and talk about the nuances and design trade-offs. We empower them so together we make the right decisions for their learners.

Production is a very iterative process. It’s agile-informed and inspired. There are design sprints and every two weeks there’s something to show. Clients have their hands in the project as much as we do. They’re interacting with the experience, giving us feedback. This way of working creates a high level of trust.

There are lots of authoring tools emerging for XR. What do learning leaders need to consider as they decide whether to build capabilities in-house or outsource to a vendor?

Adrian: We’re starting to see a democratization of this technology, and that’s a good thing. The more creators we have experimenting and adopting XR pushes all of us forward. All authoring tools have their features and limitations. So the question is, what is your learning objective and what type of content do you want to, and need to, create to make effective learning? 

Just like with eLearning, you can create at a certain level with these tools, and creativity and an innovative mindset will serve you. And just like eLearning, when you start moving toward the higher end with games and simulations, you start needing a bigger team to create that content. 

It’s the same with XR. The higher the complexity, if you want a richer, more engaging experience, you’ll need technical artists, developers. Maybe you want to track analytics. As the complexity increases, you need a bigger team with more specialized skills. You’ll reach an inflection point where you have to decide if it’s justifiable to do this in-house or go to a company that lives and breathes this work every day. At this stage of the industry, it probably makes sense to outsource if this is the level of experience you’re looking for.

What about WebVR content? What is it and how is it changing the game for XR learning?

Danielle: WebXRt is an experience that can be accessed via a headset or desktop computers. This is really significant because now we have options for how learners consume VR content. No one gets left behind. All employees in an organization can access the same content.

Obviously, the headset version is more immersive. You are completely immersed in the 3D volumetric space. But the desktop version is pretty spectacular and engaging. And it’s so much easier to scale. Especially in a hybrid work environment where not everyone is in the office.

If you’re not yet ready to invest in thousands of headsets, but you know that VR is something that you want to explore, WebXR is a great starting point. You can create a proof of concept or prototype and test it out with your audiences.

Quote 3 - Quote 2 - Quote 1 - XR and Immersive Learning in 2023

Adrian: I think a question that someone might have is, why is WebXR such an important thing now when it wasn’t in the past? It has a lot to do with the evolution of the technology. It’s a first step we didn’t have before that will allow more companies to get into VR learning.

When you’re a large, global company, the business case for investing in headsets is challenging. Your use cases are constrained to the size of the audience you can get headsets for. Now that constraint is removed. You can look at potentially more impactful use cases because you can distribute the experience to all of your learners. As we say, no headset, no problem.

Quote 4 - Quote 3 - Quote 2 - Quote 1 - XR and Immersive Learning in 2023

VR opens up a whole world of data that hasn’t been possible before. What data can you track in VR and how is that useful for learning?

Adrian: There are so many possibilities here; it’s really up to your creative power to determine what you want to track. The technology is very flexible. Where and when are you looking at something? How long did it take you to interact with something? Did you grab it or not? How fast did you do something? 

We think about how data can serve everyone. For stakeholders, they want to see how VR improves outcomes compared to other ways of learning. The issue becomes how to feed the LMS with that information. They’re not set up to receive that level of data. So we’ve created a tool we call the Analytics Dashboard to visualize the data for clients. 

And data can also enhance the learning with real-time feedback. For example, we’re doing voice analysis for practicing communication and language skills. We can give learners feedback right away on their projection, tone, and pronunciation. We can track hand and body movements for safety training and help learners make adjustments to keep them healthy and safe. Eye movements, heart rate. With new headsets, the technology is becoming available to track cognitive load. Imagine what that means for adaptive learning.

What about budgets? What should clients expect to invest as they get into this space?

Danielle: Our approach is to be consultative, strategic partners to our clients. The decisions we make together are based on learning objectives and creating a successful and scalable learning solution. That means making decisions about complexity. Making thoughtful and intentional decisions that help us keep costs in check.

We’ve created three categories of experiences, from passive observation to semi-active with more agency to fully active. We center on the learning objective and determine what type of experience will be most effective. And we’ve created pricing levels for each category, so there are options for how to get started.

We know the value of having a social component within a learning experience, whether that’s an instructor or learning from your peers. Is that a possibility with immersive technologies?

Adrian: Absolutely. We’ve been able to do that for quite some time now with multi-learner experiences. This could be learners sharing the same virtual space or having an instructor there to observe, guide, and give feedback. They can even control the experience, for example, resetting an exercise, calling everyone to attention, or triggering a new variable to make the experience more challenging. 

If you’d like to find out more about WebXR, XR, and immersive learning, it would make our day to hear from you. Get in touch through our website or reach out directly to Danielle Silver at [email protected].

That’s So Meta: Ensuring the Metaverse Doesn’t Become a Dystopia

From hardware to polygons, getting started with immersive technology can feel like a plunge into the unknown. But SweetRush’s award-winning XR Team is on a mission to help L&D practitioners understand these exciting new technologies and their use cases. Level-setting on all things XR is a major part of the team’s consultative approach to immersive learning. 

The question below comes to us from a SweetRush community member who attended our webinar, “To the Metaverse and Beyond: An Immersive Learning Adventure for L&D Leaders and Professionals.” 

Emily Dale SweetRushHow can we make sure the metaverse isn’t a dystopia like the one in the novel (and film!) Ready Player One? 

Emily Dale, Design Strategy and Learning Architect, responds: 

Meta, AI, and most technology, in general, are aimed at creating “efficiencies”—tools to speed up progress, save time or energy, or accomplish a task more quickly (horse-drawn carriages to cars, brooms to vacuum cleaners, the encyclopedia to Alexa, providing instantaneous information). 

Similarly, the metaverse offers immersive and instantaneous ways to connect with friends, learn a new skill, shop in a store, or see a concert—all without leaving your home. A question to ask today might be: Are there “inefficient” experiences we want to protect in the name of in-person interactions or meaningful engagement with our communities, cultures, and local businesses? If we decentralize everything (classrooms, banks, medical appointments, and musical performances) to the point where every experience is virtual, has no real location, or involves any sort of in-person communication (eye contact, handshakes, etc.), are we then in a dystopia? 

Two ways to prevent a dystopic metaverse are:

1) Ask yourself if an experience should be virtualized and to what extent. If an in-person learning experience, for instance, plays an important role in building community or culture, or allows the learner to do important things they won’t be able to do in VR (e.g., interact with a real workplace/equipment, look other learners or stakeholders in the eyes, etc.), then maybe bringing that experience into the metaverse is not as good an idea as it sounds. Or maybe certain tasks or interactions should be brought into the metaverse and others shouldn’t.

2) Research and consider what positive experiences and interactions are possible in the metaverse that are not possible in reality. For example, enjoying a virtual concert with a faraway friend, using a digital twin to experiment with a risky design, visiting the Great Pyramid of Giza, or engaging a public official in the same virtual room. These experiences are not dystopic but exciting, meaningful, and promotive of a healthy future.

Want to learn more about XR technology, needs analysis, and L&D use cases for immersive learning in the metaverse and beyond? Check out our eBook, “Ready, Learner One? The L&D Innovator’s Gateway To Immersive Learning and the Metaverse.

A Match Made In The Metaverse: How To Find the Perfect Immersive Learning Partner

If you’re feeling inspired by the immersive learning opportunities in the metaverse and beyond, you’re in great company. More and more L&D leaders and professionals are discovering that immersive solutions are some of the best ways to achieve their high-impact, human-centered learning goals. 

Maybe you’ve discovered that your organization’s learner and business needs point toward an immersive learning solution. Or maybe you’ve discovered that you haven’t found the right use case just yet. Either way, congratulations on following your needs—and not the shiny object! 

When you are ready to find your perfect-match immersive learning partner, there are a few key qualities to look for. We’ve created this six-step checklist to help you recognize The One. 

Want to meet a partner with all six of these must-haves? Reach out to our award-winning Immersive Technologies team.   

How to Find the Perfect Immersive Learning Partner: Six Steps

Prefer to use this checklist in the classic pen-and-paper format? We’ve got you!

1. They Can Consult on Broader L&D and Business Strategy.

A partner isn’t just for building cool stuff: They should be able to advise you on everything from hardware to change management to your learner and business needs. 

One of your first meetings should include a level-set on all things XR: the spectrum of immersion, available hardware, and video versus CGI (computer-generated imagery), to name a few. Bonus points for showing and telling: What better way to learn about avatars or polygon counts than to experience them live? 

Your partner should be equally curious about you. Understanding your specific needs, use cases, learners, and work environments helps your partner guide you toward the optimal immersive learning experience for your needs. It also helps you imagine together how different teams across your organization—from legal to sales to building maintenance—might share and leverage 3D assets

This beginning-to-end consulting is called strategy mapping, and it’s the reason so many L&D leaders choose to work with SweetRush. A strategy mapping conversation with our Immersive Technologies team is an exchange of expertise—fueled by mutual trust, respect, and care.

2. They’re a Learning Partner First.

Immersive learning is exciting—and it’s no surprise that everyone wants to jump in! 

This enthusiasm means that plenty of companies focused solely on XR and content are expanding into the learning space and eager to partner with L&D leaders. But without a strong understanding of instructional design, learner experience, learning needs analysis, and your organization’s learning strategy (See No. 1!), even the most talented XR partner will be building on shaky ground. 

 Like any learning solution, immersive learning experiences should be built to meet the learning and performance objectives you identified in the needs analysis stage. Everything else—bells, whistles, cool features, Easter eggs—should grow from that foundation. It’s great to have an XR partner who’s excited to build an amazing experience with you, but they should also have the skills to survey your organization’s existing learning landscape and sketch out its future. (See No. 4 for the origin story of this superpower!)

From ID to QA to UI—and everything in between—the SweetRush team will help you blaze the trail to your perfect immersive learning solution. Reach out and start your journey.  

3. They’re Technology Agnostic.

If your prospective partner is a hammer purveyor, they’re bound to see your immersive learning need as a nail. That’s not necessarily a bad thing: It might truly be a nail! 

But your partner’s immediate response to your needs shouldn’t be, “I have a great hammer for that!” It should be, “Let’s figure out the tools you need—together.” 

A tale of two partners

Suppose you want to create a gamified experience in a metaverse. 

Graphic 1

Graphic 2

4. They Have a Range of Professionals and Capabilities on Their Team.

You’ve heard the not-so-kind saying about folks of all trades. We prefer to reframe it more generously: None of us can do our best work when we’re spread too thin. 

That’s why we have differentiated roles within our organizations and teams—and your XR partner should have the same. This specialization gives them the flexibility to be learning developers whose art form happens to be XR rather than an XR vendor who ventures into every trade. 

A prospective XR partner should bring the following specialists to the table: 

  • Project and product managers to manage the many moving parts that make up an immersive learning solution 
  • Developers to program and build experiences 
  • 3D technical artists to create vivid, engaging visuals in your polygon level of choice
  • Instructional designers to ensure that every facet of the immersive learning experience speaks to the learning need
  • A UI/UX professional to ensure that the experience is usable, enjoyable, and accessible for all learners
  • A psychometrician, if you’re planning to conduct any assessments before, during, or after your immersive learning experience

QA reviewers to ensure that every aspect of your immersive learning experience functions smoothly and meets the highest standards

Quote 2

The folks in our XR team have different specialties, but they share a laser focus on the craft of learning. The results? Engaging, effective immersive learning solutions that make a difference for your people and your organization. 

5. They’re Focused on Research, Development, and the Future.

Immersive technologies, tools, and functionality evolve quickly, and a prospective XR partner should have a sense of what’s ahead—and a road map for the next five years. Once they share theirs with you, look for overlap with your L&D strategy. 

Because they’re a learning partner first and foremost, your XR superstar should also be curious about the effectiveness of the solutions they co-create. And because immersive environments are such a rich source of learner data, research and development should play a significant part in their vision. Bonus points if they conduct systematic, controlled tests of their immersive learning solutions. 

Are you looking for a long-term relationship full of communication, collaboration, and a focus on the future? We want the same things. Reach out to our Immersive Technologies team today. 

6. They Offset the Carbon Footprint of Their Projects.

Immersive learning solutions can help cut costs on materials, venue space, travel, and plenty of other training-related costs. 

As you’ve probably guessed, rendering those vibrant, realistic virtual spaces and bringing everyone together within them takes a lot of computing power—up to 1000 times the processing power of our current usage. 

Without an XR partner who thinks strategically about the global impact of their immersive learning solutions, it’s easy to rack up energy-hungry features that take a toll on the planet. At our current level of climate urgency, a partner who knows how to build simply isn’t enough—you need a partner who knows how to build sustainably.

Quote

Source: Metaverse: Could creating a virtual world build a more sustainable one? April 2022. 

The sustainability conversation should begin with your first (virtual) handshake and account for the entire project journey. Every video call, email, attached file, text message, and user test leaves a footprint; the right partner will help you offset that footprint—and even leave the world better off. 

Leaders such as Amazon, Microsoft, and Google have already started their journey toward carbon neutrality or negativity. But leaving renewal and regeneration in your wake doesn’t take a giant: Our small but mighty team and community have been offsetting the carbon footprint of every project since April 2021. To date, the SweetRush team and our client-partners have joined forces to plant more than 900 trees in La Maestra, an ecological and educational haven in the Limón province of Costa Rica. 

Want to build virtual worlds that leave the Earth better off? The SweetRush team is with you every step of the way. Reach out and discover how to create immersive learning solutions with a living legacy. 

Next Steps: The Perfect Learning Partnership

Great learning experiences touch lives and create connections.The best learning experiences leave a legacy. We’d love to be the partner who shares your passion for literally building a better world. 

As we like to say at SweetRush, there’s no limit to what we can achieve together when we start as friends, work consultatively, frame the process and decisions that lie ahead and—above all—keep humans at the heart. If that’s the kind of long-term relationship you’re looking for, we just might be a match! 

Not the right time for a meet-cute? No worries! We’ve got plenty of resources to help you explore the wide, wonderful world of immersive learning on your own. Our eBook, Ready, Learner One? The L&D Innovator’s Gateway To Immersive Learning and the Metaverse, will inspire you with amazing learning experiences, use cases, and forecasts for the future of L&D. 

Maybe you’re more of a movie buff? Check out our director’s cut of some of the best immersive work and learning experiences in the metaverse and beyond. 

Whatever your path into immersive learning, we encourage you to find a vendor-partner who puts you and your people first.