IMMERSE’s Language Assist feature is designed to help you understand and use new vocabulary, cultural insights, and grammar with ease. Whether you're in VR or on your computer, this tool provides real-time translations, pronunciation help, and usage tips, all at your fingertips.
What It Is
This advanced tool, a generative AI-powered learning aid, was developed by our team and integrated with OpenAI’s Large Language Model Database. This powerful resource is designed to supplement and support you during live interactions within IMMERSE.
This feature acts as a searchable database, offering valuable knowledge to help you stay engaged in conversation, even when you're searching for the right words. Furthermore, it provides translations beyond our primary display languages, making it beneficial for a broader range of users who might desire native support not available as a display option.
Breakdown of Results
Sounds Like
Sounds Like
This section shows you how the word is pronounced using a simple phonetic guide (for example: neh-goh-see-ohs). Seeing how a word “sounds” in writing helps you bridge the gap between what you read and what you hear. As you practice, you’ll be able to recognize the word when it’s spoken in conversation and feel more confident saying it yourself. Pronunciation support like this builds your listening and speaking accuracy, which are essential for real communication.
Explanation
Explanation
Here you get a clear explanation of what negocios means. The definition tells you that it usually refers to companies or commercial activities, but also points out that in Spanish it can mean “negotiations” or “deals” depending on context. Having this expanded explanation helps you understand the full range of how the word can be applied. Instead of memorizing a single meaning, you’re learning how to choose the right meaning depending on the situation, which makes your vocabulary much more flexible.
Other Examples
Other Examples
In this section, you see the word used in complete Spanish sentences with English translations. This helps you notice how the word fits naturally into grammar and context. For example, “Los negocios internacionales requieren mucha planificación” shows how negocios is used in the plural form and in a formal context, while “Ella tiene varios negocios en la ciudad” demonstrates everyday usage. Seeing vocabulary in authentic sentences helps you grasp grammar, collocations, and context all at once, so you can start modeling your own sentences in a natural way.
Questions
Questions
Finally, you’re given some guided questions that push you to think more deeply about the word. Questions like “How do I use ‘negocios’ in formal and informal contexts?” encourage you to compare contexts and reflect on nuance. These prompts push you to go beyond memorizing the definition and actually think about how you’ll apply the word in your own speech. By reflecting on usage in different contexts, you deepen your understanding and get practice with the flexibility of the word.
Where to Activate It
The Language Assist feature can be activated by opening the tool itself directly to ask a question, or by hovering over written content in various learning activities and clicking to translate. Choose your preferred option below to learn more.
Click a word in an activity to translate
Click a word in an activity to translate
For asynchronous content, you can click on any word that turns blue when you hover over it, to access its translation. Additionally, clicking the translate icon next to the results will open Language Assist, offering more details and examples related to the word. This feature is available in the following areas:
Self-paced Lesson content
Class Notes (within a live scene or the review section of your homeroom)
Live Class Prep Material Activities (Flashcards, Fill-in-the-blank, and Pronunciation)
Note that these activities have their own “translate” button option as well, so the Language Assist feature becomes secondary
Open directly to ask a question
Open directly to ask a question
When in a live class or community scene, follow the steps below to open the Language Assist feature directly.
Computer
Press the SPACEBAR on your keyboard, or click the Toolbox icon on your screen.
Select > Language Assist, to the right of your menu.
VR
Press the right wrist button with your virtual finger, or press the A button on your right controller.
Select > Language Assist, on the far right of Geo’s menu.
How to Use It
By integrating the Language Assist tool into your learning routine, you can build confidence and improve your language skills in real time. Try it out and see how this feature can support your journey!
Translate Instantly
The easiest way to use the Language Assist feature is by simply using it as a translation tool. Check out how you can do that below!
Open Input
⚠️ Open input is not available while using this feature in the Homeroom.
Click the microphone icon to give verbal input.
Click the checkmark to send audio before the recording limit is reached.
Click into the typing box to give written input.
Click the grey send arrow to submit.
⚙️ Strange Results After Submitting Audio?
If the Language Assist feature returns your name or “context” instead of processing your response, it indicates an issue with audio input. This could be due to a technical problem or other factors. To resolve this, test your microphone playback in Homeroom settings or verify your microphone and headset settings outside of IMMERSE before re-entering the platform.
From IMMERSE Content
*This includes Self-Paced Lesson content, Prep Material Practice Activities, and directly on the Language Assist results page.
Click a word in to translate it and hear it said aloud again
Click and hold on full sentences to translate and hear the entire phrase.*limited to Self-Paced Lessons and inside the Language Assist feature itself.
Click on the blue translate icon to view more info and other examples.
View the extension questions at the bottom of the results to expand your learning.
Understand Vocab & Context
Understand Vocab & Context
The Language Assist feature can help you with vocabulary and phrasing beyond basic translation. For instance, you can:
Learn word usage: Get examples of how to use a word in a sentence. For instance, you could ask, "How do I use 'recomendar' in a sentence?"
Find synonyms: Discover alternative words. For example, "What are other ways to say 'computadora'?"
Understand phrase appropriateness: Inquire about the right context for a phrase. An example query might be, "Is it appropriate to say 'Calláte' to someone at work?"
Discover additional nuances: Explore frequently asked questions in search results to delve deeper into the information!
Dive Deeper into Grammar & Culture
Dive Deeper into Grammar & Culture
Want to understand your target language better without the need for in-person classes or expert interaction? The Language Assist feature provides independent learning opportunities, allowing you to:
Inquire about grammar and structure: For instance, "What's the difference between 'ser' and 'estar' in Spanish?"
Request verb conjugation examples: Such as, "Can you show me examples of the 'pluscuamperfecto tense' in negative and question forms?"
Discover alternative expressions: For example, "What are some different ways to express that I am confused?"
Learn about word origins: Like, "Where did the word 'almohada' come from?"
Explore culture or history: For example, "What is Cinco de Mayo all about?"
⚙️ Current Limitations
While Language Assist is a powerful learning aid, it's still growing. Here are some current limitations:
Contextual Limitations: The AI may produce incorrect translations if there is insufficient context or if words in the target language resemble those in the display language.
Speech Recognition Challenges: The system may have difficulty recognizing languages with special characters (such as Polish or Arabic).
My Notes: Currently, adding new words or sentences to My Notes is not possible due to storage and data limitations.
Translation Language Availability: This feature is only available to translate to 15 additional languages beyond our display language options.
Rating the Results
Because responses generated by Language Assist are AI-generated, they may contain errors or irrelevant information. Your feedback is valuable in fine-tuning this feature. Therefore, you have the option to rate the results provided by Language Assist each time you use it!
Thumbs Up or Down?
When determining whether to give a positive or negative rating, focus on content accuracy (to the best of your knowledge), level of detail, clarity of explanation, relevance of additional questions provided, and your overall experience with the feature.
Additional Feedback
Once you've chosen your rating you can select from various reasons that explain your decision, or choose to close the window without sending additional feedback.
Options to Select From:
Helpful - Unhelpful
Quick - Too Slow
Engaging - Uninteresting
Relevant - Irrelevant
Frequently Asked Questions
Do I have to rate the Language Assist feature results?
Do I have to rate the Language Assist feature results?
No, rating is optional but it does help our team to know where this AI-feature needs improving. You can simply exit the feature if you choose not to rate.
How many languages do the Language Assist & Translation features support?
How many languages do the Language Assist & Translation features support?
The feature supports 21 total translation languages, 15 languages in addition to our core 5 display languages (English, Spanish, French, Portuguese, Japanese). You can view the full list of languages here.
How can I set my default translation language?
How can I set my default translation language?
The easiest way to set your translation language is from the settings menu in your Homeroom: Settings Gear Icon > Display > Translation Language Default. Check out this support article for the full run down.
How is Translation Language different from Display Language?
How is Translation Language different from Display Language?
The IMMERSE application offers display language options in English, Spanish, French, Portuguese, and Japanese. These programmed written elements are distinct from the AI-based translation tools integrated into platform activities, such as chat bubbles in Self-Paced Lessons and the Language Assist Feature. These AI tools leverage an extensive database and generative capabilities, providing a wider range of translation options than can currently be built into the virtual world's physical elements. For more information please visit this support article.
Why can’t I perform “open input” searches within the Homeroom using the Language Assist feature?
Why can’t I perform “open input” searches within the Homeroom using the Language Assist feature?
We appreciate your patience as we work to implement a similar language assistance functionality in a future build. Currently, the infrastructure to support this feature is not built into the static build of the Homeroom scene. We understand how helpful this would be for your learning!
Why can’t I click and hold to select a full sentence in Guide or Class Notes?
Why can’t I click and hold to select a full sentence in Guide or Class Notes?
The language assist feature has been disabled in Guide Notes and Class Notes within live scenes and the Homeroom. This decision was made to enhance your learning experience.
The feature's click-and-hold programming struggles with Guide Notes because they lack a consistent pattern and punctuation. This can lead to the selection of entire class notes, potentially including irrelevant information for translation or multiple languages simultaneously, which could cause confusion.
❓Have questions about (or have run into an issue with) the Language Assist feature? Let our team know at [email protected].