Introduction

EON Metaverse Builder (MVB) is a tool used to compose multiple 3D objects together in AR mode, when creating a 3D Xperience. Some functionality in the MVB authoring tool is the same as described in the Create 3D Xperience article.

You can add learning material and media content for each object in the MVB using:

  • Assessment portal to create assessment activities, such as Quiz, Locate, and Identify

  • Knowledge portals with different media content, such as Video, Image, PDF, and memo

  • Memo in Knowledge portals, used to play text elements with a synthesized voice of your choice

You can also use add-on functionality to enhance learning experiences created with MVB:

Create an MVB experience

You can use the Create img-createred function to create an MVB experience.

After creating the Xperience, you can add details in the Xperience Page, such as description, additional learning materials, and assigned students.

The Create function directs you to select a model and build the experience using the MVB authoring tool.

  1. Select Create img-createred and Metaverse Builder to create an MVB experience

create, Xperience types, metaverse builder, close
  1. The MVB authoring tool launches in AR mode

  2. Place your avatar, which guides you through creating your Xperience

  3. If you are adding subsequent objects, select img-addobject in the img-plus menu

  4. Describe what you want to create with your voice and then:

    • Select img-mic to search for objects, and then select img-stop to search

    • Optionally, select img-redo to say something else

    • Alternatively, select img-key to type the search words using the keyboard

  1. Select the object you want to use, and select Next to proceed

    Note

    Activities are only auto-generated for existing annotations. The number of annotations affects which activities are created.

    Hint

    Assets are graded based on their complexity and how they perform in a 3D Xperience.

3D assets, XR library, My assets, Sketchfab, Login. Search. Categories. Cancel. Next.
  1. Select an anchor point on a surface location

    • The object is downloaded to the anchor point

    • Alternatively, select X in the progress bar to cancel the download

  2. Repeat steps 5-8 for each object you want to add

  3. Select X to SAVE & EXIT and go to the Xperience page

    • Optionally, edit the title of your MVB experience and update the Xperience thumbnail

    • Alternatively, select DISCARD to return to the Library without saving

    Note

    These exit options are only displayed the first time you exit a new MVB experience. On subsequent exits, your Xperience is saved automatically.

exit metaverse builder, cancel, discard, save & exit

MVB authoring tool

You can select and access different tools and menus to create an immersive Xperience:

  1. Select exploration tools to interact with the object(s) and view annotations

  2. Select the Move all icon to select objects

  3. Select Object name to change object and part name in hierarchy view

    • Select img-home to navigate to the start position of the current hierarchy

  4. Select img-setmenu to access Xperience options in the experience menu

  5. Select img-help to show or hide tooltips

  6. Select the AR tools to create persistent anchor or change object position

  7. Select img-plus to access Content menu

exploration tools, move all, object name, home, experience menu, help, AR tools, and add content
  1. Use multitouch gestures to select, manipulate, and isolate different components of the object:

multitouch gestures, select, change hierarchy, scale, rotate, move, raise and lower object
  1. Select img-playmode to preview your Xperience in play mode

step 9

Exploration tools

The exploration tools include:

  1. Annotations img-annotations : view descriptions and activities attached to object parts

  2. Knowledge portal img-kp : show or hide Knowledge portals

  3. Explode img-explode : break apart the 3D object

  4. X-Ray img-Xray : view the inner details of the 3D object

  5. Animation img-animation : view animation associated with the 3D object

    Note

    The animation option is only available for 3D objects with animation

exploration tools, numbers 1-5

Object select

Selected objects are indicated by the multicolored circle surrounding the base of the 3D object.

  1. Tap on the 3D object to select that specific object

select one object, option 1
  1. Select all 3D objects with img-selectall

select all option, option 2

You can manipulate selected object(s) as follows:

  • Re-anchor the objects as a group

  • Rotate all objects

  • Set the scale for all objects

AR tools

You can select the AR tools to:

  1. Make persistent anchor

  2. Adjust placement the 3D object(s) on a surface

  3. Select and grab parts of the object(s)

AR tools, options 1-3

Experience menu

You can select options in the Experience menu to:

Option

Remark

Delete selected object

Delete persistent anchor

Delete created persistent anchor

Set thumbnail

Create a new thumbnail for the Xperience page

Disable / Enable AI Assistant

Either hide or show the AI Assistant avatar

Save scale

Save the current image scale as 1:1 real scale

Digital twin:

Start alignment

Create a digital twin of the object, placed in relation to real-world objects. Annotations are linked with the digital twin

Hide model

Hide the 3D object from view

Annotation options:

Reverse annotations

Reverse direction of annotation anchors

Delete all annotations

Delete all annotations you have created for the object

Hide / Show buttons

Either hide or show tools and menus

Settings

Open Settings menu to configure sound and lightning effects

experience menu

Settings

Number

Remark

Background sound

Upload an audio file to play in the background

Shadows

Enable the 3D objects to cast shadows

HDR

Enable high dynamic range reflection on the 3D object

Occlusion

Enable segmentation of physical objects. Improves illusion that 3D objects exist in real-world

settings menu

AI Assistant

The AI Assistant guides you to create new Xperiences, answers questions that you ask, and creates the auto-generated Knowledge portal and Assessment portal.

You can change the visual look and voice of your AI Assistant in the user profile menu.

Note

The AI Assistant is only available when creating Xperiences with EON Metaverse Builder.

Note

The information generated by the AI Assistant is saved in a AI Report, accessed in the Xperience Page.

Ask the AI Assistant questions after adding the first object to your Xperience:

  1. Select img-ai to open the AI portal

  2. Select img-mic to ask the AI assistant your questions

steps 1-2, AI Portal.
  1. Select img-stop to receive a response from the AI Assistant

  • Optionally, select img-redo or img-key to adjust your question

  • Repeat this step to ask additional questions

step 3
  1. The conversation history is displayed in the AI portal

  • Select img-bin to delete questions and related answers

step 4, AI Portal.

Hint

The AI Assistant can point out and highlight parts in the 3D object, if the answer and part name matches.

Hint

You can select Suggested questions to ask to receive suggestions from the AI Assistant.

  1. Optionally, select img-_ or to hide the AI Assistant

Markup Guide

Welcome to the Markup User Guide! Markups are 3D add-ons that you can add to the scene for better like icons or text like a sticky note around the model or the environment. The original idea is to bring each player’s markup data in a meeting so they can share extra ideas through the markups.

How to use the markup toolbox:

  1. Click the AddMU.png button

../../_images/1400-Markup1.png
  1. Click on the Markup Toolbox ShapesMU icon on the far left.

../../_images/1401-Markup2.png
  1. This is the Markup Toolbox where it holds Markups you want to use in the scene. To add more Markups to your Toolbox, click on the EditMU icon on the bottom right corner of the Markup Toolbox panel.

../../_images/1402-Markup3.png
  1. This is the Markup Toolbox Editor that acts like a catalog of Markups. Click on different tabs at the top to see different categories.

../../_images/1416-Markup17.png
../../_images/1403-Markup4.png

– Numbers (Left) and Icons (Right) categories –

  1. Click on any of the icons on the left. To add to your Toolbox, click on the right arrow button in the middle.

../../_images/1404-Markup5.png
  1. When done adding, click Save to save your changes.

How to add markups:

  1. To put Markups in your scene, reopen your Markup Toolbox and click on any one of the icons available.

../../_images/1405-Markup6.png
  1. The Markup object will pop up and be attached to the model initially. Drag it around the scene to a desired highlighted model part and tap on screen to confirm.

If a Persistent Anchor is present, the Markup object will be allowed to be placed beyond the model, in the environment.

../../_images/1406-Markup7.png
  1. Once the Markup is set, the Markup should be attached to the associated model part and will continue to follow the part.

../../_images/1407-Markup8.png
../../_images/1408-Markup9.png
  1. When you tap on the Markup object placed, it will select the Markup object and highlight the associated part. By selecting, a menu of buttons will appear around the Markup object.

You can press the TrashMU icon to delete Markup.

Tap anywhere outside of the highlighted area to deselect.

../../_images/1409-Markup10.png
  1. You can see the list of present Markups in the current scene in the List tab of Markup Toolbox.

You can also select Markup by tapping the Markup item in the list.

You can toggle visibility using the EyeMU icon.

You can also select Markup by tapping the Markup item in the list.

You can delete all Markups by pressing the Delete All button at the bottom.

  1. In order to use Text Markup, tap on the TextMU icon in your Markup Toolbox.

../../_images/1410-Markup11.png
  1. Here, you can speak into the microphone of your device or press the KeyboardMU icon to type in your desired text.

../../_images/1411-Markup12.png
  1. A Textbox will pop up with the desired text and you can place it on the model or the environment just like any other markups. Tap to confirm.

../../_images/1412-Markup13.png
  1. The Text Markup works just like any other Markup. It will attach to the selected model part during initial placement and will remain attached. It can also be selected for more options.

../../_images/1413-Markup14.png
../../_images/1414-Markup15.png

Welcome to markup!

../../_images/1415-Markup16.png

Content menu

You can select functionality in the Content menu to add annotations, activities, and additional objects to the MVB experience:

  1. img-plus show the Content menu, or select X to hide the menu

  2. img-interactportal open the Interact Portal to edit interactions

  3. img-interact create Interactions.

  4. img-3drecording create 3D Recording and 3D Assessment

  5. img-assessmentportal create activities in the Assessment portal

  6. img-aicamera use the AI Camera

  7. addannotation create new Annotations

  8. img-addobject add objects in the MVB experience by following steps 5-9

content menu, options 1-9

Assessment portal

The Assessment portal img-assessmentportal includes activities associated with each object in the Xperience.

You can add img-plus, view, edit img-pencil, and delete img-bin activities in the Assessment portal.

  1. Select the object you want to add an activity to

  2. Select Assessment portal img-assessmentportal in the Content menu

  3. Select and perform the necessary steps for the activity you want to create:

assessment portal, all assessments, quiz, identify, locate, 3D rec

Auto-generated activities

The auto-generated activities are created for existing annotations connected to the object.

If the number of annotations are 3 or fewer, the auto-generated activities are as follows:

  • 1 annotation: Identify

  • 2 annotations: Identify and locate

  • 3 annotations: Identify, locate, and quiz

Knowledge portal

Knowledge portals img-kp includes media content, such as text, videos, or images, associated with each object in the Xperience.

  1. Select an annotation on the object you want to add a Knowledge portal to

  2. Select img-plus to add content

create Knowledge portal, step 2
  1. Select the media content you want to add:

    • You can select up to one item from each category: Texts, Images, Videos, PDF, Voice Rec, and Memo

    • Selected categories and content is indicated by img-selected

    • Enter another search word to refine your search

    • Knowledge portals use SERP for retrieving search results

  2. Select Add to add the selected content to the Knowledge portal

    • The number of selected content is indicated within parenthesis

create Knowledge portal, steps 3-4
  1. Select img-kp to show / hide Knowledge portals

Auto-generated knowledge portal

When you select auto-generate knowledge portal option, a knowledge portal is automatically created for the 3D object.

The knowledge portal includes video, image, and text related to the 3D object, based on the object name. Once the knowledge portal is created, you can edit the content.

Memo

A Memo is a text element which EON-XR plays using the synthesized voice of your choice. You can add memos to Knowledge portals.

  1. Select the Knowledge portal and select img-plus to add content

  2. Select Memo

  3. Select img-mic to record your memo and view the voice transcription

    • You can change the input language in the Voice input list

    • You can install additional languages, select the + by the Voice input list. Then, select your desired language(s) in the system settings dialog

create memo, steps 2-3
  1. Select img-stop to save the recording

  2. Optionally, select the text field to edit the voice transcript

  3. Select the desired voice used for the memo in the Voice output list

  4. Select Add to save the memo, or Cancel to discard

create memo, steps 4-7

AI Camera

The AI Camera is used to search for content related to a captured AI Image. The AI Image can be used to find out more information about your 3D object and surrounding area, such as name, content tags, and images of similar objects.

You can use the terms when creating Knowledge portals using SERP.

  1. Select img-aicamera in the content menu

  2. Set an annotation point on the 3D object

  3. Use voice input to create an annotation label

  4. Select img-aicam to capture an AI Image of the 3D model or the surrounding area

Note

Images captured are discarded when you exit the AI Camera.

  1. Browse through relevant search results

Persistent anchors

Persistent anchors is a function used to create geolocated Xperiences. It is used to connect 3D objects to physical locations in the real world, by memorizing position and orientation of the objects. When exploring the geolocated Xperience in play mode, you can load the objects in the specified orientation at the memorized location.

Note

Creating persistent anchors requires GPS location on an AR compatible device.

Create persistent objects

  1. Select make persistent img-anchor

  2. Place the object at a location where it is easily reachable

Note

Adjusting the placement for an object does not relocate previously anchored objects.

  1. Optionally, adjust the orientation of the object

  2. Scan surrounding areas until the indicator turns green to capture the anchor

Hint

Move around the object slowly and make sure the scan indicator turns green.

Hint

If you are unable to complete the scan, place the object in another physical location and try again.

move around the anchor point and turn the red bars into green
  1. The persistent anchor for the object is created and uploaded to the cloud service

  2. Take a photo of the persistent anchor location to help users find the correct location

Note

You can remove persistent anchors in the Experience menu.