Learner Experience Node Types

Generic Items

Positions: Null. This is the position where the activity will spawn (appear). Options could include but are not limited to left, right, middle, etc.

Audio Playback Node

• CG: ✅
• 360 Video: ✅

This node will play an audio file which will appear to emit from the defined playback position.

• Add Audio File: This will allow you to add an audio file to be used for the audio playback. It will also include Audio Recorder Files here.

Audio Recorder Node

• CG: ✅
• 360 Video: ✅

The Audio Recorder Node allows the user to record themselves in the headset so that it can be played back later via an audio playback node.

• Set Save Name of Clip: This is a custom save name that the user will be able to set. They can also use this name in other content, such as the Audio Playback Node, you will be able to see the Save Name.
• Select Recorder UI Type: The user can change between a non-button version or a button version of the Audio Recorder UI.
• Select Input Type: Depending on the UI type, the user can set a way to start/end the recording.
• Select Recorder Preset: Offers various presets for how the mechanic will operate.
• Start/Stop Recording Information Text: This allows the user to set custom text for the start/stop recording.
• Enable Max Recording Duration: This will stop the recording if the player has been recording for longer than the max duration. If ticked, a new field called "Clip Duration" is generated. This is the time for a max clip.

Breathing Node

• CG: ✅
• 360 Video: ✅

The Breathing Node will set the scenario up to help the user breathe in and out.

• Style Type: Different types of breathing styles can be used. Style 1 is used via inputs, whereas Style 2 is automatic and done via timings.
• Breathe In: How long the breathing in part of the cycle will last in seconds.
• Breathe Out: How long the breathing out part of the cycle will last in seconds.
• Timeout: Total duration of the node.

Learning Record Node

• CG: ✅
• 360 Video: ✅

The Learning Record Node is connected to the ECSDK System that is a part of the Skills^VR Packages. With this node, you are able to send the Learning Record you want. This will be reflected on the Enterprise Platform when the records are sent.

Use the Learning Record ID Dropdown to change the Learning Record you are wanting to send.

Login to SkillsVR Account: This will open a separate window where you can enter your Enterprise details.

Reload Config: Will reload details, this can be used for when changes have been made on the Enterprise platform and you want to see them in the editor.

Marker Question Node

• CG: ✅
• 360 Video: ✅

The main use of the Marker Question Node is to use the items in the world as a multiple choice question. eg: selecting hazards in a scene.

• Answers: You are able to add as many answers as you want and choose the various settings for each one.
  • Correct: Weather this choice is the correct one or not.
  • Position: This is the object in the scene that you want the selection to appear above.
  • Custom Text: This allows you to set custom text for the marker.
  • Use / Select Sprite: This allows you to change the sprite that is used for selecting the answer.
• Submit Button Position: This is the location for the submit button.
• Select Feedback Type: This will change how the UI reacts based on the feedback type selected.
• Check Straight Away: Stops the answers from being checked right away.
• Untoggle Others: This will untoggle other markers if you select one.
• Hide Marker on Reset: This will hide all the markers once the node is over.

Multi-Choice Question Node

• CG: ✅
• 360 Video: ✅

This activity node will allow you to create multiple choice questions.

• Question: This field has the text that will be used as the main question.
• Answers: You are able to add as many answers as you want as well as configure their settings
  • Correct: Weather this answer is correct or not.
  • Answer: The test the answer will display.
• Multiple Choice Feedback: There are different types of feedback available for the user. Depending on the choice, different results will show.
• Allow Multiple Selection + Min Selection Amount: This allows for a multiple choice with the ability to select more than one item before locking in the answer using a button.
• Choice Display Timeout: This is how long the mechanic will stay active after the user has answered the question.
• Shuffle Answers: This will shuffle the answers into a random order.
• Use Variant Style: This will change the Multiple Choice Question to use a different style layout.

Popup Node

• CG: ✅
• 360 Video: ✅

The main use for a Popup Node is to show the user information about the current topic being presented in the scenario.

• Information/Title: This is the heading that will show up in the popup.
• Has Next Button: This will make the popup node stay on the screen until the next button is pressed.
• Time Until Disappear: How long the popup will last.
• Use Marker: Will have a marker (Visual UI) to be selected for the popup.
• Body Text (Optional): A secondary information popup field for more information.
• Show Custom Image: This will show an image to go along with the extra information.

Rank-Sort Node

• CG: ✅
• 360 Video: ✅

The main use for the Rank/Sort Node is to mix and match items into the slots. This can be used for ranking objects or for sorting items into the correct piles. There are many different ways to use this node.

• Select Rank/Sort Preset: There are a number of presets that the user can select. It will set all the option items based on the preset.
  • All Items Must Slot: This means all the items must go into a corresponding slot.
  • Fail on First Attempt: After clicking the submit button, the mechanic will show results and then continue on. Only one attempt is allowed.
  • Items are Stacked: Items will all be stacked and then can be dragged onto a slot.
  • Items and Slots Same ID: Items and the slots must match to continue on.
• Slots Title: This field has the text that will be used as the main title.
• Slots and Items: Slots represent the positions where Items can be moved to. Items are the interactable part of this mechanic. Their settings are similar:
  • Text: This field has the text that will be used as the information of the Slot / Item.
  • ID: This field is used to create association between Slots and Items. For example, an Item with ID 1 could be slotted into a slot with ID 1.
  • Use / Select Custom Image: offers a way to include an image along side the text of Slots / Items.
• Continue Button: Continue Button Dialog Field.
• Randomize Answer Order: This will shuffle the items to be different each time.
• Show Titles: This will show title fields.
• Only One Answer Attempt: This will allow the rank/sort activity to continue even if the user fails selections or will stop after one attempt.
• Show One Item at a Time: This will stack the items to be in a card pile, instead of being spread out. Only one will be shown.
• Show Correct/Incorrect Feedback: This will check for answers and provide feedback if the answer was correct or incorrect.
• Match Slot and Item ID: This will only allow the items to be slotted into the same ID.
• Keep Feedback Showing: When getting correct / incorrect colors are shown. The user then can decide if they want the colors to stay shown.
• Add Seconds for Answer Review: How long the answers will stay shown after the rank/sort activity has ended.

360 Video Node

• CG: ❌
• 360 Video: ✅

This node will allow the user to add 360 videos to the project and play them via the node.

• Scrub Bar: This allows you to scrub through the video and also play/pause the video. There will be previews in the scene and on the image above the bar.
• Video Controls (from left to right):
  • Skip to the start of the video.
  • Play/pause video.
  • Skip to the end of the video.
  • Jump to section start.
  • Play from section Start.
  • Jump to section End.
• Play Mode:
  • Section: This will play a section of the video as defined by the start and end time.
  • Loop Section: This will loop the section that has been defined until another video is played.
  • Section then loop last seconds: This will play the section then, based on the time set by "Loop Last Seconds", it will loop that many seconds from the end of the video.
• Video Start Time: This sets the time where the video will start. Clicking the preview button will show this in the editor and on the image below.
• Video Cut Off Time: This sets the time where the video will end. Having it at ‘0’ will make the video end at the max amount of time. Previews are also available for this setting.
• Volume: This adjusts the volume of the video.
• Volume Booster: This will boost the volume past max; limited to 20 decibles extra.
• Video Transition: This sets transitions between other videos.
• Video Image Type: Use this to set the format of the video.
• Video Layout Type: Use this to set the layout of the video.
• Virtual North: This will rotate the video and allow you to line it up with the player.
• Mechanic Events: This will trigger the linked event at the set time. For example: If an MCQ is linked to this node and the time is set to 5 seconds, the question will appear in the video during the 5 second mark.
• Preview Image: This previews what is being shown in the scene view.

Timer

• CG: ✅
• 360 Video: ✅

This node allows you to show a countdown (or up) timer to the desired amount.

Count Downwards to Target:

• If ticked, the timer will start at the set time and go down to 0.
• If unticked, the timer will start at 0 and count up to the time set.

Amount of Time (In Seconds): This is the amount of seconds you want to show the timer for.

Drag and Drop Node

• CG: ✅
• 360 Video: ❌

This node allows you to set up drag and drop systems inside a scene, meaning the learner (in headset) will be able to grab 3D objects in the scene and slot them into their appropriate spots.

Completion

The following settings show how to the node will be completed. This is set via different presets.

Selection Completion Preset

• Timer Ends: This node will finish when the allotted amount of time has passed.
• Timer: The amount of time to pass before the node is finished automatically.
• All Objects Selected Once: This node will finish once you have selected each interactable at least once.
• Sockets Filled: This node will finish once the sockets have been filled at least once.
• Sockets Filled Correctly: This node will only finish once the user has slotted all the interactables into the correct slots.

Show Feedback Where

• On Nothing: This will not show any feedback when slotting objects.
• On Socket: This will show if the item slotted was correct or incorrect.
• On Socket and Answer: This will only show feedback if the socket is filled with the correct answer.

Show Feedback When

This represents the timing of the feedback for the slotted objects.

• On Socket Filled: This shows feedback straight away.
• On Node Complete: This will show all of the slotted items feedback when the node is finished.

Objects

• Pickup Speed: How fast the object will be moved to the learner's hand.
• Hold Position Offset (XYZ): This moves the position of the object based on the values set.

Drop Behavior

• Return to Pickup Location: Once the object is dropped it will return to the original position.
• Hover: This will hover the game object in the current position.
• Physics Applied: Physics will be applied to the object, so it will have gravity acting on it.

Rotation Type

• Auto: This will automatically rotate the object when holding it.
• User Input: This will rotate based on the learner's input.
• Rotation Speed: The speed at which the object will rotate.
• Scale: When the object is grabbed, it can be scaled bigger or smaller.
• Objects Drop Where Pointing: This enables the behavior where the object will 'socket' into a socket exactly where the user is pointing, rather than having the object snap to the socket's attach point.

Interactable Props

This is a list of all the props you want the user to be able to interact with.

• Interactables: Object to interact with.
• Filter Layer: The layer on which this object is assigned.

Sockets

This is a list of all the sockets in the scene that the interactables will be able to interact with.

Correct Only in Order: Have to have the correct order for the interactables going into the socket otherwise the node fails.

Socket Props

• Interactors: This is the socket.
• Accepted: This is a list of the layers that will be allowed to be socketed into the socket.
• Filter Layer: Layer to be checked.
• Is Correct: If the interactable socket has this layer and is socketed, then we check if it is correct or not.

2D Panel Image Node

• CG: ✅
• 360 Video: ✅

This will present an image to the learner.

• Custom Sprite: This is the image that will be shown to the user.
• Duration: The amount of time for the image to show.
• Next Button: If this is ticked, then the duration is ignored and will only end when the button (seen in the headset by the learner) is clicked.
• Next Button Text: The text (label) for the button.

2D Panel Video Node

• CG: ✅
• 360 Video: ✅

This will show a 2D video in a panel at the desired location.

• Video Controls: Play/pause the video.
• Scrub Bar: This allows you to scrub through the video and also play/pause the video. There will be previews in the scene and on the image above the bar.
• Video Start Time: Sets the time that the video will start at. The Preview button will show this in the editor and on the image below.
• Video Cut Off Time: Sets the time that the video will end at. Having it at ‘0’ will make the video end at the max amount of time. The Preview button is also available to see.
• Loop Entire Video: This will loop the entire video after it has finished playing.
• Volume: Allows the learner to adjust the volume of a video.
• Show Skip Video Button: This allows the learner to skip the video by clicking a button.

Eye Tracking Node

• CG: ✅
• 360 Video: ❌

The Eye Tracking Node allows users to define a set of props in a scene to detect weather the users gaze falls upon them or not. This is hardware dependent, and if eye tracking cameras are not featured on the users headset, then the behavior will default to a general looking direction form the users head.

• Completion Presets:
  • Look at Once: The node will complete when all / any listed props have been looked at at least once.
  • Look at For a Time: The node will detect the total duration all / any of the props are looked at for, and complete after the total time is up. This preset allows for the Success and Failure outputs to activate. If all props is selected, then the user must also at least look at all listed props once for Success to trigger.
• Use Raycast: This will mean the node will use unity's physics and collider system to detect the if the gaze is looking at the object.
• Show Looking At UI: If active, this will overlay a reticle on to the users vision to represent where the eyes are gazing.
• All Props: Here you can list the props in your scene you want the node to consider.

Face Tracking Node

• CG: ✅
• 360 Video: ❌

The Face tracking node allows users to detect if the wearer of the headset is presenting a particular emotion from a select predefined set. The node can also be used as a way to stop this system from running buy selecting stop node.

This is hardware dependent, and if face tracking cameras are not present on the headset, then this node will automatically complete and not function.

• Is Stop Node: If this is selected, then this node will stop the whole tracking system, overriding any other duration based face tracking nodes.
• Emotion: Which emotion you are using this node to track for.
• Target Emotion Duration: If the total time for which the node detects the emotion is being shown for is greater than this number, then the node succeeds.
• Node Duration: The total amount of time the node is tracking for.

Slider Node

• CG: ✅
• 360 Video: ✅

This node will showcase a series of statements for the user to rate. It can be done with a numeric value or with Likert Labels defined by the user.

• Scale Type: This is a choice between 'Percentage' and 'Likert'.
  • Percentage: This shows a numeric value.
  • Likert: This will show the options you have put for the slider.
• Instruction: This is optional text to be shown on the mechanic.
• Prefix / Postfix: These are items that can go before and after for the percentage scale type.
• Likert Labels: These are the options that will show when changing the slider value.
• Statement Prompts: These are the options that will show each time you go through the slider.
  • Learn More: When clicking on the statement prompt, the Statement text will change to this.
  • Audio Clip: When clicking on the statement prompt, the audio clip will play if it is set.

Ask Me Anything (AMA) Node

• CG: ✅
• 360 Video: ✅

Introducing the Ask Me Anything (AMA) Node, your ultimate tool for creating AI-driven NPCs that engage players with dynamic, personalized responses. Transform your in-game characters into interactive, knowledgeable personas with ease.

Generation Phase

GPT Key: Seamlessly integrate your OpenAI account with a simple key entry. Character Selection: Choose any character from your scene to become your AI persona. Voice API Integration: Utilize Google Voice and Overdub API to give your NPCs realistic voices. Customizable Learning Files: Upload files like PDFs (e.g., a manual on operating a digger) for the AI to learn and reference. Persona Customization: Define the NPC’s personality and knowledge base directly within the system. Voice Clip Generation: Generate six unique voice clips, including an introduction and five standby responses, enhancing immersion while new responses are being generated.

Post-Generation Configuration

Intro Dialogue: Set the introductory audio clip that welcomes users to interact with your NPC. Character Reassignment: Easily reassign the NPC persona to any character within your scene. Conversation Loop Control: Decide whether the NPC can engage in continuous conversation or limit it to a single interaction. Max Question Limit: While looping is enabled, control the number of questions a user can ask, ensuring a balanced interaction.