We will update our weekly progress and contribution in this post.

Snippet Week 1 (Jan 16)

  • Finalized idea of project. Began researching how to implement and possible technical challenges.
  • Researched how our application can work in AR vs VR
  • Researched existing solutions to our problem, determining how our project could be unique or build upon these solutions.
  • Dove into how to solve some of our specific technical challenges:
    • Multi-user object visibility
      • MRTK’s solution
      • Harmonize
    • Retrieving 3D Assets
      • Various text-to-speech solutions
      • Could generate with AI models
  • Kenny - wrote up the overview, mission, and milestone sections of the first-draft project plan, started mapping out week-by-week * milestones for the PRD and conducted a preliminary survey of possible machine learning models for the team to consider using for the project - specifically looking for pre-trained models for converting text-to-art and text-to-3D assets.
  • Hitesh - conducted initial search on existing options for supporting multiple users viewing the same object. Better understanding of how AR/VR works and the technology involved with developing applications. Looked at potential voice-to-asset selection methods.
  • Simona - set up the initial website and updated with weekly snippet. Conducted research on the existing presentation tools in VR. Created slides for Project Pitch.
  • Aroosh - Conducted research on existing solutions in the space, and evaluated their effectiveness against our proposed solution of changing how powerpoints are conducted.

Snippet Week 2 (Jan 20)

  • Team: Mapped out a matrix of presentation features and competitors to identify our niche. Narrowed from building a presentation suite in VR to focusing on animations and transitions in our MVP
  • Simona: Write User Experiences and Risk in PRD, uploaded snippets and PRD onto website
  • Aroosh: Wrote the project description, materials and budget in the PRD.
  • Kenny: Evaluated feature/competitor matrix and consulted course staff to narrow down project, created control flows for adding animations and transitions to identify core features, wrote up deliverables and milestones sections of the MVP.
  • Hitesh: Aided in ideation and narrowing of project scope. Helped determine how to restructure project for greater usability and uniqueness.
  • A bulleted list of new features/functionality implemented
    • Finished PRD and finalized the features we wanted for MVP
    • Identified the unique contribution of our product
  • A bulleted list of specific files the team would like to have reviewed
    • PRD
  • A bulleted list of blocking issues or other help needed
    • N/A

Snippet Week 3 (Jan 27)

  • Aroosh: Created a script to serialize scenes into a compact file store. Worked on setting up an AWS S3 backend setup.
  • Simona: Set up multi-user viewing (Photon) following John’s sample, added dialog when new user enter, different types of client setting (master client in yellow)
  • Kenny: Designed MVP hand-ui for animations and transitions with Hitesh and implemented/tested the workflow for importing MRTK UIs from Figma to Unity and deploying to Quest. Started creating scripts to show animation UI popup when pinching an object.
  • Hitesh: Worked with Kenny to determine workflow for animations and transitions that should be represented in UI. Utilized Aroosh’s serialization scripts to begin and developed a solution to scene transitions for up to 5 scenes.
  • A bulleted list of new features/functionality implemented
    • Added scene serialization - link
    • Multi-user(2 commits) - link
    • Hand-ui - link
  • Bulleted list of specific files the team would like to have reviewed: Nothing yet
  • A bulleted list of blocking issues or other help needed: Nothing yet

Snippet Week 4 (Feb 3)

  • Aroosh: reworked saving scene to json, merged mvp-demo with multi user and saved scenes, merged multi user with scene transitions
  • Simona: Built 2 airport scenes for the demo video, merged multi-viewer into the demo, prepared presentation & demo script
  • Kenny: worked with Simona to design the MVP hand menu, implemented several iterations in Unity. Worked with Hitesh in designing data representation of animations/transitions in Unity.
  • Hitesh: worked with Kenny to design data representation of animations and transitions, including designing data structures, tracking state, and writing button scripts.
  • A bulleted list of new features/functionality implemented
    • Demo scenes - link
    • Hand-menu-v5 - link
    • Saving Scenese to json - link
    • Mvp demo with scene transitions - link
    • Mvp demo with multi-user & saved scene - link
  • Bulleted list of specific files the team would like to have reviewed: Nothing yet
  • A bulleted list of blocking issues or other help needed: Nothing yet

Snippet Week 5 (Feb 10)

  • Kenny - Implemented new hand menu UI, worked with Hitesh to implement animation menu functionality, worked with Aroosh, Simona, and Hitesh to design front-end for asset library, web import, presentation mode, and timeline UI.
  • Hitesh - Worked with Kenny to fully implement animation mode, resolved rotation animation bug.
  • Simona - Created scripts/some video clips for demo, worked with Kenny to design UI for the future features
  • Aroosh - Implemented network-shared assets and scene transitions across multiple devices. Responsible for merging all of the individual features into the cohesive MVP demo.
  • A bulleted list of new features/functionality implemented
    • MVP Demo complete - link
  • Bulleted list of specific files the team would like to have reviewed
  • A bulleted list of blocking issues or other help needed
    • We would like your feedback on the new UI we are designing for the Asset Library and Timeline UI features we are about to implement. Please see the UI sketches here
      • Asset Library: Users could import their assets or use the pre-packed ones and create the assets in the scene
      • Timeline UI:
        • Interface to order animations/scenes
        • Interface for hand menu in the presentation mode(ability to play animation & transition scenes in the preset order)

Snippet Week 6 (Feb 17)

  • Kenny - Worked with Aroosh and Simona to design UI for presentation mode, timelines, and asset library. Designed and started implementation for new multi-mode hand menu.
  • Hitesh - Worked with Simona to design how the timeline for presentation mode would be represented internally. Researched into the ability to load in 3D models from Unity and the feasibility of an “empty” object whose meshes are modified.
  • Simona - Worked with Hitesh on designing data structure for ordering animation/scene, worked on building the order menu UI
  • Aroosh - Created a basic web portal to allow for uploads to a s3 bucket. Created a cloud syncing functionality for scenes so scene data is downloaded from the cloud.
  • A bulleted list of new features/functionality implemented: N/A
  • Bulleted list of specific files the team would like to have reviewed: N/A
  • A bulleted list of blocking issues or other help needed: N/A

Snippet Week 7 (Feb 24)

  • Kenny - implemented multi-mode hand menu, cleaned up animation code, and started integrating scrolling animation list into hand menu.
  • Hitesh - Figured out how to modify object meshes at runtime. Started building out timeline functionality and integrating it with existing hand menu buttons.
  • Aroosh - Finished end-to-end cloud syncing functionality with headsets and downloading scene data to the cloud.
  • Simona - Finished data structure script for the timeline order functionality and finished implementing the scrolling list menu
  • A bulleted list of new features/functionality implemented
    • Multi-mode hand menu - link
    • Presentation order - link
    • Scrolling menu - link

Snippet Week 8 (Mar 3)

  • Kenny - Finished integrating all hand menus and tested animation list population, started designing PrezVR presentation for final demo, and created proof-of-concept for instantiating objects from the asset menu.
  • Hitesh - Finished integrating presentation functionality into new hand menus. Added scene transitions into new menu. Updated animation list population to handle switching between scenes.
  • Simona - Set up the UI for the presentation and asset library menu, finished the icon set, working in progress (Instantiate objects from asset menu)
  • Aroosh - Fixed all bugs with downloading meshes and scene data from s3. Created the ability to normalize the size of downloaded meshes
  • Commits
    • Instantiating objects from asset menu - link
    • Integrated hand menus - link

Snippet Week 9 (Mar 10)

  • Simona - started asset menu functionality, re-organized asset menu UI, edited the final video.
  • Kenny - created final class presentation, tested integrated app, created/recorded presentation for showcase video, and added 2-way selection for animatable objects in the scene and list entries in the animation list.
  • Hitesh - finished testing presentation mode with other features, implemented swapping animations ability, and various quality of life improvements.
  • Aroosh - Finished last bug fixes and merged all changes to master
  • Commits
  • Highlight outline - link
  • Final master commit- link
<
Blog Archive
Archive of all previous blog posts
>
Next Post
Product Requirements Document