One of Microsoft's research projects
is Holoportation -
Given what we are going to talk about this week in collaboration, and what we have discussed previously in regards to tracking and cameras and interaction, and given your experience playing with the holoLens back at the beginning of the class, give your critical analysis (positives, and negatives) of this work in the typical homework webpage writeup.
With GPUs becoming smaller and more powerful, and AI improving through Deep Learning and other techniques, we are seeing computers gaining a better ability to classify things on the fly, so for example one could classify things in videos as in https://www.youtube.com/watch?v=MPU2HistivI and we have apps that tell us what song is playing nearby, allowing us to augment our knowledge of both the visual and auditory space around us. Imaging you had these tools running constantly on a phone or eyewear. Write your typical 1 page on how you would make this helpful and not annoying?
Week 7 Homework
A new trend in AR apps is evaluating virtual furniture placed within the room where you are thinking about putting it. For this homework you should try out one of these apps - IKEA Place is one example. Take a room you know, place a piece of appropriate furniture in it and take a screen capture. Then do the same thing for a place you normally wouldn't see a piece of furniture like that - like a bed in the middle of Halsted St. or a stove in the middle of campus. Add these two snapshots to another homework page and write down the typical one page of your thoughts on how AR applications like this could be effectively used in the future.
A few other potential apps can be
found at https://thinkmobiles.com/blog/best-ar-furniture-apps/
5 and 6 Homework
google translate in its smartphone app shows some of the more 'serious' potential of augmented reality as it allows you to automatically translate text into other languages. For this assignment you should find something in a foreign language in the real world (not by bringing up images in google) and take a photo of it, and then save 2 or 3 screens when google translate is translating it with varying degrees of success. Create another public webpage on your site and attach the photos and a page of text you have written on how you think this capability would be most effectively used. Right now on your smartphone it allows you to have a lens that you can move over the real world and see it modified on the phone's screen, but what if you were running this in a future AR pair of glasses or contact lenses, and it was automatically translating everything it sees to the language of your choice and hiding the original text from real world. What are the pros and cons of that? How much control do you think the user should have over the way the synthetic is mapped over the real.
By this Friday at 9pm Chicago time you should have Unity set up and running with Vuforia and have gone through the 'getting started with Vuforia in Unity' tutorial. As part of that you should create or download a 3d model of your choice and have that model stand on the Astronaut image target (either printed out or on your phone or laptop screen) when the camera points at it. Make sure the model is an appropriate size to see it on the Astronaut image target. Take a screenshot showing the 3d model standing on the image target and add that to a new webpage that you add to your 428 website and a page of text on your initial thoughts about uses for this technology, assuming you were viewing it through your phone, and then through a pair of AR glasses that you were always wearing. If you use a model you found on the web be sure it is available for use and give appropriate attribution to its creator(s).
here is a link to the astronaut image target