Deep Exploration

Right Hemisphere's Deep Exploration Standard Edition is a software tool that allows the quick production of multimedia 3D graphics. Unlike typical multimedia 3D tools, Deep Exploration Standard Edition is a unified application that works across a number of multimedia formats and 3D graphics styles so it is easy to take advantage of existing content and avoid big changes in file formats. The main operations that Deep Exploration performs includes: (a) translate 2D and 3D graphics and multimedia files, (b) search, view, and markup 3D graphics and (c) author, render, and publish 3D images and animations.

The above screenshot shows a 3D model representing City University’s campus and it was used as part of the LOCUS project. This 3D model (or 3D map) was originally generated in 3D Studio Max and then converted into two different formats used for mobile navigation in personal digital assistants (PDAs). More specific, the 3D map was converted in VRML for the Virtual Navigator interface and to DirectX for the MD3DM VR interface.

More information:

http://www.righthemisphere.com/products/dexp/

IJAC Journal Article

Last June, the International Journal of Architectural Computing (IJAC) has published a journal paper I co-authored with colleagues from the Centre for VLSI and Computer Graphics at the University of Sussex and the Ename Center, in a Special Issue on Cultural Heritage. The title of the article is ‘Multimodal Mixed Reality Interfaces for Visualizing Digital Heritage’ and the main aim of the paper is to provide several different and interesting types of virtual heritage exhibitions by utilising Web3D, virtual and augmented reality technologies for visualizing digital heritage in an interactive manner through the use of several different input devices. A high-level diagram illustrating the technologies employed in the multimodal mixed reality system is presented below.

The novelty of the technologies employed is that they allow users to switch between three different types of visualization environments including: the web in the traditional way, but including 3D, virtual reality and augmented reality. Additionally, several different interface techniques can be employed to make exploration of the virtual museum that much more interesting. In particular the architectural diagram illustrates several interaction modes from use of SpaceMouse and gamepad through to use of a physical replica of an artefact, and simple hand manipulation of AR marker cards. In addition, several visualization scenarios are provided ranging from the familiar web page but with 3D object, a virtual gallery environment, a person using a physical replica of an artefact to control and explore the virtual artefact, and several augmented reality examples.

A draft version of the article can be downloaded from here.

Polhemus Patriot

Polhemus PATRIOT is a cost-effective solution for 6 Degree-Of-Freedom (DOF) tracking and 3D digitizing. Patriot can accommodate a wide array of indoor applications such as head tracking, biomechanical analysis and computer graphics to cursor control and stereotaxic localization. PATRIOT includes a system electronics unit (SEU), a power supply, one sensor and one source. However, it is possible to expand the system’s capabilities simply by adding an additional sensor or an optional stylus. Measuring in at only 6.75 by 6.25 by 1.75 inches (LWH), the electronics unit is compact for easy installation in any environment. PATRIOT interfaces with the host computer via RS-232 or USB 1.1 and it's fully compatible with Windows® XP, Windows 2000 and Linux®. The source and sensor contain electromagnetic coils enclosed in plastic shells. The source emits magnetic fields, which are detected by the sensor. The sensor’s position and orientation are precisely measured as it is moved. Because the sensor is completely passive, it's safe for use in any application.

PATRIOT provides dynamic, real-time measurements of position (X, Y and Z Cartesian coordinates) and orientation (azimuth, elevation and roll). PATRIOT can update data continuously, discretely (point by point), or incrementally. With the optional stylus, you can trace the outline of a physical object or collect polygon facets and get pinpoint accuracy of unlimited X, Y and Z data points. PATRIOT offers low latency and high stability to ensure precise, uninterrupted tracking at all times. It boasts an update rate of 60Hz per sensor and has a range of five feet, resolution of 0.0015 inch and 0.1 degree, and static accuracy of 0.1 inch RMS for the X, Y, Z position and .75 degrees RMS for orientation. Latency is less than 18 milliseconds for both sensors simultaneously.

More information:

http://www.polhemus.com/?page=Motion_Patriot

Sensor-based Mixed Reality

During June and July 2007, I have co-supervised with members of the Cogent research group and the department of Creative Computing, a research project regarding a mixed reality audio-visual visualisation and localisation interface. The project has been developed over a six-week period by three students and operates within a room which is equipped with fixed-location wireless sensing devices called gumstix. These nodes are multi-modal although the system makes use of the microphone only. The main objective of the project is to display a 3D representations of the audio data contained inside the room blended with 3D information. The overall architecture of the sensor-based MR interface is presented below.

This project has been designed to test at least some aspects of the mixed reality presentation system, using easily available sensors and display devices. MR presentation of the sound field occurs within a 3D computer model of the room in which the sensors are located. It can take a variety of forms from a sound 'mist' to 'objects' representing the sound, which hang in space. Computer-vision registration is achieved through the capabilities of ARTag and ARToolKit and the best available marker is selected using confidence levels. Finally, in terms of localisation, the sensors calculate the location of a sound before drawing the object in 3D space.

More information and a demo video of this work can be found at:

http://www.youtube.com/watch?v=ittMEBIPFNw

3D Mouse Navigation

3Dconnexion has made powerful 3D navigation accessible and affordable for architects, artists, students and anyone else who wants to enjoy the 3D experience. In particular, 3Dconnexion devices are ideal sensors for navigation into virtual and augmented reality environments, mainly because they provide intuitive manipulation in six degrees-of-freedom. A characteristic example is SpaceNavigator™ which is shown below.

3Dconnexion's SpaceNavigator™ is a very cheap solution to 3D navigation. It works with more than 100 of today's most popular and powerful 3D applications and it is ideal for Google Earth version 4 and Google SketchUp. An alternative and a bit more expensive solution is SpacePilot which is illustrated below.

The 3Dconnexion SpacePilot, connects the users to the 3D design process in a different way that the standard mouse does. Its optical sensor technology and ergonomic design combine to deliver unprecedented control and fewer distractions. The SpacePilot may be used in user’s non-dominant hand to position, rotate, pan and zoom a model in one single, fluid motion. It can be also used in conjunction with the standard mouse w to simultaneously edit the model or select menu items.


More information:

http://www.3dconnexion.com/

OQO model 2 Handheld PC

OQO model 2 is another ultra mobile computer (it is the main rival of the SONY VAIO UX model) which is ideal for a number of everyday applications including navigation and wayfinding, location-based services as well as many more. The model 2 comes standard with WiFi 802.11a/b/g and Bluetooth 2.0 technology, 60GB hard drive, 5-inch Wide VGA LCD display and a 1.2GHz or a 1.5GHz VIA C7M ULV processor with integrated graphics chipset.

The OQO model 2 includes a keyboard that features a track stick mouse pointer for precise cursor movement with your thumb and dedicated zoom keys for quickly changing screen magnification that allow full interactivity while zoomed, and support 1000x600 and 1200x720 interpolated modes. The main flaws of the model 2 are that it lacks a digital camera which is nowadays a standard feature with any mobile devices (smartphones, PDAs and other handhelds) and there is no built-in memory card reader.

More information:

http://www.oqo.com/products/index.html

Gumstix Verdex

Gumstix has launched the 3G of its gumstick-shaped SBC (single-board computer) line. The tiny, Linux-friendly, PXA270-powered "Verdex" SBC offers 50 percent more processor speed and twice the memory of earlier models, and features an enhanced expansion bus, according to the company. In addition to its Marvell (formerly Intel) PXA270 (aka "Bulverde") processor, clocked at up to 600MHz, the new Verdex SBC integrates up to 128MB of RAM and 32MB of flash memory soldered onboard, the company said. Other enhancements over previous Gumstix SBCs include support for USB host interfaces, inputs for CCD (charge-coupled device) cameras, and better power management. Also available is an option for on-board Bluetooth, with a u.fl antenna connector, as shown on the Verdex XM4-bt board shown below.

The Verdex maintains the 3.2 x 0.8 x 3.2-inch (80 x 20 x 8mm) of Gumstix's earlier SBC generations. In addition to matching the dimensions of its predecessors, the Verdex retains the 60-pin board-to-board connector of the first generation SBCs (now referred to as "Basix"), which should enable it to support existing 60-pin expansion cards; these include audio I/O, digital I/O, various microcontroller co-processors for robotics applications, and serial and USB expansion. The Verdex replaces the 92-pin I/O expansion connector introduced with the second-generation SBCs ("Connex"), however, with a pair of connectors. The combination of a 24-pin flex connector and separate 120-pin connector will support a range of new expansion boards, including much sought-after USB host ports. On the software side, the Verdex SBC comes preinstalled with the latest Linux 2.6 operating system as well as the open source U-Boot bootloader. Some of the potential applications include position-tracking applications. At Coventry University, we are developing a sensor-based mixed reality platform based on Gumstix technology.

More information:

http://www.linuxdevices.com/news/NS7437869444.html

Sharp Zaurus SL-C3200

The Sharp Zaurus SL-C3200 is the sixth generation of the groundbreaking SL-C line of LINUX-based PDAs. The internal 6 GB drive offers unparalleled storage and opens up new options--including using the Zaurus as a portable media player. The C3200 has both compact flash and SD slots. And, since the Zaurus's HDD is plug-n-play recognized by Windows, moving data is by USB 2.0 connection is fast and easy. Rather than running a somewhat limited PDA operating system, it runs Linux which means the CPU and RAM are the only real limit for running Linux applications. Linux apps must be recompiled to run on the Zaurus but that's not a daunting task, and we've seen many useful ports and open source software for the Z emerge over the years. In fact, there are several ROMs available for the Z as well.

The Zaurus runs Lineo Linux with kernel 2.4.20 and Qtopia window manager. It includes a 3.7" VGA (640x480) screen including an optional VGA-out connection. There is also a built-in zoom function that allows zooming into the screen in five increments. Each step is larger than the previous, but none suffers any loss of quality. The screen's orientation automatically adjusts when swiveled. It's a very impressive design. Similar to the HTC Universal models, the swiveling screen transforms the shape of the Zaurus from PDA-style to laptop-style. Other technical specs include an Intel XScale PXA270 processor (416 MHz), 64mb RAM, and 128mb flash ROM. The two slots (1 CF, 1 SD) are I/O, so they support wireless connectivity (such as Bluetooth or Wi-Fi). There is a stereo-out for MP3 playback. The Zaurus SL-C3200 measures 4.9x3.4x1.0 inches (124x87x25mm), and weighs 0.65 pounds (298g).

More information:

http://www.mobiletechreview.com/Sharp-Zaurus-C3200.htm

http://www.dynamism.com/sl-c3000/main.shtml