It’s been a very busy few weeks here, in case you were wondering why the blog has gone quiet all of the sudden. This is a quick post to let everyone know that Christian and I will be attending GDC in San Francisco in a couple of weeks. If you would like to meet up, send me an e-mail to ENLIGHTEN3D@feelingsoftware.com. I will definitely make time while I’m down there to blog about what’s going on at GDC.
Here are a few screenshots of a project that we have been working on at Feeling Software. From aerial photographs, this proof-of-concept shows how we can automatically build a 3D city model using our Feeling Constructive computer vision technology.
This was produced only using data that we were able to obtain internally. Better imagery, along with GPS position information, can be used to create 3D city models of much greater quality.
In a second proof-of-concept, we use 5 ground-level photos taken with a standard digital camera to create a near photo-realistic 3D model of one of the buildings nearby to our office in Montreal. This is done in a semi-automatic way, such that no 3D modeling experience is necessary to create the high quality 3D model.
Below, you can see how the City of Montreal uses the Feeling Engine GIS Edition as a visualization and planning tool for the city’s GIS department. Our office is in the red building!
Today, local governements today are creating impressive 3D representations of their cities, both for internal planning purposes and as external marketing materials. As the need for tools to create 3D cities rises across the globe, Feeling Software is looking for partners to bring these cutting-edge computer vision technologies to market.
Frequent readers of this blog are familiar with Presto3D, a 3D model marketplace that we built and launched a few months back. The main distinguishing feature of that site was that artists could upload 3D models in a standard Maya or 3dsmax format, and we would automatically convert it to a form of COLLADA so that we could show a 3D preview of it within the browser.
In our latest update, you can now embed the 3D viewer with a specific model anywhere on the web. A one time plug-in download is required, but it is definitely worth it. The 3D rendering and speed is impressive, as is the artwork by hundreds of talented artists. The artist is credited and their models are linked to in the embedded window, to provide extra promotion. And anyone can embed the models anywhere, provided the artist grants permission.
Right now, the plug-in works on Windows in Internet Explorer and Firefox browsers. For those interested, the plug-in is a web-enabled version of the Feeling Engine.
Usability and time-to-learn are two big concerns with any web application. For 3D applications, both of these factors have led to the downfall of some pretty innovative sites.
In the video above, I demonstrate how we use the Constructive technology to refurnish our own conference room in 3D without having to learn any new or foreign process. With a few points tagged in two pictures by an operator, Constructive understands the camera position, orientation, and focal length, allowing me to move around the 3D furniture along the floor with the correct perspective. And since Constructive understands the relationship between the photos, moving a piece of furniture (or a French maid, as the case may be) in one photo will also move it with the correct perspective in any and all others.
This application also addresses the issue of scalability; by not requiring any highly trained or skilled work to be done, the simple manual tagging process can be cheaply outsourced or put “in the cloud” using Amazon’s Mechanical Turk.
I look forward to seeing innovative retailers using Computer Vision technology like Constructive to add a level personalization that doesn’t exist today. Soon, we won’t have to try to imagine what our new room will look like; you will be able to perfect it before ever putting any money down, and even share your ideas with friends and family to get their thoughts too. A mother knows best, right?
In the last month, Josh and I have had the opportunity to meet with several companies on the cutting edge of the computer vision and graphics field. First, we sat down at SIGGRAPH with the team leaders on Intel’s Larrabee project (the topic of a future post). More recently, we talked to Videosurf CTO Eitan Sharon, our pick for top company presenting at the TechCrunch50 conference two weeks ago. Last week, we got to chat with the founders of a local startup, Float4 Interactive, a Montreal start-up, who is turning image processing and computer vision techniques into an interactive art form.
Although Float4’s custom software technology works with cheap cameras (e.g. eyeToy) and regular screens, the effects are most impressive when displayed life-size using a back-projected display and two high-performance cameras. They provide turn-key solutions and even rent the hardware for special events, such as extravagant wedding ceremonies, industry expositions, and advertising installations.
Applications and clients.
Other companies experiment similar technologies — I remember seeing some at SIGGRAPH – but Float4 has raised the bar in interactivity, robustness and aesthetic quality.
Here are a couple examples of the applications of their current technology:
Move your body to create unique animations (such as juggling a soccer ball)
Experience the joy of flying like an airplane or a bird, by shifting or waving your arms.
Already, the company has attracted attention from notable clients such as the Cirque du Soleil. Despite our best efforts to pry it out of them, the Float4 folks are staying quiet on exactly what kind of display they’re building for the Cirque. Personally, I’m excited to see how this state-of-the-art graphical technology gets integrated into what is already a visually astounding performance.
If creating 3D models was as easy as taking photos, it is safe to say that the use of 3D would be far more widespread than it is today. From e-commerce to virtual tourism to casual games, reducing the cost and complexity of creating 3D models would have a widespread effect on multiple industries.
Feeling Software is making that possible. Over the last 2 years, we have worked to develop a technology that allows anyone to create 3D models with little effort and no training. Our goal: simplicity. You take a bunch of photos with a regular camera from any angle you please, and we automatically create a 3D model. The demo video below discusses our project in detail.
We have thought of a variety ways that this technology can be applied to solve problems for consumers. For our readers, imagine that you could take photos of an object or scene, press a button, and instantly have a high-quality 3D model of that object or scene. If this technology were available today, how would you use it?
After months of development, Presto3D left closed beta last week and has opened to the public. If you missed the post a few weeks ago, Presto3D is a 3D model marketplace that automatically creates 3D previews of the content that is submitted.
The reception has been positive, and we have gotten press coverage on several major animation and game development sites. If you haven’t taken a look at the site yet, come check out what we’ve been up to for the last few months. If you already visited the site during the closed beta, it’s worth going back just to see the fullscreen 3D previews that we’ve added in the latest release.