Blog

Notes on ongoing projects — builds, experiments, and things I'm learning.

Create a capture workflow for my Azure Kinect and Windows 10 laptop.

Open3D seems like a good framework to use for my Azure Kinect experiments. I do have Visual Studio on my laptop due to Unreal Engine work, but I'm really looking for a bit simpler solution, and hoping the Python will work.

Get...

I've been very interested in Lightfield technology ever since I visited the now defunct Lytro company here in the Bay Area. It is so disappointing that they were absorbed by Google and basically disbanded. (come on tech entrepreneurs stop giving in!) In any event I've gathered notes here, this techn...

I'm working on my mobile immersive camera using the new Azure Kinect and Nvidia Jetson. I'm brainstorming what I want the physical format to be, the interface to be like, and also the camera mode functionality required.

Interface

Portability, Robustness, Compatible with standard camera tools, e...

Unreal Engine is a great game engine, and ecosystem, but some seemingly basic things are really complicated to pull off. I want to have a particle follow a path, something that is pretty easy in most other systems, but not UE4.

First thing I need a path. UE4 calls these splines, but you can't impo...

Blackmagic Fusion is my preferred application for all things VR/360 video related. It is such a powerful tool, and with the addition of KartaVR, right up there with Nuke. Occasionally I'll find an interesting processing technique that is not available in Fusion, that's where these fuses come in hand...

Motion Capture (MoCap) has historically been implemented using expensive hardware, typically a large number of high speed cameras in combination with physical markers on the human to be capture. This works very well and has been the standard in the high end visual effects market. However, as softwar...

Backup Scenarios

Every IT person will have a different idea on backup, especially these days with multiple options. I subscribe to the "3-2-1 Backup Strategy" I was thinking about using my primary FreeNAS, a second local hard drive RAID, and cloud object as the third. But, when I started putting...

Meshlab is the best free pointcloud processor out there. However, there isn't a built in way to process a bunch of pointclouds. Linux to the rescue, but some might have a hard time getting the latest Meshlab working on Linux, note that most of the prebuilt binaries I found were for version 2016 whic...

One challenge with 360 photos and videos is that everything is in frame! There is no place to hide, so the tripod is in every shot, and the photographer is in a lot of the shots as well. For my 360 image pipeline it would be nice to automate removing the tripod at the "nadir" and also removing peopl...

Pointclouds are the native output of various 3D capture devices including LIDAR scanners, and structured light depth cameras. I have a need to process an animation of pointclouds, eventually getting them into Unreal Engine.

File Formats

There are a ton of different file formats for pointclouds....

I really love Blackmagic cameras, they are real video cameras, not still cameras trying to be video cameras, so the software is enjoyable to use. The quality is very good, and they have genlock which is important for a 360 rig.

I've been eyeing 360 designs Blackmagic Mini cameras, they are the t...

Here are the products I'm using for the Ultra rack PS installation:

Ultra Rack Amazon List

In addition to the Netgear switch for IPMI there are a number of blanking panels, screws and cable management items required. This kit assumes a "half rack" and that the Panasas front 2U LED panel, and rea...