We made it! Thanks for supporting Public Lab's 🎈 Mini Balloon & Kite Kit (part of Kickstarter Gold) -- watch the video!

  • 1

Question:Video Infragram

jfd is asking a question about infragram: Subscribe to answer questions on this topic

jfd asked on December 14, 2016 08:37
293 | 2 answers | shortlink

C implementation of Infragram for realtime image processing

We would like to process images in realtime - e.g. at least a 30FPS framerate at HD resolutions. I'm looking for a C implementation of Infragram which could run with some DSP modifications on a 1Ghz+ microprocessor. Worst case, I plan to simply port the JS to C if that has not been done already.

Background story

I've developed a camera system based on Raspberry Pi which we are using for aerial and atmospheric videography and research using experimental rockets and drones. It's basically running raspivid and audio capture for offline muxing into MP4. No big deal, other than the flexibility to develop custom algorithms and now that the base HW setup and SW load has been tested it's a good baseline.

Using a Pi-Zero camera system is about $5 (Pi) +$15 (Cam) +$5 (Lipo) +$5 (PiZero Lipo) + $5 (SD-Card 16MB). At $30 it is cheaper than the Mobius camera and allows a much more flexible firmware to be developed.

I've recently modified this system with a 5Ghz RF Transmitter for use in drones or live telemetry and plan to build a modified camera sensor to conduct agricultural research in Central Valley CA.

Has anyone already done a C implementation? Happy to share any of our findings and/or port of the same.

For more info see here: https://www.raspberrypi.org/blog/rocket-man/ http://realflightsystems.com/wordpress/?page_id=722

Thank you and best regards -James

near-infrared-camera infrared infragram n multispectral-imaging

question:infragram question:infrared question:multispectral-imaging question:general


Log in to comment

2 Answers

Hi, this is a good question, but I wanted to suggest possibly adapting the WebGL implementation which is awfully fast:


In either case, I'm very interested in reworking infragram's core libs and adding a test suite -- whether implemented in JS, GL, or C, we should be able to pass in an image and a transformation expression, and get the same output -- that way peoples' infragram expressions would be portable between different implementations, and developing a new implementation would be easier since it'd have to pass the same test suite.

I didn't write the GL implementation, but have worked on the JS one a lot, and it needs a lot of structural/modularity work. Happy to offer more input as you decide which way to go, and perhaps we could select a set of before/after images to use as our common test suite. Thanks!

Nice! Thank you Warren, ok I will check it out. Yes, I will develop on Github... I will have some time in next 2 weeks, once I get a prototype going will send you a pointer.

best -james

Sign up or Login to post an answer to this question.