Public Lab Research note


Rough prototype of video analysis tool for monitoring a pixel's brightness/color over time

by warren | July 23, 2017 10:17 23 Jul 10:17 | #14675 | #14675

I've spoken with a few people over the past months about figuring out a way to monitor the color of a patch of water or air in a timelapse video -- to see if it changes on a cyclic basis, and if you can detect things like turbidity changes, emissions, and that sort of thing by looking at a graph of color change over a long period of time.

With help from a few people at a Tactical Tech event this week (more soon), I got a very rough prototype running; you can upload .mp4.mp4 videos (maybe others?) and click on the video where you want to "monitor" -- and as it plays, it'll graph the brightness of the pixel you've clicked. The data can be downloaded as well.

This has lots of possible pitfalls or problems - obviously the day/night cycle changes the lighting conditions, and so does the weather. The idea, though, is to see if, in a predictable enough situation, you could see some kind of recognizable and measurable change.

I used a timelapse video of mountaintop removal mining by @laurachipley (posted on this note) and it's working enough to try a few videos out. Please - if you have a timelapse, give it a try! Comments, ideas, refinements, all welcome.

https://jywarren.github.io/video-analyzer/

Keep in mind, it's a very rough prototype! It is likely to break :-P

I got this data from the mine video, clicking on the exposed hillside -- but i wonder if my computer being really slow is making the video display poorly and therefore the data much rougher than it really is:

Plotly: https://plot.ly/~jywarren/1/

image description

x,y
1,96
3,66
5,29
7,111
9,191
11,80
13,146
15,70
17,164
19,71
21,138
23,255
25,255
27,255
29,255
31,255
33,255
35,255
37,255
39,254
41,255
43,255
45,255
47,255
49,226
51,255
53,249
55,255
57,255
59,255
61,255
63,255
65,255
67,255
69,206
71,255
73,255
75,208

2 Comments

@xose check this prototype out for your river timelapse project... Very crude but interesting?

Is this a question? Click here to post it to the Questions page.

Reply to this comment...


Impressive Jeff. As soon as we check the outcome, this analysis will be carried on the pictures obtained ;)

Reply to this comment...


Login to comment.