What I want to do
I'm an agronomist, I'm going to make a IR RaspiCam to do an IR Timelapse in g...
Public Lab is an open community which collaboratively develops accessible, open source, Do-It-Yourself technologies for investigating local environmental health and justice issues.
Public Lab Research note
By signing up, you agree to the Code of Conduct, which applies to all online and in-person spaces managed by the Public Lab community and non-profit. You also agree to our Privacy Policy.
As an open source community, we believe in open licensing of content so that other members of the community can leverage your work legally -- with attribution, of course. By joining the Public Lab site, you agree to release the content you post here under a Creative Commons Attribution Sharealike license, and the hardware designs you post under the CERN Open Hardware License 1.1 (full text). This has the added benefit that others must share their improvements in turn with you.
Raspberry + NoIR cam + Sensors to detect water stress of the plants during their growing
I'm an agronomist, I'm going to make a IR RaspiCam to do an IR Timelapse in greenhouse. I want add same sensors (temperature, moisture, soil moisture) at the IR Raspicam in order to link environmental condition to Health of the plant.
I built a IR camera + blue filter (# 2008) by Raspberry Pi in order to have the time lapse movies of growing plants in greenhouse. I would like especially to detect the water stress or the micro water stress during the stage of growing of the plant o during the day. So I placed the IR camera in a greenhouse at the first stage of growing of the plants of cucumber. The camera use a custom white balance according to https://publiclab.org/notes/LaPa/12-03-2015/how-do-i-set-a-costum-white-balance-of-the-noir-modulo-cam
I posted my first attempts with IR on youtube: the first one portrays 3 water stressed plants of primula just after water supply. Indeed you can see in the time lapse movie the leaves of the plants to increase their turgor as clear demonstration of the reduction of water stress.
I use "ImageJ (FiJi)" + "photo monitoring plugin" to elaborate raw IR photos into NDVI by using InfraBlue.lut that you can see here https://www.youtube.com/watch?v=DUKliCFogxA.
Now I am keeping to shoot photos of the growing cucumber plants in greenhouse. I'm going to elaborate those into NDVI again.
Have that sense for my goals? Could this technique be proper for detecting the water stress of the plants?
Am I going in the right direction?
Any suggestions?
If is it necessary I can send some single photos that I used for my time-lapses
If you consider useful to use Raspberry pi for IR green plant analysis, where I can post some images that I shoot?
Thanks in advance
Best regards by LaPa
Why I'm interested
1) Learn more about IR Images of the plants; 2) to identify by IR Images of the plants best of growing condition or the moments of the worst health (water stress) of the plants during their growth; 3) to use IR Raspicam on aerostatic baloon; 4) To build DIY weather tools by Raspberry Pi
Your time-lapse videos are impressive. These are excellent teaching videos. You can clearly see that the NDVI values for the foliage of the plants changes dramatically through the day. It is likely that these changes are not due to physiological changes in the plant (stress, growth, productivity), but instead to changes in the ambient light and/or camera settings. There are probably also changes in the plant health during these periods of time, but they are too subtle to see. These changes in plant health might produce a change in NDVI of maybe 0.05 or 0.1 or so if the plant was stressed by heat or drought. The color gradients you used have approximately the same color for NDVI values of (e.g.) 0.4 and 0.45, so the color of a plant leaf might not change much if it was actually stressed.
To allow a video like these to show plant stress, a few things must happen:
the ambient light must be constant or nearly constant (brightness, color) for the entire video,
the camera must use the same settings when each frame is captured,
if numbers 1 and 2 are not true, then each frame must be calibrated,
the color gradient used (lut) must have different colors for NDVI values of stressed and unstressed foliage.
There are not enough colors to differentiate all the NDVI values between 0.2 and 0.8 with enough resolution to detect small changes in plant health. So a special lut could be used to differentiate changes in NDVI between (e.g.) 0.5 and 0.3 using all the obvious colors.
Thank a lot all of you for the consideration and the suggestions!
Chris, sincerely I didn't understand from your reply if you consider my direction completely wrong or just that I have a long way ahead.
But, anyway I try to answer to your considerations:
1) I'm using my camera in operative greenhouse (in farm), so the light and color conditions vary widely. And I can't change this. But I can choose some photos where the conditions are similar, for example in same hours of the day but in different days, and work with those.
2) I shoot several hundreds of photos, and I am continuing to do so, to make those movies the white balance is fixed in every photos. The exposure I guess is automatic so I think that vary in each photo. I think it is possible to set fixed exposure for each photo, but I have to understand how to do that.
3) I don't know how to calibrate the photos
4) Is there any lut that I can use in Fiji Photo monitoring plug in. If there isn't how to get the the "special lut to differentiate changes in NDVI" using Fiji Photo monitoring plug in?
NDVI is based solely on color (near infrared is one of the colors). If a camera records different colors for two leaves, the NDVI computed for those leaves will probably differ. The color captured by a camera depends on the surface properties (spectral reflection and absorption) of objects in the scene and also the color and angle of the light illuminating the surface. To detect differences in the reflective and absorptive properties of objects, the light illuminating the scene must be constant. If the light is not constant, the change must be accounted for. Accounting for changing light conditions is done by "calibrating" the process.
One process of calibration requires that special surfaces (calibration targets) of known spectral reflectivity be included in the photographs. The color of all pixels in a photograph is adjusted based on the color of pixels in those targets. Some research notes at Public Lab describe the development of a procedure for calibrating the process, and a plugin for Fiji automates the process. There are still issues with the procedure, and no tests have been described which demonstrate that NDVI derived from the calibration process is always robust. Without calibration, interpreting the meaning of NDVI values should be limited to very general patterns.
It is easy to make new color look up tables (luts) in Fiji. When an image with a lut applied is displayed in Fiji, open the lut editor (Image/Color/Edit lut). Below is a lut in the editor which shows color only for the NDVI values between 0.38 and 0.5.
Almost every color used can be distinguished, so leaves with NDVI values of 0.4 could be distinguished from leaves with values of 0.45. With a series of calibrated NDVI images, this lut could allow a visualization of plants becoming stressed (assuming NDVI of 0.5 is not stressed and NDVI of 0.4 is stressed, and that leaves in the scene have NDVI values in that range).
Calibration targets work outside or in a greenhouse.
Calibration targets are hard to find and very expensive. But some companies are developing new targets for this purpose. It's also possible to make your own if you have access to a spectrometer. You can also use common materials with known spectral reflectivity. This note has some sites where you can find spectral data for common materials: https://publiclab.org/notes/nedhorning/11-01-2013/why-a-red-filter-should-work-well-for-ndvi.
Soil does not work well for calibration because its reflectivity changes as its moisture content changes. If you know the reflectivity of the black plastic in the wavelength bands you will use to compute NDVI, you could use that. But black plastic is shiny so its reflectivity will change as the angle changes. Also it is very dark and will be underexposed in many photos in which case it provides no information for calibration. A medium light and a medium dark target would be better.
Hi,
1) unluckily I don't have access to a spectrometer
2) wich are the companies where I can buy a cheap Calibration targets?
3) may it be fine to use, for my goals, the normal corrugated brown cardboard like one in this image as calibration target?
4) If my corrugated brown cardboard is ok, I can put it in greenhouse and begin to shoot photos with the calibration target inside the images.
5) Do you think the NoIR Pi camera + red filter would be better instead of NoIR Pi camera + blue filter (Rosco # 2008) I use now?
I don't know of any commercially available inexpensive calibration targets. A good calibration target will have the same reflectance for all wavelengths (colors). Most common surfaces reflect a different proportion of blue light compared to red light or NIR. These common surfaces can be used, but it is harder to know the reflectance at any wavelength. For example, not all brown corrugated cardboard will have exactly the same reflectance curve, but they probably all have that steep section between 500nm and 800nm (NIR). The value you choose for the reflectance of red will be very sensitive to the particular curve. For cardboard, it might be acceptable to choose 30% reflectance for red and 45% reflectance for NIR. As long as you always use the same cardboard (and it does not fade or get wet) your results will be comparable with themselves. If you had a surface that reflected 80% of any wavelength that hit it, it is much easier to select a value for any wavelength band (80%).
One target will not be enough. The idea is to describe the relationship between the brightness of NIR or red recorded in each camera pixel (0-255) with the actual energy being reflected from the surface in the NIR and red bands. So you need a curve (an equation) of how pixel values vary with actual reflectance for each wavelength band. So you need at least two points to define each curve. Because your points will have some error (you are not measuring reflectance, just guessing from stuff on the internet) having several points (targets) will probably be good at least to start. You can probably assume a linear relationship because if it is not linear you are going to have a really hard time describing the curve very precisely.
Some of your targets should be bright and some should be dark to cover the range for both red and NIR. If the targets are too dark or too bright, they might be overexposed (255) or underexposed (0) and will not give you very good information. Even black tarpaper reflects 5% of NIR, so the value should not be zero, but it will be zero in a well exposed photo with a small piece of tarpaper in it.
In general, a red filter usually works better than blue.
I haven't played around with it, but I'd assume a neutral gray "TV White" and "TV black" paint like these for TV camera calibration would be the best cheap calibration target option. http://www.rosco.com/FTVP/TVPaints.cfm
ok, THANKS all of you for the answers. I like that my research note elicits answers that can also affect other. I am interested to make experiences with NIR and NDVI at this stage and make a step forward.
I'm not sure I understood all Chris wrote. I guess I miss a lot of basic knowledge. Waiting to get colored surfaces with ROSCO colors that suggested Mathew, change the Pi Cam filter from blue to red;
I could put in greenhouse two calibration target in short time: 1) the cardboard I photographed, 2) tar paper.
Do you think it'll can improve the NDVI transformation for my goals?
Mathew I didn't understand where I can buy "TV White" and "TV Black" and how much those cost, because the linked page "Where to buy" give me "an unexpected error".
well, B&H will sell it to you by the gallon. pricey to try out. $42-95 a gallon, but it sure will make a lot of targets. I tried to get chips of the paint a few years ago, and couldn't at any local Rosco retailer. Rosco wouldn't send paint chips of it either :-(
We might be able to order it on a speculative budget and package up some small amounts for testing if enough people want to try it out and it looks promising. I don't know enough to make that judgement.
Mathew, I haven't seen any spectral data for Rosco paints. Is there any reason to think that they would be better than other paints for NDVI calibration targets?
This sounds like a business opportunity for someone with access to a spectrometer. Buy a few shades of gray paint, paint some plywood squares, get a spectral scan of each color, sell the squares with the spectral data. International shipping is a plus.
The paints are for making consistent whites and greys that will be the same perceptual color across a wide variety of lighting conditions. They are frequently used for white balancing in broadcast settings.
I've never seen spectra for these paints, but I've worked with them commercially on TV sets. The idea that they'd have a flat spectral response is a guess-- these paints exist precisely because commercial wall paint looks so varied in different lighting.
I have the reflectance spectral for these materials and can provide a PDF, Excel, or CSV file of the spectra if someone lets me know a good way to share it:
Black spray paint Glidden Rust Master stove and barbecue flat black
White spray paint Premium Decor PDS-10 White Primer #792314
Gray spray paint Rust-oleum automobile primer
Tar paper Not sure of the brand
White printer paper Hammermill Premium multipurpose, 24 lb, 97 brightness
Red card stock From Middlebury stationary store
Thank you Nedhorning, nice to see your answers in the my research note! I'm reading your notes about calibration trying to understand more about NDVI and calibration targets.
1) You listed some materials, which of those could be better as calibration targets for my goals?
2) I'm in Italy and I think it'll be difficult for me get exactly the same materials you listed, if I buy those by you, is it possible to ship me the most suitable ones?
3) May I put here my eMail address to send me the reflectance spectral you have?
A DIY spectrometer can be used to characterize the spectral reflectivity of a target if two things are true:
The spectrometer must be sensitive in the near infrared region
The spectrometer's relative sensitivity in the visible and NIR bands used to compute NDVI must be known.
Neither of these things is true about the Public Lab spectrometer. A spectrometer that uses a camera with known spectral sensitivity in the visible and NIR region (e.g., PowerShot A2200) could be used.
I removed, at the moment, the camera from the greenhouse. I took thousands of IR photos (every 10 minutes for more then a month) I got a movie ( https://www.youtube.com/watch?v=1Gcey4fJz_E ) , but it doesn't have meaning to detect health of plants. Anyway it was great for me because with your help I learn a lot about Raspberry camera, timelapse, IR and so on. I hope to find a way to do better and to put again the camera in the greenhouse.
1) just wondering which steps you followed to setup and run ImageJ and Fiji in your Raspberry Pi, and get the NDVI images.
I am following this indications of ImageJ (https://imagej.net/Raspberry_Pi) but documentation is quite shallow.
2) Also, did you reach a good end with this project, getting useful NDVI data? was it helpful to detect plant health?
Hi, Elongo, I didn't reach the goal to measure health of plants most because Red Horning wrote me, by private mail, the that technique wasn't proper to detect small reductions of plant health determineted during the day o cycle of cultivation how I hoped.
I'm continuing the project, very slowly ....
However I found very interesting to observe realized timelapse to study the cycle of plants and for understanding eventualy some critical moments, plant stages and so on.
So, then I replaced "IR modulo CAM" with a normal (visible spectre) "modulo CAM" and I focused to add some sensors.
I collected 68,000 data by that sensors and I obtained a new timelapse from january to july of indoor plants.
I'm going to use again IR in future putting both IR (IR modulo CAM) and visible camera (normal usb webcam) on Raspberry PI to avoid the calibration target problem. But it is not my immediate goal.
Thank you so much @LaPa for your insights and sharing the experience.
Would be possible for you share with me how did you implemented, using the raspberry pi, this part that you mentioned in your post:
"I use "ImageJ (FiJi)" + "photo monitoring plugin" to elaborate raw IR photos into NDVI by using InfraBlue.lut that you can see here https://www.youtube.com/watch?v=DUKliCFogxA."
If @cfastie, who also seems very experienced on the field, has any clue, that would be awesome.
I'll be happy to share with you as well if I manage to move things forward and get reliable NDVI data.
Thank you guys.
Public Lab is open for anyone and will always be free. By signing up you'll join a diverse group of community researchers and tap into a lot of grassroots expertise.
 photos?
Best regards
LaPa
[](//i.publiclab.org/system/images/photos/000/015/543/original/Screen_Shot_04-14-16_at_11.55_PM.PNG)
){kind=link}
 unluckily I don't have access to a spectrometer
2) wich are the companies where I can buy a cheap Calibration targets?
3) may it be fine to use, for my goals, the normal corrugated brown cardboard like one in this image as calibration target?
4) If my corrugated brown cardboard is ok, I can put it in greenhouse and begin to shoot photos with the calibration target inside the images.
5) Do you think the NoIR Pi camera + red filter would be better instead of NoIR Pi camera + blue filter (Rosco # 2008) I use now?
Thank you
LaPa
[](//i.publiclab.org/system/images/photos/000/015/583/original/CorrugatedBrownCardboardInSunnyLight.jpg)
){kind=link}
,
5. were available from a national or global distributor (Home Depot?),
6. included very light gray, medium gray, and dark gray.
Colored paints have very interesting reflectivity curves:
[](//i.publiclab.org/system/images/photos/000/015/615/original/paintspectra.JPG)
){kind=link}
26 Comments
Hi LaPa,
Your time-lapse videos are impressive. These are excellent teaching videos. You can clearly see that the NDVI values for the foliage of the plants changes dramatically through the day. It is likely that these changes are not due to physiological changes in the plant (stress, growth, productivity), but instead to changes in the ambient light and/or camera settings. There are probably also changes in the plant health during these periods of time, but they are too subtle to see. These changes in plant health might produce a change in NDVI of maybe 0.05 or 0.1 or so if the plant was stressed by heat or drought. The color gradients you used have approximately the same color for NDVI values of (e.g.) 0.4 and 0.45, so the color of a plant leaf might not change much if it was actually stressed.
To allow a video like these to show plant stress, a few things must happen:
There are not enough colors to differentiate all the NDVI values between 0.2 and 0.8 with enough resolution to detect small changes in plant health. So a special lut could be used to differentiate changes in NDVI between (e.g.) 0.5 and 0.3 using all the obvious colors.
Chris
Reply to this comment...
Log in to comment
Hi @LaPa, great to see your note! I'm tagging some other raspberry pi developers @rjstatic and @seankmcginnis
Reply to this comment...
Log in to comment