WO2016040316A1 - System and method for calibrating imaging measurements taken from aerial vehicles - Google Patents

System and method for calibrating imaging measurements taken from aerial vehicles Download PDF

Info

Publication number
WO2016040316A1
WO2016040316A1 PCT/US2015/048928 US2015048928W WO2016040316A1 WO 2016040316 A1 WO2016040316 A1 WO 2016040316A1 US 2015048928 W US2015048928 W US 2015048928W WO 2016040316 A1 WO2016040316 A1 WO 2016040316A1
Authority
WO
WIPO (PCT)
Prior art keywords
spectral
measurements
target
ambient light
frequency ranges
Prior art date
Application number
PCT/US2015/048928
Other languages
French (fr)
Inventor
Michael Ritter
Michael Milton
Original Assignee
SlantRange, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SlantRange, Inc. filed Critical SlantRange, Inc.
Priority to ES15839458T priority Critical patent/ES2886556T3/en
Priority to AU2015315327A priority patent/AU2015315327B2/en
Priority to CA2960375A priority patent/CA2960375C/en
Priority to EP15839458.5A priority patent/EP3192260B1/en
Publication of WO2016040316A1 publication Critical patent/WO2016040316A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0297Constructional arrangements for removing other types of optical noise or for performing calibration
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/42Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/4204Photometry, e.g. photographic exposure meter using electric radiation detectors with determination of ambient light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/42Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/44Electric circuits
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2823Imaging spectrometer
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/02Details
    • G01J1/04Optical or mechanical part supplementary adjustable parts
    • G01J1/0407Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
    • G01J1/0433Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings using notch filters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00Photometry, e.g. photographic exposure meter
    • G01J1/02Details
    • G01J1/04Optical or mechanical part supplementary adjustable parts
    • G01J1/0407Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
    • G01J1/0474Diffusers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2823Imaging spectrometer
    • G01J2003/2826Multispectral imaging, e.g. filter imaging

Definitions

  • This disclosure relates to systems and methods for obtaining calibrated images of a target area, and specifically relates to obtaining calibrated images of a target area taken from aerial vehicles.
  • the spectral content of electromagnetic waves reflected off of, or emitted from, a target provides information about the properties of that target.
  • the spectral content of the electromagnetic waves reflected off of, or emitted from, a target provides information about the chemical composition of the target. Based on the information provided by the reflected and/or emitted electromagnetic waves, the target can be classified. For example, the target's composition may be determined. In cases where the target is vegetation, it may be possible to determine a condition of the vegetation.
  • Multi-spectral imaging (MSI) and hyperspectral imaging (HSI) systems which are capable of capturing incident light as a function of spectral wavelength, may be used to collect such information about a target for a large variety of applications.
  • the electromagnetic waves that are reflected off of a target are from a light source. Therefore, the spectral content of the electromagnetic waves reflected off of a target will also be a product of the electromagnetic waves provided by the light source. Different light sources and different conditions affecting a light source will cause the spectral content of the electromagnetic waves from the light source to differ. Therefore, it is necessary to provide systems and methods to calibrate the spectral content measurements captured of the target.
  • Calibration systems have been used whereby the target is illuminated by an artificial light source having a known spectral content.
  • Calibration systems have been used whereby a target calibration panel having a known spectral reflectance has been placed in the field of view of the target spectral measurement devices and used to calibrate the target spectral measurements.
  • Calibration systems have also been used which measure the spectral content of the light sources directly.
  • Prior methods and systems for calibrating spectral images of targets are especially impractical for use in small aerial vehicles. Existing methods either require logistically impractical steps for inserting known reflectance objects within the target scene, or require on-board sensing systems which are impractical for use on very small aircraft with extreme weight and power constraints.
  • This disclosure relates to obtaining calibrated images of a target area, and specifically obtaining calibrated images of a target area obtained using airborne vehicles. Spectral measurements of a target and/or target area may be calibrated by direct spectral measurements of the ambient light source(s). The calibration may be performed by obtaining spectral measurements of one or more ambient light sources across discrete spectral frequency ranges with photo sensors having extremely low size, weight, and power.
  • the spectral frequency ranges of the spectral measurements of the ambient light source may correlate with the spectral measurements of the target(s) and/or target area(s).
  • Such systems and methods provide an advantage over the prior art because they are lightweight, have reduced power requirements, and provide a calibration correction for each spectral image that accounts for changes in ambient illumination conditions that vary from sample to sample..
  • Spectral measurements may include intensity measurements, luminosity measurements, luminous flux measurements, luminous power measurements, wavelength measurements, frequency measurements, brightness, and/or other measurements of electromagnetic waves.
  • the system may comprise an aerial vehicle.
  • the aerial vehicle may be a manned or unmanned aerial vehicle.
  • the aerial vehicle may be an unmanned aerial system, a remotely piloted aircraft, and/or other aerial vehicle.
  • the aerial vehicle may have a propulsion type being one or more of vertical rotor, horizontal rotor, jet propelled, and/or other propulsion type.
  • the aerial vehicle may be a passive aerial vehicle having no active propulsion type.
  • the aerial vehicle may be a balloon, glider, or other vehicle.
  • the system may comprise at least one spectral imaging device.
  • the at least one spectral imaging device may be configured to obtain spectral measurements of a target.
  • the target may be at least partially illuminated by one or more ambient light sources.
  • the ambient light sources may be one or more of the sun, reflected light from the moon, star light, artificial light, natural light, and/or other light sources.
  • the spectral imaging device may be configured to obtain spectral measurements of the target in discrete frequency ranges.
  • the spectral imaging device may be configured to obtain spectral measurements of the target across a continuous frequency range.
  • the continuous frequency range may span across one or more selected discrete frequency ranges.
  • the one or more discrete frequency ranges may be selected based on a desired information type.
  • the spectral measurements of the target may comprise a first set of spectral measurements of the target.
  • the first set of spectral measurements of the target may comprise spectral measurements of the target taken across one or more discrete frequency ranges.
  • the spectral imaging device may be configured to obtain measurements of the target over spectral frequency ranges spanning across the ultraviolet, visible, near infrared, and infrared regions of the electromagnetic spectrum.
  • the target may be a single target, multiple targets, a target area or target areas, and/or any other target.
  • the system may comprise one or more photo sensors.
  • the one or more photo sensors may be configured to obtain spectral measurements of the one or more ambient light sources.
  • the one or more photo sensors may have peak responses approximate to a first set of discrete spectral frequency ranges.
  • the one or more photo sensors may be configured to obtain spectral measurements of the one or more ambient light sources at individual ones of the first set of discrete spectral frequency ranges.
  • Individual ones of the one or more photo sensors may have a peak response range approximate to individual ones of the first set of spectral frequency ranges.
  • the one or more photo sensors may comprise a first photo sensor.
  • the first set of spectral frequency ranges may comprise a first spectral frequency range.
  • the first photo sensor may have a peak response approximate to a first spectral frequency range.
  • the first photo sensor may be configured to obtain a first spectral measurement of the one or more ambient light sources over the first spectral frequency range.
  • the sets of spectral frequency ranges may include any number of frequency ranges. Individual ones of the spectral frequency ranges may overlap.
  • the first set of spectral frequency ranges may include: a first discrete frequency range, a second discrete frequency range, a third discrete frequency range, a fourth discrete frequency range, a fifth discrete frequency range, and other discrete frequency ranges.
  • the photo sensors may be configured to obtain spectral frequency measurements of the one or more ambient light sources and may include a first photo sensor having a peak response range approximate to a first spectral frequency range, a second photo sensor having a peak response range approximate to a second spectral frequency range, a third photo sensor having a peak response range approximate to a third spectral frequency range, a fourth photo sensor having a peak response range approximate to a fourth spectral frequency range, a fifth photo sensor having a peak response range approximate to a fifth spectral frequency range, and one or more other photo sensors having peak response ranges approximate one or more other spectral frequency ranges.
  • the photo sensors may be one or more of light-emitting diodes (LEDs), photodiodes, and/or other sensor.
  • the photo sensors may comprise one or more light-diffusing elements configured to integrate downwelling illumination from the one or more ambient light sources.
  • One or more electrical amplifiers may be
  • the one or more amplifiers may be configured to amplify the measurements obtained by the photo sensors.
  • the circuit may comprise a conversion circuit.
  • the conversion circuit may be employed, wherein the amplifier(s) may be configured to convert the photo sensors' output current to an output voltage.
  • the circuit may comprise an analog-to-digital converter configured to convert the voltage signal into a digital value for individual images collected by the spectral imaging devices.
  • the obtained spectral measurements of the one or more ambient light sources may be used to calibrate the obtained spectral measurements of the target.
  • the first set of target spectral measurements may be calibrated based on the first set of ambient light spectral measurements.
  • the system may be configured to determine a first set of calibration values for the first set of target spectral measurements.
  • the first set of calibration values may be based on the first set of ambient light spectral measurements.
  • the system may be configured to scale the first set of target spectral measurements based on the determined first set of calibration values.
  • the spectral measurements of the target may include measurements spanning over the first set of discrete frequency ranges.
  • the one or more photo sensors may have peak response frequency ranges approximate to the discrete frequency ranges included in the spectral measurements of the target.
  • the system may comprise one or more processors configured by machine- readable instructions to carry out one or more functions.
  • the one or more functions are herein described in relation to computer program components.
  • the computer-readable instructions may or may not be created in discrete components corresponding to the one or more functions.
  • the computer-readable instructions herein described may include computer-readable instructions created in one or more sets of programming code, in one or more separate computer programs, performed on one or more computing devices, and/or created in other forms.
  • the one or more processors may be configured by machine-readable instructions to perform the operations of a time component and/or other components.
  • the time component may be separate from the other components.
  • the time component may comprise individual time components for each sensor.
  • the time component may be configured to obtain time data and/or information associated with the obtained measurements. For example, a first set of time data may be obtained for the first set of measurements of the target.
  • the time component may be configured to obtain time data associated with the obtained spectral measurements of the one or more ambient light sources.
  • a first set of time data may be obtained for the first set of ambient light spectral measurements.
  • the first set of time data obtained for the first set of ambient light spectral measurements may be the same as the first set of time data obtained for the first set of target spectral measurements.
  • the system may comprise one or more electronic data storage mediums configured to receive the obtained spectral measurements of the target and the obtained spectral measurements of the one or more ambient light sources, such that the electronic data storage mediums are configured to receive the first set of measurements of the target, the first set of ambient light spectral measurements, and/or other measurements.
  • the one or more electronic data storage mediums may be mounted to the aerial vehicle and may be in electronic communication with the spectral imaging device(s), the photo sensor(s) and/or other sensors and/or elements.
  • the system may comprise one or more thermometers configured to measure the temperature of the spectral imaging devices(s), the photo sensors, and/or other sensors and/or elements.
  • the electronic storage medium(s) may be in electronic communication with the thermometer(s) and may be configured to receive
  • the data associated with the temperature information, spectral measurements of the target, spectral measurements of the one or more ambient light sources and/or other obtained information may be stored on the electronic storage medium(s) together with the associated time information of the measurements and/or the obtained information.
  • the system may comprise an attitude component.
  • the attitude component may be configured to obtain an attitude of the spectral imaging devices(s), the one or more photo sensors, and/or other sensors and/or elements.
  • the system may comprise a position sensor.
  • the position sensor may be configured to obtain position information of the system.
  • the position sensor may be configured to obtain position information of individual ones of the one or more sensors and/or elements.
  • the time component may be configured to obtain time information associated with the one or more target spectral measurements, the ambient light spectral measurements, the one or more temperature measurements, the one or more attitude measurements, the one or more position measurements, and/or other measurements.
  • the first set of target spectral measurements, the first set of ambient light spectral measurements, the first set of temperature measurements, the first set of attitude measurements, the first set of location measurements, and/or other measurements may be obtained concurrently, or near concurrently, and may be collectively referred to as the first set of measurements.
  • the time component may be configured to obtain a first set of time information associated with the first set of measurements.
  • the at least one spectral imaging device may be configured to obtain a first set of spectral measurements of the target across the first set of spectral frequency ranges at a first time.
  • the at least one spectral imaging device may be configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time.
  • the one or more photo sensors may be configured to obtain a first set of spectral measurements of the one or more ambient light sources across the first set of spectral frequency ranges at the first time.
  • the one or more photo sensors may be configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at the second time.
  • the first set of spectral measurements of the target may be calibrated based on the first set of spectral measurements of the ambient light source(s).
  • the second set of spectral measurements of the target may be calibrated based on the second set of spectral measurements of the ambient light source(s).
  • the system may comprise an environmental parameter component.
  • the environmental parameter component may be configured to obtain environmental parameter information.
  • the environmental parameter information may be associated with the spectral measurements of the target and/or the spectral measurements of the ambient light source(s).
  • the spectral measurements of the target may be calibrated using the obtained environmental parameter information.
  • the obtained environmental parameter information may be correlated with the first set of measurements based on the time information.
  • the method may comprise the steps of obtaining spectral measurements of a target.
  • the target may be at least partially illuminated by one or more ambient light sources.
  • the method may comprise obtaining spectral measurements of the one or more ambient light sources across a first set of discrete spectral frequency ranges.
  • the spectral measurements across the first set of discrete spectral frequency ranges may include a first spectral measurement of the one or more ambient light sources over a first spectral frequency range.
  • the obtained spectral measurements of the one or more ambient light sources may be used to calibrate the obtained spectral measurements of the target.
  • the first set of spectral measurements of the target may be calibrated based on the first set of spectral measurement of the one or more ambient light sources.
  • the method may comprise obtaining target spectral measurement data associated with one or more targets.
  • the target spectral measurement data may have been obtained using an aerial vehicle.
  • the method may comprise obtaining ambient light spectral measurement data associated with one or more ambient light sources.
  • the ambient light spectral measurement data may have been obtained using an aerial vehicle.
  • the target spectral measurements, the ambient light spectral measurements, and/or other measurements may be taken by the same or different aerial vehicles.
  • the method may comprise determining sets of calibration values for the obtained target spectral measurement data.
  • the determination of the calibration values may be based on the obtained ambient light spectral measurement data.
  • the method may comprise scaling the obtained target spectral measurement data with the determined sets of calibration values. Scaling the obtained target spectral measurement data may provide calibrated spectral measurements of the one or more targets.
  • the obtained target spectral measurement data may comprise spectral measurement data associated with a first set of spectral frequency ranges.
  • the obtained ambient light spectral measurement data may comprise spectral measurement data associated with the first set of spectral frequency ranges.
  • the step of determining the sets of calibration values for the obtained target spectral measurement data may comprise determining individual ones of the sets of calibration values based on the spectral measurement data associated with individual ones of the first set of spectral frequency ranges.
  • the target spectral measurement data and the ambient light spectral measurement data may be obtained by a server.
  • the server may be in electronic communication with the sensors that obtained the data.
  • the server may be in electronic communication with storage devices used to store the data obtained from the sensors.
  • the server may be physically remote from the sensors and/or electronic storage device.
  • the data may be obtained by a client-computing device associated with an operator of an aerial vehicle from which the data has been obtained.
  • the data may be processed by the server, the client computing device, and/or other devices.
  • the system may comprise one or more data connections configured to electronically connect to one or more electronic data storage mediums on an aerial vehicle.
  • the one or more data connections may be wired and/or wireless connections.
  • the one or more data connections may be direct or indirect.
  • the data connection(s) may be configured to continuously provide data from the electronic storage mediums and/or the sensors on the aerial vehicle.
  • the data connection(s) may be configured to periodically provide data from the electronic storage mediums and/or the sensors on the aerial vehicle.
  • the data connection(s) may be configured to provide data from the electronic storage mediums and/or the sensors on the aerial vehicle when connected to devices configured to retrieve the data, wherein the devices download all, substantially all, or select portions of the data.
  • the data may be transferred to one or more other electronic storage devices prior to processing.
  • the electronic data storage medium(s) may be configured to store spectral measurements of a target taken from an aerial vehicle.
  • the electronic storage medium(s) may be configured to store spectral measurements of one or more ambient light sources.
  • the system may comprise one or more physical computer processors configured by machine-readable instructions to perform the functions of one or more computer components.
  • the one or more computer components may comprise a calibration component, an environmental parameter component, and/or a theoretical model component.
  • the calibration component may be configured to determine sets of calibration values for the spectral measurements of the target.
  • the sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources and/or other sources.
  • the environmental parameter component may be configured to obtain sets of environmental parameters associated with the spectral measurements of the target.
  • the environmental parameter component may be configured to obtain sets of environmental parameters associated with the spectral measurements of the one or more ambient light sources.
  • the environmental parameters may include temperature measurements of and/or adjacent to the multiple photo sensors configured to obtain spectral measurements of the one or more ambient light sources.
  • the environmental parameters may include temperature measurements of and/or adjacent to the spectral imaging device configured to obtain spectral measurements of the one or more targets. Temperature measurements of the photo sensors may be obtained to correct for thermal responsivity effects of the photo sensors.
  • the environmental parameters may include one or more of the
  • the environmental parameters may include one or more of the time of year the measurements were taken, the time of day the measurements were taken, the atmospheric properties at the time the measurements were taken, and/or other environmental parameters.
  • the theoretical model component may be configured to determine a theoretical irradiance model for the target based on the obtained sets of
  • the theoretical model component may be configured to determine the theoretical irradiance model for the target based on an atmospheric transmission model.
  • the calibration component may be configured to determine sets of calibration values for the spectral measurements of the target.
  • the sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources.
  • the sets of calibration values may be determined based on the theoretical irradiance model for the target.
  • the calibration component may be configured to determine a calibration value for the spectral measurements of the target. For example, where the spectral imaging devices are configured to obtain spectral measurements of a target, a calibration value may be determined for the spectral frequency ranges and/or spectral bands in which the spectral measurements were taken. Individual calibration values may be determined for the individual spectral frequency ranges and/or spectral bands. A calibration value may be determined for, and may be applicable to, multiple spectral frequency ranges and/or spectral bands.
  • the calibration component may be configured to scale the spectral measurements of the target with the determined sets of calibration values. Scaling the spectral measurements of the target with the determined sets of calibration values may provide spectral measurements of the target that is independent, or nearly independent, of ambient light illumination conditions.
  • FIG. 1 illustrates a system for obtaining calibrated spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations
  • FIGs. 2A and 2B provide simplistic illustrations of examples of the spectral measurement curves of the spectral imaging device(s) and the photo sensor(s), in accordance with one or more implementations;
  • FIG. 3 illustrates a schematic view of a circuit used in calibrating spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations
  • FIG. 4 illustrates a schematic view of a circuit used in calibrating spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations;
  • FIG. 5 illustrates a system for obtaining calibrated spectral measurements of a target, in accordance with one or more implementations
  • FIG. 6 illustrates a method for obtaining calibrated spectral measurements of a target, in accordance with one or more implementations
  • FIG. 7 illustrates a method for calibrating spectral measurements of a target, in accordance with one or more implementations.
  • FIG. 8 illustrates a method for analyzing data of spectral measurements, in accordance with one or more implementations.
  • Prior methods and systems of calibrating spectral images of targets are especially impractical for use in small aerial vehicles. Existing methods either require logistically impractical steps for inserting known reflectance objects within the target scene, or require on-board sensing systems which are impractical for use on very small aircraft with extreme weight and power constraints.
  • This disclosure relates to obtaining calibrated spectral images of target(s) and/or target area(s) using spectral measurements obtained from aerial vehicles.
  • the systems and methods may include calibrating spectral images of target(s) using measurements of the spectral characteristics of the incident illumination within discrete and/or narrow spectral bands that may be selected to match the bands of the spectral imager.
  • the measurements of the spectral characteristics of incident illumination may be synchronized to the spectral measurements of the target(s).
  • Such systems and methods provide an advantage over the prior art because they are lightweight, have reduced power requirements, and provide a calibration correction for each spectral image that accounts for changes in ambient illumination conditions that vary from sample to sample.
  • FIG. 1 illustrates a system 100 for obtaining calibrated spectral images of a target 102.
  • the target 102 may be illuminated by one or more ambient light sources 107.
  • the target 102 may be an individual target, a group of targets, an area, and/or any desired target.
  • the system 100 may be configured to obtain calibrated spectral images of a target, wherein the spectral images are obtained using an aerial vehicle 106.
  • the aerial vehicle shown in FIG. 1 is an unmanned vehicle, or a remotely piloted vehicle. However, the aerial vehicle 106 may be any type of aerial vehicle, including piloted and non-piloted aerial vehicles.
  • the aerial vehicle 106 may be an autonomous aerial vehicle capable of flying missions without continuous or periodic intervention by a pilot, whether directly or remotely.
  • the aerial vehicle may be a helicopter, quadcopter, hexacopter, octocopter, an aerial vehicle having horizontal, or near horizontal, propellers, an aerial vehicle having vertical, or near vertical, propellers, an aerial vehicle having jet propulsion, a plane, a satellite, a balloon, a flying ship, or any other type of aerial vehicle capable of facilitating the obtaining of spectral images of a target from an elevated position.
  • spectral images may include spectral measurements and/or other ways of obtaining spectral information of a target(s).
  • Spectral measurements may include intensity measurements, luminosity measurements, luminous flux measurements, luminous power measurements, wavelength measurements, frequency measurements, brightness, other
  • the aerial vehicle 106 may be capable of carrying, and/or being configured to carry, at least one spectral imaging device 108.
  • the aerial vehicle 106 may be capable of carrying, and/or being configured to carry, one or more photo sensors 1 10.
  • the spectral imaging device 1 08 may be configured to obtain spectral images and/or measurements of a target 102.
  • the spectral imaging device 108 may be one or more of a multispectral or hyperspectral still image or video camera, an array of charge-coupled devices or complimentary metal oxide semiconductors, LEDs, photo sensors, and/or other image and/or spectral measuring devices.
  • the target 1 02 may be illuminated by one or more ambient light sources 1 07.
  • the ambient light sources 107 may be direct and/or indirect light sources.
  • the ambient light sources 107 may be one or more of the sun (as shown in FIG. 1 ), the moon, starlight, artificial light, natural light, any combination of reflected and/or transmitted light sources, and/or other light sources.
  • the spectral imaging device 108 may be configured to obtain signals reflected and/or emitted from the target at a set of predefined spectral bands and/or spectral frequency ranges.
  • the predefined spectral bands and/or spectral frequency ranges may be across one or more of the ultraviolet, the visible, the near-infrared, and/or the infrared regions of the electromagnetic spectrum.
  • the photo sensors may be configured to obtain spectral measurements of characteristics of the electromagnetic radiation from one or more ambient light sources 107.
  • the one or more ambient light sources 107 may provide illumination and/or part of the illumination of the one or more targets 102.
  • the photo sensors 1 10 may be configured to obtain spectral measurements of the ambient light source(s) 107 in the same frequency bands as obtained for the target 102 by the spectral imaging device 1 08.
  • the photo sensors 1 10 may be mounted to the aerial vehicle 106.
  • the mount 130 may be configured to facilitate orientation of the photo sensors 1 10.
  • the photo sensors 1 10 may be oriented in a desired manner. For example, the photo sensors
  • the photo sensors 1 10 may be oriented toward the one or more ambient light sources 107.
  • the photo sensors may be oriented at a desired angle relative to the target(s) 102.
  • the photo sensors may be oriented individually, as groups of photo sensors, or as a combined whole.
  • Individual ones of the set of photo sensors 1 1 0 may have a peak response parameter range approximate to individual ones of the spectral bands and/or spectral frequency ranges of the spectral imaging device 108.
  • An example of such a spectral imaging device may be a multispectral imager.
  • the spectral imaging device 108 may comprise one or more sensors having a continuous spectral response across a range of spectral frequencies.
  • the spectral imaging device 108 (as shown in FIG. 1 ) may comprise one or more sensors wherein individual ones of the one or more sensors have a spectral response across subsets of discrete spectral frequency ranges within a wider spectral frequency range.
  • Individual ones of the set of photo sensors 1 10 may have a peak response parameter range at spectral positions selected at discrete bands spanning the continuous spectral response of the spectral imaging device 108, as shown in FIG. 2A.
  • An example of such a spectral imaging device 108 may be a hyperspectral imager.
  • the spectral imaging device 108 comprising one or more sensors wherein individual ones of the one or more sensors have a response range across a discrete subset of spectral frequency ranges within a wider range of spectral frequencies
  • individual ones of the photo sensors 1 10 may have a peak response parameter corresponding to the discrete subset of spectral frequency ranges of the spectral imaging device 108, as shown in FIG. 2B.
  • the multiple photo sensors 1 1 0 may comprise a first photo sensor 1 12 having a peak response parameter range approximate to a first spectral frequency range of the spectral imager 108.
  • the first photo sensor 1 12 may be configured to obtain a first spectral measurement of the ambient light sources 107 and/or other sources.
  • a second photo sensor 1 14 may be provided having a peak response parameter range approximate to a second spectral frequency range of the spectral imager 108.
  • the second photo sensor may be configured to obtain a second spectral measurement of the ambient light sources 1 07 and/or other sources.
  • the system may comprise multiple photo sensors, such as photo sensors 1 14, 1 16, 1 18, 1 20, and other photo sensors, configured to obtain spectral measurements in multiple different frequency ranges.
  • the individual photo sensors of the multiple photo sensors 1 10 may have different peak response ranges. Two or more of the individual photo sensors of the multiple photo sensors 1 10 may have the same and/or similar peak response ranges.
  • the multiple photo sensors 1 10 configured to obtain spectral measurements of the one or more ambient light sources 1 07 may include a third photo sensor 1 16 having a peak response parameter range approximate to a third spectral frequency range.
  • the third photo sensor 1 16 may be configured to obtain a third set of ambient light measurements.
  • the multiple photo sensors 1 1 0 may include a fourth photo sensor 1 18 having a peak response parameter range approximate to a fourth spectral frequency range.
  • the multiple photo sensors 1 1 0 may include a fifth photo sensor 120 having a peak response parameter range approximate to a fifth spectral frequency range.
  • the fourth and fifth photo sensors may be configured to obtain a fourth and fifth set of ambient light measurements.
  • the multiple photo sensors 1 1 0 may include multiple photo sensors having peak response parameter ranges approximate to multiple spectral frequency ranges. Individual ones of the multiple photo sensors may be configured to have a peak response parameter range approximate to individual ones of the multiple spectral frequency ranges of the spectral imaging device.
  • FIGs. 2A and 2B provide simplistic illustrations of examples of the spectral measurement curves of the spectral imaging device 108 and the one or more photo sensors 1 10.
  • FIG. 2A shows a first plot 200 of an example of a spectral
  • the spectral imaging device 108 may be configured to obtain spectral images and/or measurements of the target 102 over a continuous range of frequencies.
  • An example of such a spectral imaging device may be a hyperspectral imager.
  • the system 1 00 may comprise one or more photo sensors 1 1 0.
  • the photo sensors 1 10 may be configured to obtain a first set of measurements of the ambient light source 1 07.
  • the first set of measurements of the ambient light source 107 may comprise measurements of the ambient light source taken over a first frequency range and/or band.
  • the multiple photo sensors 1 10 may comprise one or more sensors having a peak response within a first spectral frequency range or band A. As shown in FIG. 2A, the one or more sensors having a peak response within a first spectral frequency range may have a peak response curve 204 across a first spectral frequency range or band A.
  • the first set of measurements of the ambient light source 1 07 may comprise measurements of the ambient light source taken over a second frequency range and/or band.
  • the multiple photo sensors 1 10 may comprise one or more sensors having a peak response within the second spectral frequency range and/or band B. As shown in FIG. 2A, the one or more sensors having a peak response within the second spectral frequency range may have a peak response curve 206 across a second spectral frequency range or band B.
  • the first set of measurements of the ambient light source 107 may comprise measurements of the ambient light source taken over a third, fourth, fifth, or more, spectral frequency ranges and/or bands, C, D, and E.
  • the multiple photo sensors 1 10 may comprise one or more sensors having peak responses within the third, fourth, fifth, or more, spectral frequency ranges and/or bands. As shown in FIG. 2A, the one or more sensors having a peak response within the third, fourth, fifth, or more, spectral frequency ranges and/or bands may have peak response curves 208, 210, 212, across the third, fourth, fifth, and more spectral frequency ranges and/or bands C, D, and E. (64) FIG.
  • FIG. 2B shows a second plot 200 of an example of spectral measurement curves for a spectral imaging device 1 08, wherein the spectral imaging device 108 is configured to obtain spectral images and/or measurements across discrete frequency ranges or bands.
  • a spectral imaging device 108 may be a multispectral imager.
  • the spectral images and/or measurements obtained of the target by the spectral imaging device 108 may comprise a first set of spectral measurements of the target taken over a first set spectral frequency ranges and/or bands. As shown in FIG.
  • the spectral imaging device 108 configured to obtain spectral measurements over one or more discrete frequency ranges and/or bands may comprise one or more sensors having a peak response over a first spectral frequency range and/or band A providing a first spectral curve 214.
  • the imaging device 108 configured to obtain spectral measurements over one or more discrete frequency ranges may comprise one or more sensors having a peak response over a second B, third C, fourth D, fifth E, and more spectral frequency ranges and/or bands, providing a second 21 6, third 218, fourth 220, fifth 222, and more, spectral curves.
  • the first set of images and/or measurements of the target 102 may provide information about the spectral irradiance and/or reflection of the target 102.
  • the spectral imaging device(s) 108 may be configured to obtain measurements over preselected spectral frequency ranges.
  • the spectral imaging device(s) 108 may comprise sensors dynamically configured to adjust their detecting frequency to obtain measurements over dynamically selected spectral frequency ranges.
  • the spectral frequency ranges selected for the multiple photo sensors may be selected based on parameters providing an indication of a type of information obtained from measurements over the selected frequency ranges.
  • the multiple photo sensors 1 10 may have peak spectral sensitivities in any number of spectral frequency ranges and/or spectral bands.
  • a matrix of multiple photo sensors may have peak sensitivity ranges in one, two, three, four, five, and more spectral frequency ranges or bands.
  • the width of the spectral frequency ranges and/or bands may be any size.
  • the spectral frequency ranges and/or bands may be limited to a single nanometer, or may be many nanometers.
  • the width of the spectral frequency ranges or bands may be selected to have a range indicative of providing a desired set of information or indicative of providing a desired outcome.
  • the multiple photo sensors 1 10 may be configured in an array. In some implementations, the multiple photo sensors 1 10 may be disposed in the system 100 individually. The system 100 may comprise a diffusing element 1 13 configured to reduce the directionality of the electromagnetic radiation received by the multiple photo sensors 1 10.
  • the multiple photo sensors 1 10 may be comprised of light-emitting diodes (LEDs) configured and operated as light collection sensors.
  • the LEDs may be configured such that individual ones of the LEDs are selected based on the LED's responsivity within individual ones of the predefined spectral bands.
  • FIG. 3 illustrates a schematic view of a circuit 300 used in obtaining calibrated spectral images and/or measurements of a target and/or target area illuminated by ambient light sources and/or other sources, in accordance with one or more implementations.
  • a circuit 300 may comprise a LED 302.
  • the LED 302 may comprise an anode 304 and a cathode 306.
  • the LED 302 may comprise a substrate 308, an n-layer 310, an active region 312, a p-layer 314, and one or more other elements.
  • the LED may comprise one or more light diffusing elements.
  • the light diffusing elements may be configured to integrate downwelling illumination from the one or more ambient light sources.
  • the circuit 300 may comprise a light diffusion optic 316 configured to cover one or more of the LEDs 302.
  • the circuit 300 may comprise an amplification circuit 31 8 comprising one or more electrical amplifiers 320.
  • the amplification circuit may be electronically connected to the LEDs 302.
  • the one or more amplifiers 320 may be configured to amplify the measurements obtained by the one or more LEDs 302.
  • the one or more electrical amplifiers 320 may amplify the first set of ambient light measurements and the second set of ambient light measurements obtained by the LEDs 302.
  • the circuit 300 may be configured such that the output at V ou t may be proportional to the incident photon flux within the LED's spectral band.
  • the circuit may comprise a conversion circuit which may be employed, wherein the LED current is converted to a voltage and amplified in proportion to the feedback resistance across the amplifier(s) 320.
  • the circuit 300 may comprise an analog-to-digital converter 322 configured to convert the voltage signal into a digital value for the measurements collected by the LEDs 302.
  • the multiple photo sensors 310 may be comprised of photodiodes.
  • FIG. 4 illustrates a schematic view of an assembly and circuit 400 used in obtaining calibrated spectral images and/or measurements of a target and/or target area illuminated by ambient light sources and/or other sources, in accordance with one or more implementations.
  • Individual ones of the photodiode assemblies 402 may comprise a bandpass light filter element 41 0.
  • the bandpass light filter element 410 of the individual photodiodes 402 may be selected based on its restriction of incident illumination to predefined and/or preselected spectral bands approximate to individual ones of the spectral imaging device's 408 spectral bands.
  • the photodiode(s) 402 may comprise one or more light diffusing elements 404.
  • the light diffusing elements 404 may be configured to integrate downwelling illumination from the one or more ambient light sources.
  • the circuit 400 may comprise a light diffusion optic 404 configured to cover one or more of the photodiodes 402.
  • the circuit 400 may comprise an amplification circuit 406 comprising one or more electrical amplifiers 408.
  • the amplification circuit may be electronically connected to the photodiodes 402.
  • the one or more amplifiers 408 may be configured to amplify the measurements obtained by the one or more photodiodes 402.
  • the one or more electrical amplifiers 402 may amplify the first set of ambient light measurements obtained by the photodiodes 402.
  • the circuit 400 may be configured such that the output at V ou t may be proportional to the incident photon flux within the spectral bandpass region of the bandpass light filter 410.
  • the circuit 400 may comprise a conversion circuit which may be employed, wherein the photodiode's output current is converted to a voltage and amplified in proportion to the feedback resistance across the amplifier(s)408.
  • the circuit 400 may comprise an analogue-to-digital converter 412 configured to convert the voltage signal into a digital value for the measurements collected by the photodiodes 402.
  • the obtained spectral measurements of the one or more ambient light sources 107 may be used to calibrate the obtained spectral measurements of the target 102.
  • the first set of measurements of the target 102 may be scaled based on a concurrently sampled, or near concurrently sampled, first set of ambient light spectral measurements.
  • the first set of measurements of the target 102 taken by the spectral imaging device 108 may comprise measurements taken over a first spectral frequency range or band.
  • the first set of measurements of the target 102 taken by the spectral imaging device 1 08 may comprise measurements taken over a second, third, fourth, fifth, and more, spectral frequency ranges or bands.
  • the obtained spectral measurements of the target may comprise a second set of spectral measurement of the target taken at a time different from the first set of spectral measurements of the target.
  • the second spectral measurement of the target may be scaled based on a concurrently sampled, or near concurrently sampled, second set of ambient light spectral measurements.
  • the system 1 00 may comprise a location sensor 1 25.
  • the location sensor 125 may be configured to obtain a position of the aerial vehicle, the spectral imaging device, and/or the multiple photo sensors.
  • the system 100 may comprise an altitude sensor 127.
  • the altitude sensor 127 may be configured to obtain an altitude of the aerial vehicle, the spectral imaging device, and/or the multiple photo sensors.
  • the system 100 may comprise one or more processors 122 configured by machine-readable instructions to carry out one or more functions.
  • the one or more functions are herein described in relation to computer program components.
  • the computer-readable instructions may or may not be created in discrete components corresponding to one or more functions.
  • the computer-readable instructions herein described may include computer-readable instructions created in one or more sets of programming code, in one or more separate computer programs, performed on one or more computing devices, and/or created in other forms.
  • the one or more processors 122 may be configured by machine-readable instructions to perform the operations of a time component 124 and/or other components.
  • the time component 124 may be configured to be independent of the one or more processors 122.
  • the time component 1 24 may be configured to obtain time data and/or information associated with the obtained measurements of the sensors.
  • the time component 124 may be configured to obtain time data and/or information associated with the obtained spectral measurements of the target 1 02.
  • the time component 124 may be configured to obtain time data and/or information associated with the obtained spectral measurements of the one or more ambient light sources 107.
  • the time component 124 may be configured to obtain time data and/or information associated with the obtained attitude measurements by the one or more attitude sensors 1 27.
  • the time component 124 may be configured to obtain time data and/or information associated with the obtained location information obtained by the one or more location sensors 125.
  • the measurements and/or observations obtained by the sensors may be taken concurrently, or nearly concurrently.
  • the time component 124 may be configured to facilitate recording the time at which the measurements and/or observations were obtained.
  • the time component 124 may be configured to record and/or store a single time measurement for all measurements obtained concurrently, or near concurrently, by the sensors.
  • the time component 124 may be configured to record and/or store time measurements for the individual measurements obtained concurrently by the individual sensors.
  • the multiple time measurements of the individual measurements may be the same time measurement, or may be individual time measurements representing the time at which the individual sensors obtained the measurement and/or observation.
  • a first set of time data may be obtained for the first set of spectral
  • the time component 124 may be configured to obtain time data associated with the obtained spectral measurements of the one or more ambient light sources 107.
  • the time component 124 may be configured to obtain time data associated with the one or more temperature readings obtained by the one or more thermometers 128.
  • the system 100 may comprise one or more temperature sensors 128 configured to measure one or more of the ambient temperature, the temperature of the multiple photo sensors 1 1 0, the temperature of the spectral imaging device(s) 108, the temperature of the location sensor(s) 125, the temperature of the altitude sensor(s) 125, and/or other temperature measurements.
  • the temperature may be taken of the elements of the system or adjacent to the elements of the system.
  • the system 100 may comprise one or more electronic data storage mediums 126.
  • the electronic storage mediums 126 may be configured to receive one or more of the obtained spectral measurements of the target 102 by the spectral imaging device 108, the obtained spectral measurements of the one or more ambient light sources 107 by the photo sensors 1 10, the position measurements, the attitude measurements, the temperature measurements, and/or other information, the ambient light sources, and/or other data.
  • the one or more electronic data storage mediums 126 may be mounted to the aerial vehicle 106 and may be in electronic communication with the spectral imaging device(s) 108, the photo sensor(s) 1 1 0, the processor 122, and/or the position, attitude, and temperature sensors.
  • the electronic storage mediums 126 may be a single electronic storage, or may be multiple electronic storage devices. For example, individual sensors may comprise their own electronic storage or the sensors may electronically connect, either wired or wirelessly, or otherwise, to shared electronic storage.
  • the electronic storage 126 may be in electronic communication with the thermometer(s) 128 and may be configured to receive temperature data associated with the multiple photo sensors 1 1 0 and/or spectral imaging device(s) 108.
  • the data associated with temperature information, spectral measurements of the target, and the spectral measurements of the ambient light source may be stored on the electronic storage 126 together with associated time information of the
  • Electronic storage 126 may comprise electronic storage media that electronically stores information.
  • the electronic storage media of electronic storage 126 may include one or both of system storage that is provided integrally (i.e., substantially non-removable) with aerial vehicle 1 06 and/or removable storage that is removably connectable to aerial vehicle 106 via, for example, a port (e.g., a USB port, a firewire port, etc.) or a drive (e.g., a disk drive, etc.).
  • a port e.g., a USB port, a firewire port, etc.
  • a drive e.g., a disk drive, etc.
  • Electronic storage 126 may include one or more optically readable storage media (e.g., optical disks, etc.), magnetically readable storage media (e.g., magnetic tape, magnetic hard drive, floppy drive, etc.), electrical charge-based storage media (e.g., EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive, etc.), and/or other electronically readable storage media.
  • the electronic storage 126 may include one or more virtual storage resources (e.g., cloud storage, a virtual private network, and/or other virtual storage resources).
  • Electronic storage 1 26 may store software algorithms, information determined by processor 122, information received from sensors, and/or other information that enables system 100 to function as described herein.
  • the system 100 may comprise at least one mounting device 130 configured to mount the photo sensors 1 10 to an aerial vehicle 106.
  • the mounting device 130 may be configured to orient at least one set of photo sensors 1 10 such that the photo sensors 1 10 may obtain spectral measurements of the one or more ambient light sources 107.
  • the mounting device 1 30 may be manually configured such that the photo sensors 1 10 may be orientated to obtain spectral measurements of the ambient light source(s).
  • the ambient light source may be a naturally occurring light source, such as the Sun.
  • the mounting device 130 may be manually set, such that the photo sensors 1 10 are orientated to obtain spectral measurements of the ambient light source(s).
  • the system 100 may comprise a mounting angle sensor configured to obtain measurements of the angle at which the photo sensors 1 10 are positioned with respect to the incident light from the ambient light source(s) 107.
  • the relationship between the intensity of the spectral measurement and the angle of incidence between the ambient light source(s) 107 and the photo sensor(s) 1 1 0 can be obtained.
  • the relationship may be stored.
  • the photo sensor(s) 1 10 may be rigidly mounted to the aircraft.
  • the attitude sensor 1 27 may be configured to facilitate determination of the attitude of the photo sensor(s) 1 10 with respect to a frame of reference.
  • One such frame of reference may be the Earth.
  • the obtained attitude of the photo sensor(s) may be recorded concurrently, or near concurrently, with the spectral measurement(s) of the ambient light source(s) 107 and/or target(s) 1 02.
  • the time and geo-location information may be obtained concurrently with the one or more spectral measurement(s) of the ambient light source(s) 1 07 and/or target(s) 102.
  • the obtained time and geo-location information may facilitate determination of the solar elevation and azimuth angles.
  • the angle of incidence of the light source relative to the sensor may be determined based on the obtained attitude information, the sensor(s) 1 10, and/or the determined solar angles. The angle of incidence along with the determined relationship between the angle of incidence and the
  • FIG. 5 illustrates a system for obtaining calibrated spectral images and/or measurements of a target, in accordance with one or more implementations.
  • the system 500 may comprise one or more data connections 502 configured to electronically connect to one or more electronic data storage mediums 504 and/or one or more sensors 508, on an aerial vehicle 506.
  • the one or more data connections 502 may be wired and/or wireless connections.
  • the data connection(s) 502 may be configured to continuously provide data from the electronic storage mediums and/or the sensors on the aerial vehicle 506.
  • the data connection(s) 502 may be configured to periodically provide data from the electronic storage 504 and/or the sensors 508 on the aerial vehicle 506.
  • the data connection(s) 502 may be configured to provide data from the electronic storage 504 and/or the sensors on the aerial vehicle 506 when connected to devices configured to retrieve the data, wherein the devices download all, substantially all, or select portions, of the data.
  • the electronic data storage 504 may be configured to store spectral measurements of a target taken from an aerial vehicle 506.
  • the electronic storage 504 may be configured to store spectral measurements of one or more ambient light sources.
  • the system 500 may comprise one or more physical computer processors 510 configured by machine-readable instructions to perform the functions of one or more computer components.
  • the one or more computer components may comprise a calibration component 51 2, an environmental component 514, a theoretical model component 516, an output component 518, and/or other components.
  • the processor 510 may provide processing capabilities to the system 500.
  • the processor 510 may include one or more of a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information.
  • processor 510 is shown in FIG. 5 as a single entity, this is for illustrative purposes only. In some implementations, processor 510 may include a plurality of processing units. These processing units may be physically located within the same device, or processor 510 may represent processing functionality of a plurality of devices operating in coordination.
  • the processor 510 may be configured to execute components 512, 514, 516, 518, and/or other components. Processor 510 may be configured to execute components 512, 514, 516, 51 8, and/or other components by software; hardware; firmware; some combination of software, hardware, and/or firmware; and/or other mechanisms for configuring processing capabilities on processor 510.
  • components 512, 514, 516, and 51 8 are illustrated in FIG. 5 as being co-located within a single processing unit, in implementations in which processor 510 includes multiple processing units, one or more of components 512, 514, 51 6, 51 8, and/or other components may be located remotely from the other components.
  • the description of the functionality provided by the different components 512, 514, 516, 51 8, and/or other components described below is for illustrative purposes, and is not intended to be limiting, as any of components 512, 514, 51 6, 518, and/or other components may provide more or less functionality than is described.
  • processor 510 may be configured to execute one or more additional modules that may perform some or all of the functionality attributed below to one of modules 512, 514, 516, 518, and/or other components.
  • the calibration component 512 may be configured to determine sets of calibration values for the spectral measurements of the target.
  • the sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources.
  • the environmental component 514 may be configured to obtain sets of environmental parameters associated with the spectral measurements of the target and the spectral measurements of the one or more ambient light sources.
  • the environmental parameters may include temperature measurements of and/or adjacent to the multiple photo sensors configured to obtain spectral measurements of the one or more ambient light sources. Temperature measurements of the photo sensors may be obtained to correct for thermal responsivity effects of the photo sensors. The temperature measurements may be obtained by one or more sensors 508 on the aerial vehicle 506.
  • the environmental parameters may include one or more of the geographical location, the altitude, the transmission properties of the optics, the responsivity properties of the photo sensors, and/or other environmental parameters.
  • the environmental parameters may include one or more of the time of year the measurements were taken, the time of day the measurements were taken, the atmospheric properties at the time the measurements were taken, and/or other environmental parameters.
  • the environmental parameter information may be obtained from one or more sensors 508.
  • the sensors may be mounted on the aerial vehicle 506.
  • the sensors may be external to the aerial vehicle 506.
  • the sensors may be on the ground, on other aerial vehicles, and/or in locations remote from where the measurements are being taken.
  • the environmental parameter information may be obtained from external resources 520.
  • External resources 520 may be one or more local sensors 508.
  • External resources 520 may be information entered into the system by a user.
  • the external resources 520 may be databases in electronic communication with the system 500.
  • the external resources may be national weather service information, atmospheric information, and/or other information available from external sources.
  • the theoretical model component 516 may be configured to determine a theoretical irradiance model for the target based on the obtained sets of
  • the theoretical model component 516 may be configured to determine the theoretical irradiance model for the target based on an atmospheric transmission model.
  • the calibration value component 512 may be configured to determine sets of calibration values for the spectral measurements of the target.
  • the sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources and the theoretical irradiance model for the target, which itself is based on the obtained environmental parameters associated with the measurements.
  • the calibration value component 512 may be configured to determine a calibration value for individual ones of the spectral measurements of the target. For example, where the spectral imaging devices are configured to obtain spectral measurements of a target in a first set of spectral frequency ranges and/or bands, a calibration value may be determined for individual ones of the spectral frequency ranges and/or bands in the first set of spectral frequency ranges and/or bands.
  • the calibration value component 512 may be configured to scale the spectral measurements of the target with the determined sets of calibration values. Scaling the spectral measurements of the target with the determined sets of calibration values may provide spectral measurements of the target that are independent, or nearly independent, of ambient light illumination conditions.
  • the output component 51 8 may be configured to provide one or more outputs of data comprising the scaled spectral measurements of the target.
  • the outputted data may be used to deduce and/or obtain information about the target.
  • the one or more electronic data connections 502 may be configured to obtain time data from the electronic storage 504.
  • the time data may be associated with the spectral measurements of the target and the spectral measurements of the one or more ambient light sources.
  • FIG. 6 illustrates a method 600 for calibrating spectral measurements of a target, in accordance with one or more implementations.
  • FIG. 7 illustrates a method 700 for calibrating spectral measurements of a target, in accordance with one or more implementations.
  • FIG. 8, illustrates a method 800 for calibrating obtained spectral measurement data, in accordance with one or more implementations.
  • the operations of methods 600, 700, and 800 presented below are intended to be illustrative. In some embodiments, methods 600, 700, and 800 may be
  • methods 600, 700, and 800 may be implemented in one or more processing devices (e.g., a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information).
  • the one or more processing devices may include one or more devices executing some or all of the operations of methods 600, 700, and 800 in response to instructions stored electronically on an electronic storage medium.
  • the one or more processing devices may include one or more devices configured through hardware, firmware, and/or software to be specifically designed for execution of one or more of the operations of methods 600, 700, and 800.
  • methods 600, 700, and 800 may be implemented in combinations of one or more processing devices, machines, human interaction, and/or by other elements capable of carrying out the operations of methods 600, 700, and 800.
  • spectral measurements of a target from an aerial vehicle may be obtained.
  • the target may be vegetation, infrastructure, water, land, and/or any target of which it is desirous to obtain spectral measurements.
  • the target may be illuminated by one or more ambient light sources.
  • the spectral measurements may include a first set of measurements of the target.
  • the first set of measurements of the target may include a spectral measurement of the target taken at a first spectral frequency range.
  • the first set of measurements of the target may include a spectral measurement of the target taken at a second, third, fourth, fifth, or more, spectral frequency ranges.
  • the method may comprise obtaining spectral
  • the individual ones of the spectral measurements of the ambient light source(s) may have a peak response parameter range approximate to the frequency ranges of individual ones of the first set of spectral frequency ranges.
  • a first spectral measurement of the ambient light source(s) may have a peak response parameter range approximate to the first spectral frequency range of the first set of spectral measurements of the target.
  • a second spectral measurement of the ambient light source(s) may have a peak response parameter range approximate to the second spectral frequency range of the first set of spectral measurements of the target.
  • the obtained spectral measurements of the one or more ambient light sources may be used during calibration of the obtained spectral measurements of the target, such that the first set of measurements of the target are scaled based on the first spectral measurement of the ambient light source(s) and the second spectral measurement of the ambient light source(s).
  • the obtained spectral measurements of the target and the obtained spectral measurements of the one or more ambient light sources may be received into electronic storage, such that the electronic storage receives the first set of measurements of the target and the first set of measurements of the ambient light source.
  • time data associated with the obtained spectral measurements of the target and/or the ambient light source (s) may be obtained.
  • a first set of time data may be obtained for the first set of
  • time data associated with the obtained measurements and/or observations of all sensors may be obtained.
  • the time data may be obtained individually for the individual sensors.
  • a single set of time data may be obtained for all measurements and/or observations taken concurrently, or near concurrently.
  • the method 600 may comprise obtaining any number of spectral features.
  • the first set of spectral measurements of the target may comprise obtaining a third, fourth, fifth, and/or more spectral measurements of the target(s) and/or ambient light source(s) over a third, fourth, fifth, and/or more discrete frequency ranges.
  • the third, fourth, fifth, and/or more sets of spectral measurements may be taken by sensor(s) having peak response frequencies within a third, fourth, fifth, and/or more spectral frequency ranges.
  • the first, second, third, fourth, fifth, and/or other spectral frequency ranges may be different.
  • the first, second, third, fourth, fifth, and/or other spectral frequency ranges may be overlapping, wherein individual ones of the spectral frequency ranges overlap one or more others of the individual ones of the spectral frequency ranges.
  • sets of environmental parameters associated with the spectral measurements of the target and/or the spectral measurements of the one or more ambient light sources may be obtained.
  • the environmental parameters obtained may be the environmental parameters disclosed herein.
  • the calibration values for the spectral measurements of the target may be calculated.
  • the operations conducted at operation 610 may be performed by a calibration value component, such as calibration value component 612.
  • spectral measurements of the target may be calibrated.
  • the theoretical irradiance model for the target based on the obtained sets of environmental parameters may be determined.
  • sets of calibration values may be determined for the spectral measurements of the target, wherein the sets of calibration values are determined based on the obtained spectral measurements of the one or more ambient light sources and the theoretical irradiance model for the target.
  • information about the target may be provided based on the calibrated spectral information of the target.
  • spectral measurements of a target and spectral measurements of one or more ambient light sources may be obtained from an aerial vehicle, over one or more data connections.
  • environmental information about the obtained spectral measurements may be obtained.
  • the environmental information may be obtained from one or more local sensors and/or from one or more external resources as described above.
  • sets of calibration values for the spectral measurements of the target may be determined.
  • the sets of calibration values may be determined by one or more processors.
  • the sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources.
  • the sets of calibration values may be determined based on the obtained
  • the spectral measurements of the target may be scaled with the determined sets of calibration values.
  • FIG. 8 illustrates a method 800 of analyzing data of spectral measurements in accordance with one or more implementations.
  • spectral measurement data associated with a target may be obtained.
  • spectral measurement data associated with one or more ambient light sources may be obtained.
  • environmental information associated with the target and/or ambient light source(s) may be obtained.
  • time data associated with the spectral measurements of the target and/or ambient light source(s), and/or other measurements may be obtained.
  • the data obtained at operations 802, 804, 806, 808, and/or other data may be obtained from electronic storage, such as electronic storage 126.
  • the data obtained at operation 802, 804, 806, 808, and/or other data may be obtained over one or more electronic connections, such as hard-wired electronic connections, wireless electronic connections, and/or other electronic connections.
  • the data obtained at operation 802, 804, 806, 808, and/or other data may be obtained at a client computing device, such as a laptop, desktop, handheld device, smart device, and/or other client computing device.
  • the data obtained at operation 802, 804, 806, 808, and/or other data may be obtained at a server remote from the client computing device.
  • sets of calibration values for the obtained spectral measurement data of one or more targets may be determined.
  • sets of calibration values for the theoretical model associated with the target may be obtained.
  • the spectral measurements of the target may be scaled based on the determined calibration values. Operations 810, 812, 814, and/or other operations, may be performed by a client device in electronic communication with the electronic storage device associated with an aircraft.
  • Operations 810, 812, 814, and/or other operations may be performed by a server.
  • the operations 810, 812, 814, and/or other operations may be performed by a service provider remote from the aircraft and/or the client computing device(s) associated with the user of the aircraft.

Abstract

Systems and methods are provided for calibrating spectral measurements taken of one or more targets from an aerial vehicle. Multiple photo sensors may be configured to obtain spectral measurements of one or more ambient light sources. The obtained spectral measurements of the one or more ambient light sources may be used to calibrate the obtained spectral measurements of the target.

Description

SYSTEM AND METHOD FOR CALIBRATING IMAGING
MEASUREMENTS TAKEN FROM AERIAL VEHICLES
RELATED APPLICATIONS
(1 ) The present international application is related to U.S. Patent Application Serial No. 14/480,565, filed September 8, 2014, entitled "SYSTEM AND METHOD FOR CALIBRATING IMAGING MEASUREMENTS TAKEN FROM AERIAL VEHICLES", which is incorporated herein by reference in its entirety.
FIELD OF THE DISCLOSURE
(2) This disclosure relates to systems and methods for obtaining calibrated images of a target area, and specifically relates to obtaining calibrated images of a target area taken from aerial vehicles.
BACKGROUND
(3) The spectral content of electromagnetic waves reflected off of, or emitted from, a target provides information about the properties of that target. In some circumstances, the spectral content of the electromagnetic waves reflected off of, or emitted from, a target provides information about the chemical composition of the target. Based on the information provided by the reflected and/or emitted electromagnetic waves, the target can be classified. For example, the target's composition may be determined. In cases where the target is vegetation, it may be possible to determine a condition of the vegetation.
(4) Multi-spectral imaging (MSI) and hyperspectral imaging (HSI) systems, which are capable of capturing incident light as a function of spectral wavelength, may be used to collect such information about a target for a large variety of applications. (5) The electromagnetic waves that are reflected off of a target are from a light source. Therefore, the spectral content of the electromagnetic waves reflected off of a target will also be a product of the electromagnetic waves provided by the light source. Different light sources and different conditions affecting a light source will cause the spectral content of the electromagnetic waves from the light source to differ. Therefore, it is necessary to provide systems and methods to calibrate the spectral content measurements captured of the target.
(6) Calibration systems have been used whereby the target is illuminated by an artificial light source having a known spectral content. Calibration systems have been used whereby a target calibration panel having a known spectral reflectance has been placed in the field of view of the target spectral measurement devices and used to calibrate the target spectral measurements. Calibration systems have also been used which measure the spectral content of the light sources directly.
SUMMARY
(7) Prior methods and systems for calibrating spectral images of targets are especially impractical for use in small aerial vehicles. Existing methods either require logistically impractical steps for inserting known reflectance objects within the target scene, or require on-board sensing systems which are impractical for use on very small aircraft with extreme weight and power constraints. This disclosure relates to obtaining calibrated images of a target area, and specifically obtaining calibrated images of a target area obtained using airborne vehicles. Spectral measurements of a target and/or target area may be calibrated by direct spectral measurements of the ambient light source(s). The calibration may be performed by obtaining spectral measurements of one or more ambient light sources across discrete spectral frequency ranges with photo sensors having extremely low size, weight, and power. The spectral frequency ranges of the spectral measurements of the ambient light source may correlate with the spectral measurements of the target(s) and/or target area(s). Such systems and methods provide an advantage over the prior art because they are lightweight, have reduced power requirements, and provide a calibration correction for each spectral image that accounts for changes in ambient illumination conditions that vary from sample to sample..
(8) Spectral measurements may include intensity measurements, luminosity measurements, luminous flux measurements, luminous power measurements, wavelength measurements, frequency measurements, brightness, and/or other measurements of electromagnetic waves.
(9) One aspect of the disclosure relates to a system for obtaining calibrated spectral measurements of a target. The system may comprise an aerial vehicle. The aerial vehicle may be a manned or unmanned aerial vehicle. The aerial vehicle may be an unmanned aerial system, a remotely piloted aircraft, and/or other aerial vehicle. The aerial vehicle may have a propulsion type being one or more of vertical rotor, horizontal rotor, jet propelled, and/or other propulsion type. The aerial vehicle may be a passive aerial vehicle having no active propulsion type. The aerial vehicle may be a balloon, glider, or other vehicle.
(1 0) The system may comprise at least one spectral imaging device. The at least one spectral imaging device may be configured to obtain spectral measurements of a target. The target may be at least partially illuminated by one or more ambient light sources. The ambient light sources may be one or more of the sun, reflected light from the moon, star light, artificial light, natural light, and/or other light sources. The spectral imaging device may be configured to obtain spectral measurements of the target in discrete frequency ranges. The spectral imaging device may be configured to obtain spectral measurements of the target across a continuous frequency range. The continuous frequency range may span across one or more selected discrete frequency ranges. The one or more discrete frequency ranges may be selected based on a desired information type. The spectral measurements of the target may comprise a first set of spectral measurements of the target. The first set of spectral measurements of the target may comprise spectral measurements of the target taken across one or more discrete frequency ranges.
(1 1 ) The spectral imaging device may be configured to obtain measurements of the target over spectral frequency ranges spanning across the ultraviolet, visible, near infrared, and infrared regions of the electromagnetic spectrum.
(1 2) As used herein, the target may be a single target, multiple targets, a target area or target areas, and/or any other target.
(1 3) The system may comprise one or more photo sensors. The one or more photo sensors may be configured to obtain spectral measurements of the one or more ambient light sources. The one or more photo sensors may have peak responses approximate to a first set of discrete spectral frequency ranges. The one or more photo sensors may be configured to obtain spectral measurements of the one or more ambient light sources at individual ones of the first set of discrete spectral frequency ranges. Individual ones of the one or more photo sensors may have a peak response range approximate to individual ones of the first set of spectral frequency ranges. The one or more photo sensors may comprise a first photo sensor. The first set of spectral frequency ranges may comprise a first spectral frequency range. The first photo sensor may have a peak response approximate to a first spectral frequency range. The first photo sensor may be configured to obtain a first spectral measurement of the one or more ambient light sources over the first spectral frequency range.
(14) The sets of spectral frequency ranges may include any number of frequency ranges. Individual ones of the spectral frequency ranges may overlap. For example, the first set of spectral frequency ranges may include: a first discrete frequency range, a second discrete frequency range, a third discrete frequency range, a fourth discrete frequency range, a fifth discrete frequency range, and other discrete frequency ranges. The photo sensors may be configured to obtain spectral frequency measurements of the one or more ambient light sources and may include a first photo sensor having a peak response range approximate to a first spectral frequency range, a second photo sensor having a peak response range approximate to a second spectral frequency range, a third photo sensor having a peak response range approximate to a third spectral frequency range, a fourth photo sensor having a peak response range approximate to a fourth spectral frequency range, a fifth photo sensor having a peak response range approximate to a fifth spectral frequency range, and one or more other photo sensors having peak response ranges approximate one or more other spectral frequency ranges.
(1 5) The photo sensors may be one or more of light-emitting diodes (LEDs), photodiodes, and/or other sensor. The photo sensors may comprise one or more light-diffusing elements configured to integrate downwelling illumination from the one or more ambient light sources. One or more electrical amplifiers may be
electronically connected to the photo sensors. The one or more amplifiers may be configured to amplify the measurements obtained by the photo sensors.
(1 6) The circuit may comprise a conversion circuit. The conversion circuit may be employed, wherein the amplifier(s) may be configured to convert the photo sensors' output current to an output voltage. The circuit may comprise an analog-to-digital converter configured to convert the voltage signal into a digital value for individual images collected by the spectral imaging devices.
(1 7) The obtained spectral measurements of the one or more ambient light sources may be used to calibrate the obtained spectral measurements of the target. The first set of target spectral measurements may be calibrated based on the first set of ambient light spectral measurements.
(1 8) The system may be configured to determine a first set of calibration values for the first set of target spectral measurements. The first set of calibration values may be based on the first set of ambient light spectral measurements. The system may be configured to scale the first set of target spectral measurements based on the determined first set of calibration values.
(1 9) The spectral measurements of the target may include measurements spanning over the first set of discrete frequency ranges. The one or more photo sensors may have peak response frequency ranges approximate to the discrete frequency ranges included in the spectral measurements of the target.
(20) The system may comprise one or more processors configured by machine- readable instructions to carry out one or more functions. The one or more functions are herein described in relation to computer program components. One of ordinary skill in the art will understand and appreciate that the computer-readable instructions may or may not be created in discrete components corresponding to the one or more functions. One of ordinary skill in the art will understand and appreciate that the computer-readable instructions herein described may include computer-readable instructions created in one or more sets of programming code, in one or more separate computer programs, performed on one or more computing devices, and/or created in other forms.
(21 ) The one or more processors may be configured by machine-readable instructions to perform the operations of a time component and/or other components. The time component may be separate from the other components. The time component may comprise individual time components for each sensor. The time component may be configured to obtain time data and/or information associated with the obtained measurements. For example, a first set of time data may be obtained for the first set of measurements of the target. The time component may be configured to obtain time data associated with the obtained spectral measurements of the one or more ambient light sources. For example, a first set of time data may be obtained for the first set of ambient light spectral measurements. The first set of time data obtained for the first set of ambient light spectral measurements may be the same as the first set of time data obtained for the first set of target spectral measurements.
(22) The system may comprise one or more electronic data storage mediums configured to receive the obtained spectral measurements of the target and the obtained spectral measurements of the one or more ambient light sources, such that the electronic data storage mediums are configured to receive the first set of measurements of the target, the first set of ambient light spectral measurements, and/or other measurements. The one or more electronic data storage mediums may be mounted to the aerial vehicle and may be in electronic communication with the spectral imaging device(s), the photo sensor(s) and/or other sensors and/or elements. (23) The system may comprise one or more thermometers configured to measure the temperature of the spectral imaging devices(s), the photo sensors, and/or other sensors and/or elements. The electronic storage medium(s) may be in electronic communication with the thermometer(s) and may be configured to receive
temperature data associated with the spectral imaging devices(s), photo sensors, and/or other sensors and/or elements. The data associated with the temperature information, spectral measurements of the target, spectral measurements of the one or more ambient light sources and/or other obtained information may be stored on the electronic storage medium(s) together with the associated time information of the measurements and/or the obtained information.
(24) The system may comprise an attitude component. The attitude component may be configured to obtain an attitude of the spectral imaging devices(s), the one or more photo sensors, and/or other sensors and/or elements. The system may comprise a position sensor. The position sensor may be configured to obtain position information of the system. The position sensor may be configured to obtain position information of individual ones of the one or more sensors and/or elements.
(25) The time component may be configured to obtain time information associated with the one or more target spectral measurements, the ambient light spectral measurements, the one or more temperature measurements, the one or more attitude measurements, the one or more position measurements, and/or other measurements. The first set of target spectral measurements, the first set of ambient light spectral measurements, the first set of temperature measurements, the first set of attitude measurements, the first set of location measurements, and/or other measurements, may be obtained concurrently, or near concurrently, and may be collectively referred to as the first set of measurements. The time component may be configured to obtain a first set of time information associated with the first set of measurements.
(26) The at least one spectral imaging device may be configured to obtain a first set of spectral measurements of the target across the first set of spectral frequency ranges at a first time. The at least one spectral imaging device may be configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time. The one or more photo sensors may be configured to obtain a first set of spectral measurements of the one or more ambient light sources across the first set of spectral frequency ranges at the first time. The one or more photo sensors may be configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at the second time. The first set of spectral measurements of the target may be calibrated based on the first set of spectral measurements of the ambient light source(s). The second set of spectral measurements of the target may be calibrated based on the second set of spectral measurements of the ambient light source(s).
(27) The system may comprise an environmental parameter component. The environmental parameter component may be configured to obtain environmental parameter information. The environmental parameter information may be associated with the spectral measurements of the target and/or the spectral measurements of the ambient light source(s). The spectral measurements of the target may be calibrated using the obtained environmental parameter information. The obtained environmental parameter information may be correlated with the first set of measurements based on the time information.
(28) Another aspect of this disclosure relates to a method for obtaining calibrated images of a target area. The method may comprise the steps of obtaining spectral measurements of a target. The target may be at least partially illuminated by one or more ambient light sources. The method may comprise obtaining spectral measurements of the one or more ambient light sources across a first set of discrete spectral frequency ranges. The spectral measurements across the first set of discrete spectral frequency ranges may include a first spectral measurement of the one or more ambient light sources over a first spectral frequency range. The obtained spectral measurements of the one or more ambient light sources may be used to calibrate the obtained spectral measurements of the target. For example, the first set of spectral measurements of the target may be calibrated based on the first set of spectral measurement of the one or more ambient light sources.
(29) Another aspect of the disclosure relates to a method for calibrating spectral measurements of a target. The method may comprise obtaining target spectral measurement data associated with one or more targets. The target spectral measurement data may have been obtained using an aerial vehicle. The method may comprise obtaining ambient light spectral measurement data associated with one or more ambient light sources. The ambient light spectral measurement data may have been obtained using an aerial vehicle. The target spectral measurements, the ambient light spectral measurements, and/or other measurements may be taken by the same or different aerial vehicles.
(30) The method may comprise determining sets of calibration values for the obtained target spectral measurement data. The determination of the calibration values may be based on the obtained ambient light spectral measurement data. The method may comprise scaling the obtained target spectral measurement data with the determined sets of calibration values. Scaling the obtained target spectral measurement data may provide calibrated spectral measurements of the one or more targets.
(31 ) The obtained target spectral measurement data may comprise spectral measurement data associated with a first set of spectral frequency ranges. The obtained ambient light spectral measurement data may comprise spectral measurement data associated with the first set of spectral frequency ranges. The step of determining the sets of calibration values for the obtained target spectral measurement data may comprise determining individual ones of the sets of calibration values based on the spectral measurement data associated with individual ones of the first set of spectral frequency ranges.
(32) The target spectral measurement data and the ambient light spectral measurement data may be obtained by a server. The server may be in electronic communication with the sensors that obtained the data. The server may be in electronic communication with storage devices used to store the data obtained from the sensors. The server may be physically remote from the sensors and/or electronic storage device. The data may be obtained by a client-computing device associated with an operator of an aerial vehicle from which the data has been obtained. The data may be processed by the server, the client computing device, and/or other devices.
(33) The system may comprise one or more data connections configured to electronically connect to one or more electronic data storage mediums on an aerial vehicle. The one or more data connections may be wired and/or wireless connections. The one or more data connections may be direct or indirect. The data connection(s) may be configured to continuously provide data from the electronic storage mediums and/or the sensors on the aerial vehicle. The data connection(s) may be configured to periodically provide data from the electronic storage mediums and/or the sensors on the aerial vehicle. The data connection(s) may be configured to provide data from the electronic storage mediums and/or the sensors on the aerial vehicle when connected to devices configured to retrieve the data, wherein the devices download all, substantially all, or select portions of the data. The data may be transferred to one or more other electronic storage devices prior to processing.
(34) The electronic data storage medium(s) may be configured to store spectral measurements of a target taken from an aerial vehicle. The electronic storage medium(s) may be configured to store spectral measurements of one or more ambient light sources.
(35) The system may comprise one or more physical computer processors configured by machine-readable instructions to perform the functions of one or more computer components. The one or more computer components may comprise a calibration component, an environmental parameter component, and/or a theoretical model component.
(36) The calibration component may be configured to determine sets of calibration values for the spectral measurements of the target. The sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources and/or other sources.
(37) The environmental parameter component may be configured to obtain sets of environmental parameters associated with the spectral measurements of the target. The environmental parameter component may be configured to obtain sets of environmental parameters associated with the spectral measurements of the one or more ambient light sources. The environmental parameters may include temperature measurements of and/or adjacent to the multiple photo sensors configured to obtain spectral measurements of the one or more ambient light sources. The environmental parameters may include temperature measurements of and/or adjacent to the spectral imaging device configured to obtain spectral measurements of the one or more targets. Temperature measurements of the photo sensors may be obtained to correct for thermal responsivity effects of the photo sensors. The environmental parameters may include one or more of the
geographical location, the attitude, the altitude, the transmission properties of the photo sensors, and/or other environmental parameters. The environmental parameters may include one or more of the time of year the measurements were taken, the time of day the measurements were taken, the atmospheric properties at the time the measurements were taken, and/or other environmental parameters.
(38) The theoretical model component may be configured to determine a theoretical irradiance model for the target based on the obtained sets of
environmental parameters. The theoretical model component may be configured to determine the theoretical irradiance model for the target based on an atmospheric transmission model.
(39) The calibration component may be configured to determine sets of calibration values for the spectral measurements of the target. The sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources. The sets of calibration values may be determined based on the theoretical irradiance model for the target.
(40) The calibration component may be configured to determine a calibration value for the spectral measurements of the target. For example, where the spectral imaging devices are configured to obtain spectral measurements of a target, a calibration value may be determined for the spectral frequency ranges and/or spectral bands in which the spectral measurements were taken. Individual calibration values may be determined for the individual spectral frequency ranges and/or spectral bands. A calibration value may be determined for, and may be applicable to, multiple spectral frequency ranges and/or spectral bands.
(41 ) The calibration component may be configured to scale the spectral measurements of the target with the determined sets of calibration values. Scaling the spectral measurements of the target with the determined sets of calibration values may provide spectral measurements of the target that is independent, or nearly independent, of ambient light illumination conditions.
(42) These and other features, and characteristics of the present technology, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of the invention. As used in the specification and in the claims, the singular form of "a", "an", and "the" include plural referents unless the context clearly dictates otherwise. BRIEF DESCRIPTION OF THE DRA WINGS
(43) FIG. 1 illustrates a system for obtaining calibrated spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations;
(44) FIGs. 2A and 2B provide simplistic illustrations of examples of the spectral measurement curves of the spectral imaging device(s) and the photo sensor(s), in accordance with one or more implementations;
(45) FIG. 3 illustrates a schematic view of a circuit used in calibrating spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations;
(46) FIG. 4 illustrates a schematic view of a circuit used in calibrating spectral measurements of a target illuminated by ambient light and/or other sources, in accordance with one or more implementations;
(47) FIG. 5 illustrates a system for obtaining calibrated spectral measurements of a target, in accordance with one or more implementations;
(48) FIG. 6 illustrates a method for obtaining calibrated spectral measurements of a target, in accordance with one or more implementations;
(49) FIG. 7 illustrates a method for calibrating spectral measurements of a target, in accordance with one or more implementations; and,
(50) FIG. 8 illustrates a method for analyzing data of spectral measurements, in accordance with one or more implementations. DETAILED DESCRIPTION
(51 ) Prior methods and systems of calibrating spectral images of targets are especially impractical for use in small aerial vehicles. Existing methods either require logistically impractical steps for inserting known reflectance objects within the target scene, or require on-board sensing systems which are impractical for use on very small aircraft with extreme weight and power constraints. This disclosure relates to obtaining calibrated spectral images of target(s) and/or target area(s) using spectral measurements obtained from aerial vehicles. The systems and methods may include calibrating spectral images of target(s) using measurements of the spectral characteristics of the incident illumination within discrete and/or narrow spectral bands that may be selected to match the bands of the spectral imager. The measurements of the spectral characteristics of incident illumination may be synchronized to the spectral measurements of the target(s). Such systems and methods provide an advantage over the prior art because they are lightweight, have reduced power requirements, and provide a calibration correction for each spectral image that accounts for changes in ambient illumination conditions that vary from sample to sample.
(52) FIG. 1 illustrates a system 100 for obtaining calibrated spectral images of a target 102. The target 102 may be illuminated by one or more ambient light sources 107. The target 102 may be an individual target, a group of targets, an area, and/or any desired target. The system 100 may be configured to obtain calibrated spectral images of a target, wherein the spectral images are obtained using an aerial vehicle 106. The aerial vehicle shown in FIG. 1 is an unmanned vehicle, or a remotely piloted vehicle. However, the aerial vehicle 106 may be any type of aerial vehicle, including piloted and non-piloted aerial vehicles. The aerial vehicle 106 may be an autonomous aerial vehicle capable of flying missions without continuous or periodic intervention by a pilot, whether directly or remotely. The aerial vehicle may be a helicopter, quadcopter, hexacopter, octocopter, an aerial vehicle having horizontal, or near horizontal, propellers, an aerial vehicle having vertical, or near vertical, propellers, an aerial vehicle having jet propulsion, a plane, a satellite, a balloon, a flying ship, or any other type of aerial vehicle capable of facilitating the obtaining of spectral images of a target from an elevated position. In some implementations, spectral images may include spectral measurements and/or other ways of obtaining spectral information of a target(s).
(53) Spectral measurements may include intensity measurements, luminosity measurements, luminous flux measurements, luminous power measurements, wavelength measurements, frequency measurements, brightness, other
measurements in the electromagnetic spectrum, and/or other measurements.
(54) The aerial vehicle 106 may be capable of carrying, and/or being configured to carry, at least one spectral imaging device 108. The aerial vehicle 106 may be capable of carrying, and/or being configured to carry, one or more photo sensors 1 10. The spectral imaging device 1 08 may be configured to obtain spectral images and/or measurements of a target 102. The spectral imaging device 108 may be one or more of a multispectral or hyperspectral still image or video camera, an array of charge-coupled devices or complimentary metal oxide semiconductors, LEDs, photo sensors, and/or other image and/or spectral measuring devices.
(55) The target 1 02 may be illuminated by one or more ambient light sources 1 07. The ambient light sources 107 may be direct and/or indirect light sources. The ambient light sources 107 may be one or more of the sun (as shown in FIG. 1 ), the moon, starlight, artificial light, natural light, any combination of reflected and/or transmitted light sources, and/or other light sources.
(56) The spectral imaging device 108 may be configured to obtain signals reflected and/or emitted from the target at a set of predefined spectral bands and/or spectral frequency ranges. The predefined spectral bands and/or spectral frequency ranges may be across one or more of the ultraviolet, the visible, the near-infrared, and/or the infrared regions of the electromagnetic spectrum. The photo sensors may be configured to obtain spectral measurements of characteristics of the electromagnetic radiation from one or more ambient light sources 107. The one or more ambient light sources 107 may provide illumination and/or part of the illumination of the one or more targets 102. The photo sensors 1 10 may be configured to obtain spectral measurements of the ambient light source(s) 107 in the same frequency bands as obtained for the target 102 by the spectral imaging device 1 08.
(57) The photo sensors 1 10 may be mounted to the aerial vehicle 106. The mount 130 may be configured to facilitate orientation of the photo sensors 1 10. The photo sensors 1 10 may be oriented in a desired manner. For example, the photo sensors
1 10 may be oriented toward the one or more ambient light sources 107. The photo sensors may be oriented at a desired angle relative to the target(s) 102. The photo sensors may be oriented individually, as groups of photo sensors, or as a combined whole.
(58) Individual ones of the set of photo sensors 1 1 0 may have a peak response parameter range approximate to individual ones of the spectral bands and/or spectral frequency ranges of the spectral imaging device 108. An example of such a spectral imaging device may be a multispectral imager. In some implementations, the spectral imaging device 108 may comprise one or more sensors having a continuous spectral response across a range of spectral frequencies. In some implementations, and as shown in FIGs. 2A and 2B, the spectral imaging device 108 (as shown in FIG. 1 ) may comprise one or more sensors wherein individual ones of the one or more sensors have a spectral response across subsets of discrete spectral frequency ranges within a wider spectral frequency range. Individual ones of the set of photo sensors 1 10 may have a peak response parameter range at spectral positions selected at discrete bands spanning the continuous spectral response of the spectral imaging device 108, as shown in FIG. 2A. An example of such a spectral imaging device 108 may be a hyperspectral imager. In the case of the spectral imaging device 108 comprising one or more sensors wherein individual ones of the one or more sensors have a response range across a discrete subset of spectral frequency ranges within a wider range of spectral frequencies, individual ones of the photo sensors 1 10 may have a peak response parameter corresponding to the discrete subset of spectral frequency ranges of the spectral imaging device 108, as shown in FIG. 2B.
(59) For example, the multiple photo sensors 1 1 0 may comprise a first photo sensor 1 12 having a peak response parameter range approximate to a first spectral frequency range of the spectral imager 108. The first photo sensor 1 12 may be configured to obtain a first spectral measurement of the ambient light sources 107 and/or other sources. Similarly, a second photo sensor 1 14 may be provided having a peak response parameter range approximate to a second spectral frequency range of the spectral imager 108. The second photo sensor may be configured to obtain a second spectral measurement of the ambient light sources 1 07 and/or other sources. The system may comprise multiple photo sensors, such as photo sensors 1 14, 1 16, 1 18, 1 20, and other photo sensors, configured to obtain spectral measurements in multiple different frequency ranges. The individual photo sensors of the multiple photo sensors 1 10 may have different peak response ranges. Two or more of the individual photo sensors of the multiple photo sensors 1 10 may have the same and/or similar peak response ranges.
(60) The multiple photo sensors 1 10 configured to obtain spectral measurements of the one or more ambient light sources 1 07 may include a third photo sensor 1 16 having a peak response parameter range approximate to a third spectral frequency range. The third photo sensor 1 16 may be configured to obtain a third set of ambient light measurements. The multiple photo sensors 1 1 0 may include a fourth photo sensor 1 18 having a peak response parameter range approximate to a fourth spectral frequency range. The multiple photo sensors 1 1 0 may include a fifth photo sensor 120 having a peak response parameter range approximate to a fifth spectral frequency range. The fourth and fifth photo sensors may be configured to obtain a fourth and fifth set of ambient light measurements. The multiple photo sensors 1 1 0 may include multiple photo sensors having peak response parameter ranges approximate to multiple spectral frequency ranges. Individual ones of the multiple photo sensors may be configured to have a peak response parameter range approximate to individual ones of the multiple spectral frequency ranges of the spectral imaging device.
(61 ) FIGs. 2A and 2B provide simplistic illustrations of examples of the spectral measurement curves of the spectral imaging device 108 and the one or more photo sensors 1 10. FIG. 2A shows a first plot 200 of an example of a spectral
measurement curve 202 for a spectral imaging device 108. The spectral imaging device 108 may be configured to obtain spectral images and/or measurements of the target 102 over a continuous range of frequencies. An example of such a spectral imaging device may be a hyperspectral imager. The system 1 00 may comprise one or more photo sensors 1 1 0. The photo sensors 1 10 may be configured to obtain a first set of measurements of the ambient light source 1 07. The first set of measurements of the ambient light source 107 may comprise measurements of the ambient light source taken over a first frequency range and/or band. The multiple photo sensors 1 10 may comprise one or more sensors having a peak response within a first spectral frequency range or band A. As shown in FIG. 2A, the one or more sensors having a peak response within a first spectral frequency range may have a peak response curve 204 across a first spectral frequency range or band A.
(62) Similarly, the first set of measurements of the ambient light source 1 07 may comprise measurements of the ambient light source taken over a second frequency range and/or band. The multiple photo sensors 1 10 may comprise one or more sensors having a peak response within the second spectral frequency range and/or band B. As shown in FIG. 2A, the one or more sensors having a peak response within the second spectral frequency range may have a peak response curve 206 across a second spectral frequency range or band B.
(63) The first set of measurements of the ambient light source 107 may comprise measurements of the ambient light source taken over a third, fourth, fifth, or more, spectral frequency ranges and/or bands, C, D, and E. The multiple photo sensors 1 10 may comprise one or more sensors having peak responses within the third, fourth, fifth, or more, spectral frequency ranges and/or bands. As shown in FIG. 2A, the one or more sensors having a peak response within the third, fourth, fifth, or more, spectral frequency ranges and/or bands may have peak response curves 208, 210, 212, across the third, fourth, fifth, and more spectral frequency ranges and/or bands C, D, and E. (64) FIG. 2B shows a second plot 200 of an example of spectral measurement curves for a spectral imaging device 1 08, wherein the spectral imaging device 108 is configured to obtain spectral images and/or measurements across discrete frequency ranges or bands. An example of such a spectral imaging device 108 may be a multispectral imager. The spectral images and/or measurements obtained of the target by the spectral imaging device 108 may comprise a first set of spectral measurements of the target taken over a first set spectral frequency ranges and/or bands. As shown in FIG. 2B, the spectral imaging device 108 configured to obtain spectral measurements over one or more discrete frequency ranges and/or bands may comprise one or more sensors having a peak response over a first spectral frequency range and/or band A providing a first spectral curve 214. Similarly, the imaging device 108 configured to obtain spectral measurements over one or more discrete frequency ranges may comprise one or more sensors having a peak response over a second B, third C, fourth D, fifth E, and more spectral frequency ranges and/or bands, providing a second 21 6, third 218, fourth 220, fifth 222, and more, spectral curves.
(65) The first set of images and/or measurements of the target 102 may provide information about the spectral irradiance and/or reflection of the target 102. The spectral imaging device(s) 108 may be configured to obtain measurements over preselected spectral frequency ranges. The spectral imaging device(s) 108 may comprise sensors dynamically configured to adjust their detecting frequency to obtain measurements over dynamically selected spectral frequency ranges.
(66) The spectral frequency ranges selected for the multiple photo sensors may be selected based on parameters providing an indication of a type of information obtained from measurements over the selected frequency ranges. (67) The multiple photo sensors 1 10 may have peak spectral sensitivities in any number of spectral frequency ranges and/or spectral bands. For example, a matrix of multiple photo sensors may have peak sensitivity ranges in one, two, three, four, five, and more spectral frequency ranges or bands. The width of the spectral frequency ranges and/or bands may be any size. For example, the spectral frequency ranges and/or bands may be limited to a single nanometer, or may be many nanometers. The width of the spectral frequency ranges or bands may be selected to have a range indicative of providing a desired set of information or indicative of providing a desired outcome.
(68) In some implementations, the multiple photo sensors 1 10 may be configured in an array. In some implementations, the multiple photo sensors 1 10 may be disposed in the system 100 individually. The system 100 may comprise a diffusing element 1 13 configured to reduce the directionality of the electromagnetic radiation received by the multiple photo sensors 1 10.
(69) The multiple photo sensors 1 10 may be comprised of light-emitting diodes (LEDs) configured and operated as light collection sensors. The LEDs may be configured such that individual ones of the LEDs are selected based on the LED's responsivity within individual ones of the predefined spectral bands.
(70) FIG. 3 illustrates a schematic view of a circuit 300 used in obtaining calibrated spectral images and/or measurements of a target and/or target area illuminated by ambient light sources and/or other sources, in accordance with one or more implementations. There may be a circuit 300 that may comprise a LED 302. The LED 302 may comprise an anode 304 and a cathode 306. The LED 302 may comprise a substrate 308, an n-layer 310, an active region 312, a p-layer 314, and one or more other elements. In some implementations, the LED may comprise one or more light diffusing elements. The light diffusing elements may be configured to integrate downwelling illumination from the one or more ambient light sources. In some implementations, the circuit 300 may comprise a light diffusion optic 316 configured to cover one or more of the LEDs 302.
(71 ) The circuit 300 may comprise an amplification circuit 31 8 comprising one or more electrical amplifiers 320. The amplification circuit may be electronically connected to the LEDs 302. The one or more amplifiers 320 may be configured to amplify the measurements obtained by the one or more LEDs 302. For example, the one or more electrical amplifiers 320 may amplify the first set of ambient light measurements and the second set of ambient light measurements obtained by the LEDs 302.
(72) The circuit 300 may be configured such that the output at Vout may be proportional to the incident photon flux within the LED's spectral band. The circuit may comprise a conversion circuit which may be employed, wherein the LED current is converted to a voltage and amplified in proportion to the feedback resistance across the amplifier(s) 320. The circuit 300 may comprise an analog-to-digital converter 322 configured to convert the voltage signal into a digital value for the measurements collected by the LEDs 302.
(73) The multiple photo sensors 310 may be comprised of photodiodes. FIG. 4 illustrates a schematic view of an assembly and circuit 400 used in obtaining calibrated spectral images and/or measurements of a target and/or target area illuminated by ambient light sources and/or other sources, in accordance with one or more implementations. Individual ones of the photodiode assemblies 402 may comprise a bandpass light filter element 41 0. The bandpass light filter element 410 of the individual photodiodes 402 may be selected based on its restriction of incident illumination to predefined and/or preselected spectral bands approximate to individual ones of the spectral imaging device's 408 spectral bands.
(74) In some implementations, the photodiode(s) 402 may comprise one or more light diffusing elements 404. The light diffusing elements 404 may be configured to integrate downwelling illumination from the one or more ambient light sources. In some implementations, the circuit 400 may comprise a light diffusion optic 404 configured to cover one or more of the photodiodes 402.
(75) The circuit 400 may comprise an amplification circuit 406 comprising one or more electrical amplifiers 408. The amplification circuit may be electronically connected to the photodiodes 402. The one or more amplifiers 408 may be configured to amplify the measurements obtained by the one or more photodiodes 402. For example, the one or more electrical amplifiers 402 may amplify the first set of ambient light measurements obtained by the photodiodes 402.
(76) The circuit 400 may be configured such that the output at Vout may be proportional to the incident photon flux within the spectral bandpass region of the bandpass light filter 410. The circuit 400 may comprise a conversion circuit which may be employed, wherein the photodiode's output current is converted to a voltage and amplified in proportion to the feedback resistance across the amplifier(s)408. The circuit 400 may comprise an analogue-to-digital converter 412 configured to convert the voltage signal into a digital value for the measurements collected by the photodiodes 402.
(77) The obtained spectral measurements of the one or more ambient light sources 107 may be used to calibrate the obtained spectral measurements of the target 102. For example, the first set of measurements of the target 102 may be scaled based on a concurrently sampled, or near concurrently sampled, first set of ambient light spectral measurements. The first set of measurements of the target 102 taken by the spectral imaging device 108 may comprise measurements taken over a first spectral frequency range or band. The first set of measurements of the target 102 taken by the spectral imaging device 1 08 may comprise measurements taken over a second, third, fourth, fifth, and more, spectral frequency ranges or bands.
(78) The obtained spectral measurements of the target may comprise a second set of spectral measurement of the target taken at a time different from the first set of spectral measurements of the target. The second spectral measurement of the target may be scaled based on a concurrently sampled, or near concurrently sampled, second set of ambient light spectral measurements.
(79) With reference to FIG. 1 , the system 1 00 may comprise a location sensor 1 25. The location sensor 125 may be configured to obtain a position of the aerial vehicle, the spectral imaging device, and/or the multiple photo sensors. The system 100 may comprise an altitude sensor 127. The altitude sensor 127 may be configured to obtain an altitude of the aerial vehicle, the spectral imaging device, and/or the multiple photo sensors.
(80) In some implementations, the system 100 may comprise one or more processors 122 configured by machine-readable instructions to carry out one or more functions. The one or more functions are herein described in relation to computer program components. One of ordinary skill in the art will understand and appreciate that the computer-readable instructions may or may not be created in discrete components corresponding to one or more functions. One of ordinary skill in the art will also understand and appreciate that the computer-readable instructions herein described may include computer-readable instructions created in one or more sets of programming code, in one or more separate computer programs, performed on one or more computing devices, and/or created in other forms.
(81 ) The one or more processors 122 may be configured by machine-readable instructions to perform the operations of a time component 124 and/or other components. In some implementations, the time component 124 may be configured to be independent of the one or more processors 122. The time component 1 24 may be configured to obtain time data and/or information associated with the obtained measurements of the sensors. For example, the time component 124 may be configured to obtain time data and/or information associated with the obtained spectral measurements of the target 1 02. The time component 124 may be configured to obtain time data and/or information associated with the obtained spectral measurements of the one or more ambient light sources 107. The time component 124 may be configured to obtain time data and/or information associated with the obtained attitude measurements by the one or more attitude sensors 1 27. The time component 124 may be configured to obtain time data and/or information associated with the obtained location information obtained by the one or more location sensors 125. The measurements and/or observations obtained by the sensors may be taken concurrently, or nearly concurrently. The time component 124 may be configured to facilitate recording the time at which the measurements and/or observations were obtained. The time component 124 may be configured to record and/or store a single time measurement for all measurements obtained concurrently, or near concurrently, by the sensors. The time component 124 may be configured to record and/or store time measurements for the individual measurements obtained concurrently by the individual sensors. The multiple time measurements of the individual measurements may be the same time measurement, or may be individual time measurements representing the time at which the individual sensors obtained the measurement and/or observation.
(82) A first set of time data may be obtained for the first set of spectral
measurements of the target 1 02. The time component 124 may be configured to obtain time data associated with the obtained spectral measurements of the one or more ambient light sources 107. The time component 124 may be configured to obtain time data associated with the one or more temperature readings obtained by the one or more thermometers 128.
(83) The system 100 may comprise one or more temperature sensors 128 configured to measure one or more of the ambient temperature, the temperature of the multiple photo sensors 1 1 0, the temperature of the spectral imaging device(s) 108, the temperature of the location sensor(s) 125, the temperature of the altitude sensor(s) 125, and/or other temperature measurements. The temperature may be taken of the elements of the system or adjacent to the elements of the system.
(84) The system 100 may comprise one or more electronic data storage mediums 126. The electronic storage mediums 126 may be configured to receive one or more of the obtained spectral measurements of the target 102 by the spectral imaging device 108, the obtained spectral measurements of the one or more ambient light sources 107 by the photo sensors 1 10, the position measurements, the attitude measurements, the temperature measurements, and/or other information, the ambient light sources, and/or other data. The one or more electronic data storage mediums 126 may be mounted to the aerial vehicle 106 and may be in electronic communication with the spectral imaging device(s) 108, the photo sensor(s) 1 1 0, the processor 122, and/or the position, attitude, and temperature sensors. The electronic storage mediums 126 may be a single electronic storage, or may be multiple electronic storage devices. For example, individual sensors may comprise their own electronic storage or the sensors may electronically connect, either wired or wirelessly, or otherwise, to shared electronic storage.
(85) The electronic storage 126 may be in electronic communication with the thermometer(s) 128 and may be configured to receive temperature data associated with the multiple photo sensors 1 1 0 and/or spectral imaging device(s) 108. The data associated with temperature information, spectral measurements of the target, and the spectral measurements of the ambient light source may be stored on the electronic storage 126 together with associated time information of the
measurements.
(86) Electronic storage 126 may comprise electronic storage media that electronically stores information. The electronic storage media of electronic storage 126 may include one or both of system storage that is provided integrally (i.e., substantially non-removable) with aerial vehicle 1 06 and/or removable storage that is removably connectable to aerial vehicle 106 via, for example, a port (e.g., a USB port, a firewire port, etc.) or a drive (e.g., a disk drive, etc.). Electronic storage 126 may include one or more optically readable storage media (e.g., optical disks, etc.), magnetically readable storage media (e.g., magnetic tape, magnetic hard drive, floppy drive, etc.), electrical charge-based storage media (e.g., EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive, etc.), and/or other electronically readable storage media. The electronic storage 126 may include one or more virtual storage resources (e.g., cloud storage, a virtual private network, and/or other virtual storage resources). Electronic storage 1 26 may store software algorithms, information determined by processor 122, information received from sensors, and/or other information that enables system 100 to function as described herein.
(87) The system 100 may comprise at least one mounting device 130 configured to mount the photo sensors 1 10 to an aerial vehicle 106. The mounting device 130 may be configured to orient at least one set of photo sensors 1 10 such that the photo sensors 1 10 may obtain spectral measurements of the one or more ambient light sources 107.
(88) The mounting device 1 30 may be manually configured such that the photo sensors 1 10 may be orientated to obtain spectral measurements of the ambient light source(s). For example, the ambient light source may be a naturally occurring light source, such as the Sun. When the aerial vehicle 1 06 is travelling in a first direction, the ambient light source may be relatively stationary with respect to the aerial vehicle 106 and therefore the mounting device 130 may be manually set, such that the photo sensors 1 10 are orientated to obtain spectral measurements of the ambient light source(s).
(89) The system 100 may comprise a mounting angle sensor configured to obtain measurements of the angle at which the photo sensors 1 10 are positioned with respect to the incident light from the ambient light source(s) 107. The relationship between the intensity of the spectral measurement and the angle of incidence between the ambient light source(s) 107 and the photo sensor(s) 1 1 0 can be obtained. The relationship may be stored. The photo sensor(s) 1 10 may be rigidly mounted to the aircraft. The attitude sensor 1 27 may be configured to facilitate determination of the attitude of the photo sensor(s) 1 10 with respect to a frame of reference. One such frame of reference may be the Earth. The obtained attitude of the photo sensor(s) may be recorded concurrently, or near concurrently, with the spectral measurement(s) of the ambient light source(s) 107 and/or target(s) 1 02. The time and geo-location information may be obtained concurrently with the one or more spectral measurement(s) of the ambient light source(s) 1 07 and/or target(s) 102. The obtained time and geo-location information may facilitate determination of the solar elevation and azimuth angles. The angle of incidence of the light source relative to the sensor may be determined based on the obtained attitude information, the sensor(s) 1 10, and/or the determined solar angles. The angle of incidence along with the determined relationship between the angle of incidence and the
measurement intensity of the spectral measurement may be stored so the ambient light source(s) 1 07 may be used to correct the spectral measurements of the ambient light source(s) 107. FIG. 5 illustrates a system for obtaining calibrated spectral images and/or measurements of a target, in accordance with one or more implementations. One aspect of the present disclosure relates to a system 500 for obtaining calibrated spectral images and/or measurements. The system 500 may comprise one or more data connections 502 configured to electronically connect to one or more electronic data storage mediums 504 and/or one or more sensors 508, on an aerial vehicle 506. The one or more data connections 502 may be wired and/or wireless connections. The data connection(s) 502 may be configured to continuously provide data from the electronic storage mediums and/or the sensors on the aerial vehicle 506. The data connection(s) 502 may be configured to periodically provide data from the electronic storage 504 and/or the sensors 508 on the aerial vehicle 506. The data connection(s) 502 may be configured to provide data from the electronic storage 504 and/or the sensors on the aerial vehicle 506 when connected to devices configured to retrieve the data, wherein the devices download all, substantially all, or select portions, of the data. The electronic data storage 504 may be configured to store spectral measurements of a target taken from an aerial vehicle 506. The electronic storage 504 may be configured to store spectral measurements of one or more ambient light sources.
(90) The system 500 may comprise one or more physical computer processors 510 configured by machine-readable instructions to perform the functions of one or more computer components. The one or more computer components may comprise a calibration component 51 2, an environmental component 514, a theoretical model component 516, an output component 518, and/or other components.
(91 ) The processor 510 may provide processing capabilities to the system 500. The processor 510 may include one or more of a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information. Although processor 510 is shown in FIG. 5 as a single entity, this is for illustrative purposes only. In some implementations, processor 510 may include a plurality of processing units. These processing units may be physically located within the same device, or processor 510 may represent processing functionality of a plurality of devices operating in coordination. The processor 510 may be configured to execute components 512, 514, 516, 518, and/or other components. Processor 510 may be configured to execute components 512, 514, 516, 51 8, and/or other components by software; hardware; firmware; some combination of software, hardware, and/or firmware; and/or other mechanisms for configuring processing capabilities on processor 510.
(92) It should be appreciated that although components 512, 514, 516, and 51 8 are illustrated in FIG. 5 as being co-located within a single processing unit, in implementations in which processor 510 includes multiple processing units, one or more of components 512, 514, 51 6, 51 8, and/or other components may be located remotely from the other components. The description of the functionality provided by the different components 512, 514, 516, 51 8, and/or other components described below is for illustrative purposes, and is not intended to be limiting, as any of components 512, 514, 51 6, 518, and/or other components may provide more or less functionality than is described. For example, one or more of components 512, 514, 516, 518, and/or other components may be eliminated, and some or all of its functionality may be provided by other ones of components 51 2, 514, 516, 51 8, and/or other components. As another example, processor 510 may be configured to execute one or more additional modules that may perform some or all of the functionality attributed below to one of modules 512, 514, 516, 518, and/or other components.
(93) The calibration component 512 may be configured to determine sets of calibration values for the spectral measurements of the target. The sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources.
(94) The environmental component 514 may be configured to obtain sets of environmental parameters associated with the spectral measurements of the target and the spectral measurements of the one or more ambient light sources. The environmental parameters may include temperature measurements of and/or adjacent to the multiple photo sensors configured to obtain spectral measurements of the one or more ambient light sources. Temperature measurements of the photo sensors may be obtained to correct for thermal responsivity effects of the photo sensors. The temperature measurements may be obtained by one or more sensors 508 on the aerial vehicle 506. (95) The environmental parameters may include one or more of the geographical location, the altitude, the transmission properties of the optics, the responsivity properties of the photo sensors, and/or other environmental parameters. The environmental parameters may include one or more of the time of year the measurements were taken, the time of day the measurements were taken, the atmospheric properties at the time the measurements were taken, and/or other environmental parameters.
(96) The environmental parameter information may be obtained from one or more sensors 508. The sensors may be mounted on the aerial vehicle 506. The sensors may be external to the aerial vehicle 506. For example, the sensors may be on the ground, on other aerial vehicles, and/or in locations remote from where the measurements are being taken. The environmental parameter information may be obtained from external resources 520. External resources 520 may be one or more local sensors 508. External resources 520 may be information entered into the system by a user. The external resources 520 may be databases in electronic communication with the system 500. For example, the external resources may be national weather service information, atmospheric information, and/or other information available from external sources.
(97) The theoretical model component 516 may be configured to determine a theoretical irradiance model for the target based on the obtained sets of
environmental parameters. The theoretical model component 516 may be configured to determine the theoretical irradiance model for the target based on an atmospheric transmission model.
(98) The calibration value component 512 may be configured to determine sets of calibration values for the spectral measurements of the target. The sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources and the theoretical irradiance model for the target, which itself is based on the obtained environmental parameters associated with the measurements.
(99) The calibration value component 512 may be configured to determine a calibration value for individual ones of the spectral measurements of the target. For example, where the spectral imaging devices are configured to obtain spectral measurements of a target in a first set of spectral frequency ranges and/or bands, a calibration value may be determined for individual ones of the spectral frequency ranges and/or bands in the first set of spectral frequency ranges and/or bands.
(1 00) The calibration value component 512 may be configured to scale the spectral measurements of the target with the determined sets of calibration values. Scaling the spectral measurements of the target with the determined sets of calibration values may provide spectral measurements of the target that are independent, or nearly independent, of ambient light illumination conditions.
(1 01 ) The output component 51 8 may be configured to provide one or more outputs of data comprising the scaled spectral measurements of the target. The outputted data may be used to deduce and/or obtain information about the target.
(1 02) The one or more electronic data connections 502 may be configured to obtain time data from the electronic storage 504. The time data may be associated with the spectral measurements of the target and the spectral measurements of the one or more ambient light sources.
(1 03) FIG. 6 illustrates a method 600 for calibrating spectral measurements of a target, in accordance with one or more implementations. FIG. 7 illustrates a method 700 for calibrating spectral measurements of a target, in accordance with one or more implementations. FIG. 8, illustrates a method 800 for calibrating obtained spectral measurement data, in accordance with one or more implementations. The operations of methods 600, 700, and 800 presented below are intended to be illustrative. In some embodiments, methods 600, 700, and 800 may be
accomplished with one or more additional operations not described, and/or without one or more of the operations discussed, and/or in combination with each other. Additionally, the order in which the operations of methods 600, 700, and 800 are illustrated in FIGs. 6, 7, and 8, respectively, and described below, are not intended to be limiting.
(1 04) In some embodiments, methods 600, 700, and 800 may be implemented in one or more processing devices (e.g., a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information). The one or more processing devices may include one or more devices executing some or all of the operations of methods 600, 700, and 800 in response to instructions stored electronically on an electronic storage medium. The one or more processing devices may include one or more devices configured through hardware, firmware, and/or software to be specifically designed for execution of one or more of the operations of methods 600, 700, and 800. In some embodiments, methods 600, 700, and 800 may be implemented in combinations of one or more processing devices, machines, human interaction, and/or by other elements capable of carrying out the operations of methods 600, 700, and 800.
(1 05) With reference to FIG. 6, at an operation 602 spectral measurements of a target from an aerial vehicle may be obtained. The target may be vegetation, infrastructure, water, land, and/or any target of which it is desirous to obtain spectral measurements. The target may be illuminated by one or more ambient light sources. The spectral measurements may include a first set of measurements of the target. The first set of measurements of the target may include a spectral measurement of the target taken at a first spectral frequency range. The first set of measurements of the target may include a spectral measurement of the target taken at a second, third, fourth, fifth, or more, spectral frequency ranges.
(1 06) At an operation 604, the method may comprise obtaining spectral
measurements of the one or more ambient light sources from the aerial vehicle. The individual ones of the spectral measurements of the ambient light source(s) may have a peak response parameter range approximate to the frequency ranges of individual ones of the first set of spectral frequency ranges. For example, a first spectral measurement of the ambient light source(s) may have a peak response parameter range approximate to the first spectral frequency range of the first set of spectral measurements of the target. A second spectral measurement of the ambient light source(s) may have a peak response parameter range approximate to the second spectral frequency range of the first set of spectral measurements of the target. The obtained spectral measurements of the one or more ambient light sources may be used during calibration of the obtained spectral measurements of the target, such that the first set of measurements of the target are scaled based on the first spectral measurement of the ambient light source(s) and the second spectral measurement of the ambient light source(s).
(1 07) At operations 602 and 604, the obtained spectral measurements of the target and the obtained spectral measurements of the one or more ambient light sources may be received into electronic storage, such that the electronic storage receives the first set of measurements of the target and the first set of measurements of the ambient light source.
(1 08) At an operation 606, time data associated with the obtained spectral measurements of the target and/or the ambient light source (s) may be obtained. For example, a first set of time data may be obtained for the first set of
measurements of the target and/or the first set of spectral measurements of the ambient light source(s). At the operation 606, time data associated with the obtained measurements and/or observations of all sensors may be obtained. The time data may be obtained individually for the individual sensors. A single set of time data may be obtained for all measurements and/or observations taken concurrently, or near concurrently.
(1 09) The method 600 may comprise obtaining any number of spectral
measurements at any number of frequency ranges, wherein the sensors have peak response frequencies within the frequency ranges. For example, the first set of spectral measurements of the target may comprise obtaining a third, fourth, fifth, and/or more spectral measurements of the target(s) and/or ambient light source(s) over a third, fourth, fifth, and/or more discrete frequency ranges. The third, fourth, fifth, and/or more sets of spectral measurements may be taken by sensor(s) having peak response frequencies within a third, fourth, fifth, and/or more spectral frequency ranges. The first, second, third, fourth, fifth, and/or other spectral frequency ranges may be different. The first, second, third, fourth, fifth, and/or other spectral frequency ranges may be overlapping, wherein individual ones of the spectral frequency ranges overlap one or more others of the individual ones of the spectral frequency ranges.
(1 10) At an operation 608, sets of environmental parameters associated with the spectral measurements of the target and/or the spectral measurements of the one or more ambient light sources may be obtained. The environmental parameters obtained may be the environmental parameters disclosed herein.
(1 1 1 ) At an operation 61 0 the calibration values for the spectral measurements of the target may be calculated. The operations conducted at operation 610 may be performed by a calibration value component, such as calibration value component 612.
(1 12) At an operation 61 2, spectral measurements of the target may be calibrated. At the operation 61 2, the theoretical irradiance model for the target based on the obtained sets of environmental parameters may be determined. At the operation 612, sets of calibration values may be determined for the spectral measurements of the target, wherein the sets of calibration values are determined based on the obtained spectral measurements of the one or more ambient light sources and the theoretical irradiance model for the target.
(1 13) At an operation 614, information about the target may be provided based on the calibrated spectral information of the target.
(1 14) Referring to FIG. 7, another aspect of the disclosure relates to a method 700 for calibrating spectral imaging measurements. At an operation 702, spectral measurements of a target and spectral measurements of one or more ambient light sources may be obtained from an aerial vehicle, over one or more data connections.
(1 15) At an operation 704, environmental information about the obtained spectral measurements may be obtained. The environmental information may be obtained from one or more local sensors and/or from one or more external resources as described above. (1 16) At an operation 706, sets of calibration values for the spectral measurements of the target may be determined. The sets of calibration values may be determined by one or more processors. The sets of calibration values may be determined based on the obtained spectral measurements of the one or more ambient light sources. The sets of calibration values may be determined based on the obtained
environmental information associated with the spectral measurements.
(1 17) At an operation 708, the spectral measurements of the target may be scaled with the determined sets of calibration values.
(1 18) FIG. 8 illustrates a method 800 of analyzing data of spectral measurements in accordance with one or more implementations.
(1 19) At an operation 802, spectral measurement data associated with a target may be obtained. At an operation 804, spectral measurement data associated with one or more ambient light sources may be obtained. At an operation 806, environmental information associated with the target and/or ambient light source(s) may be obtained. At an operation 808, time data associated with the spectral measurements of the target and/or ambient light source(s), and/or other measurements, may be obtained.
(1 20) The data obtained at operations 802, 804, 806, 808, and/or other data, may be obtained from electronic storage, such as electronic storage 126. The data obtained at operation 802, 804, 806, 808, and/or other data, may be obtained over one or more electronic connections, such as hard-wired electronic connections, wireless electronic connections, and/or other electronic connections. The data obtained at operation 802, 804, 806, 808, and/or other data, may be obtained at a client computing device, such as a laptop, desktop, handheld device, smart device, and/or other client computing device. The data obtained at operation 802, 804, 806, 808, and/or other data, may be obtained at a server remote from the client computing device.
(1 21 ) At an operation 81 0, sets of calibration values for the obtained spectral measurement data of one or more targets may be determined. At an operation 812, sets of calibration values for the theoretical model associated with the target may be obtained. At an operation 814, the spectral measurements of the target may be scaled based on the determined calibration values. Operations 810, 812, 814, and/or other operations, may be performed by a client device in electronic communication with the electronic storage device associated with an aircraft.
Operations 810, 812, 814, and/or other operations, may be performed by a server. The operations 810, 812, 814, and/or other operations, may be performed by a service provider remote from the aircraft and/or the client computing device(s) associated with the user of the aircraft.
(1 22) Although the present technology has been described in detail for the purpose of illustration based on what is currently considered to be the most practical and preferred implementations, it is to be understood that such detail is solely for that purpose and that the technology is not limited to the disclosed implementations, but, on the contrary, is intended to cover modifications and equivalent arrangements that are within the spirit and scope of the appended claims. For example, it is to be understood that the present technology contemplates that, to the extent possible, one or more features of any implementation can be combined with one or more features of any other implementation.

Claims

What is claimed is:
1 . A system for obtaining calibrated spectral measurements of a target, the
system comprising:
an aerial vehicle;
at least one spectral imaging device configured to obtain spectral measurements of a target wherein the target is at least partially illuminated by one or more ambient light sources, such that a first set of target spectral measurements are obtained for a target;
one or more photo sensors configured to obtain spectral measurements of the one or more ambient light sources, wherein the one or more photo sensors have peak responses approximate to a first set of discrete spectral frequency ranges and are configured to obtain a first set of ambient light spectral measurements of the one or more ambient light sources at individual ones of the first set of discrete spectral frequency ranges, wherein the one or more photo sensors comprise a first photo sensor having a peak response approximate to a first spectral frequency range of the first set of discrete spectral frequency ranges and is configured to obtain a first spectral measurement of the one or more ambient light sources over the first spectral frequency range;
wherein the obtained spectral measurements of the one or more ambient light sources are used to calibrate the obtained spectral
measurements of the target, such that the first set of target spectral measurements are calibrated based on the first set of ambient light spectral measurements.
The system of claim 1 , wherein the spectral measurements of the target include measurements spanning over the first set of discrete frequency ranges, such that the one or more photo sensors have peak response frequency ranges approximate to the discrete frequency ranges included the spectral measurements of the target.
3. The system of claim 1 , further comprising a time component configured to obtain time information associated with the one or more spectral
measurements of the target and the one or more spectral measurements of the one or more ambient light sources.
4. The system of claim 3, wherein:
the at least one spectral imaging device is configured to obtain a first set of spectral measurements of the target across the first set of spectral frequency ranges at a first time and is configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time; and,
the one or more photo sensors are configured to obtain a first set of spectral measurements of the one or more ambient light sources across the first set of spectral frequency ranges at the first time and are configured to obtain a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time, such that the first set of spectral measurements of the target are calibrated based on the first set of spectral measurements of the ambient light source(s), and the second set of spectral measurements of the target are calibrated based on the second set of spectral measurements of the ambient light source(s).
The system of claim 1 , further comprising an environmental parameter component configured to obtain environmental parameter information associated with the spectral measurements of the target and/or the spectral measurements of the ambient light source(s), such that the spectral measurements of the target are calibrated using the obtained environmental parameter information.
The system of claim 5, wherein the environment parameter component is configured to obtain environmental parameter information from one or more of external resources, measurements obtained by the at least one spectral imaging device, and/or measurements obtained by the one or more photo sensors.
The system of claim 1 , wherein the at least one spectral imaging device is configured to obtain measurements of the target over spectral frequency ranges spanning across one or more of the ultraviolet, visible, near infrared, and/or infrared regions of the electromagnetic spectrum.
The system of claim 1 , wherein the photo sensors configured to obtain spectral measurements of the one or more ambient light sources are comprised of photodiodes, wherein individual ones of the photodiodes are selected for its responsivity within individual ones of the discrete spectral frequency ranges.
9. The system of claim 1 , wherein the photo sensors configured to obtain spectral measurements of the one or more ambient light sources are comprised of light-emitting diodes (LEDs), wherein individual ones of the LEDs are selected for its responsivity within individual ones of the discrete spectral frequency ranges.
10. The system of claim 1 , wherein the first set of spectral frequency ranges
further includes a second discrete frequency range, a third discrete frequency range and a fifth discrete frequency range, and the photo sensors configured to obtain spectral frequency measurements of the one or more ambient light sources, include:
a second photo sensor having a peak response range approximate to a second spectral frequency range;
a third photo sensor having a peak response range approximate to a third spectral frequency range;
a fourth photo sensor having a peak response range approximate to a fourth spectral frequency range; and,
a fifth photo sensor having a peak response range approximate to a fifth spectral frequency range.
1 1 . A method for obtaining calibrated images of a target area, the method
comprising:
obtaining spectral measurements of a target wherein the target is at least partially illuminated by one or more ambient light sources, such that a first set of target spectral measurements are obtained for the target; obtaining spectral measurements of the one or more ambient light sources, such that a first set of ambient light spectral measurements are obtained, wherein the first set of ambient light spectral measurements comprise spectral measurements of the one or more ambient light sources across a first set of discrete spectral frequency ranges, and,
wherein the obtained spectral measurements of the one or more ambient light sources are used to calibrate the obtained spectral
measurements of the target, such that the first set of target spectral measurements are calibrated based on the first set of ambient light spectral measurements.
12. The method of claim 1 1 , wherein the spectral measurements of the target include measurements spanning over the first set of discrete frequency ranges, such that the one or more photo sensors have peak response frequency ranges approximate to the discrete frequency ranges included in the spectral measurements of the target.
13. The method of claim 1 1 , further comprising obtaining time information
associated with the one or more spectral measurements of the target and the one or more spectral measurements of the one or more ambient light sources.
14. The method of claim 1 1 , further comprising:
obtaining a first set of spectral measurements of the target across the first set of spectral frequency ranges at a first time; obtaining a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time;
obtaining a first set of spectral measurements of the one or more ambient light sources across the first set of spectral frequency ranges at the first time; and,
obtaining a second set of spectral measurements of the target across the first set of spectral frequency ranges at a second time such that the first set of spectral measurements of the target are calibrated based on the first set of spectral measurements of the ambient light source(s), and the second set of spectral measurements of the target are calibrated based on the second set of spectral measurements of the ambient light source(s).
15. The method of claim 1 1 , further comprising obtaining environmental
parameter information associated with the spectral measurements of the target and/or the spectral measurements of the ambient light source(s), such that the spectral measurements of the target are calibrated using the obtained environmental parameter information.
16. The method of claim 15, further comprising obtaining environmental
parameter information from one or more of external resources, the obtained spectral measurements of the target, and/or the obtained spectral measurements of the ambient light source(s).
17. The method of claim 1 1 , further comprising obtaining measurements of the target over spectral frequency ranges spanning across one or more of the ultraviolet, visible, near infrared, and/or infrared regions of the electromagnetic spectrum.
18. The method of claim 1 1 , wherein obtaining spectral measurements of the one or more ambient light sources is performed by one or more photo sensors, and the one or more the photo sensors are comprised of light-emitting diodes (LEDs), wherein individual ones of the LEDs are selected for its responsivity within individual ones of the discrete spectral frequency ranges.
19. The method of claim 1 1 , wherein the first set of spectral frequency ranges further includes a second discrete frequency range, a third discrete frequency range and a fifth discrete frequency range, and the photo sensors configured to obtain spectral frequency measurements of the one or more ambient light sources include a second photo sensor, a third photo sensor, a fourth photo sensor, and a fifth photo sensor configured to obtain spectral measurements of the one or more ambient light sources over the second, third, fourth, and fifth discrete frequency ranges, respectively, such that the obtained spectral measurements of the target are calibrated using measurements of the ambient light source(s) obtained over the first, second, third, fourth, and fifth spectral frequency ranges.
20. A method for calibrating spectral measurements of a target, the method
comprising: obtaining target spectral measurement data associated with one or more targets, wherein the target spectral measurement data was measured from an aerial vehicle;
obtaining ambient light spectral measurement data associated with one or more ambient light sources wherein the ambient light spectral
measurement data was measured from an aerial vehicle;
determining sets of calibration values for the obtained target spectral measurement data based on the obtained ambient light spectral
measurement data;
scaling the obtained target spectral measurement data with the determined sets of calibration values to provide calibrated spectral measurements of the one or more targets.
The method of claim 20, wherein the obtained target spectral measurement data comprises spectral measurement data associated with a first set of spectral frequency ranges, and the obtained ambient light spectral measurement data comprises spectral measurement data associated with the first set of spectral frequency ranges, and wherein the step of determining the sets of calibration values for the obtained target spectral measurement data further comprises:
determine individual ones of the sets of calibration values based on the spectral measurement data associated with individual ones of the first set of spectral frequency ranges. The method of claim 20, wherein the target spectral measurement data and the ambient light spectral measurement data are obtained by a server remote from the source of the target spectral measurement data and the ambient light spectral measurement data.
PCT/US2015/048928 2014-09-08 2015-09-08 System and method for calibrating imaging measurements taken from aerial vehicles WO2016040316A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
ES15839458T ES2886556T3 (en) 2014-09-08 2015-09-08 System and method for calibrating measurements of images taken from aerial vehicles
AU2015315327A AU2015315327B2 (en) 2014-09-08 2015-09-08 System and method for calibrating imaging measurements taken from aerial vehicles
CA2960375A CA2960375C (en) 2014-09-08 2015-09-08 System and method for calibrating imaging measurements taken from aerial vehicles
EP15839458.5A EP3192260B1 (en) 2014-09-08 2015-09-08 System and method for calibrating imaging measurements taken from aerial vehicles

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/480,565 US9470579B2 (en) 2014-09-08 2014-09-08 System and method for calibrating imaging measurements taken from aerial vehicles
US14/480,565 2014-09-08

Publications (1)

Publication Number Publication Date
WO2016040316A1 true WO2016040316A1 (en) 2016-03-17

Family

ID=55437245

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/048928 WO2016040316A1 (en) 2014-09-08 2015-09-08 System and method for calibrating imaging measurements taken from aerial vehicles

Country Status (6)

Country Link
US (2) US9470579B2 (en)
EP (1) EP3192260B1 (en)
AU (1) AU2015315327B2 (en)
CA (2) CA2960375C (en)
ES (1) ES2886556T3 (en)
WO (1) WO2016040316A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110057451A (en) * 2019-05-30 2019-07-26 深圳市道创智能创新科技有限公司 Multispectral data acquisition system and method
US11290623B2 (en) 2017-01-17 2022-03-29 Micasense, Inc. Multi-sensor irradiance estimation

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10753860B2 (en) * 2015-07-10 2020-08-25 Sony Corporation Inspection apparatus, inspection method, and program
US10386295B2 (en) * 2015-07-28 2019-08-20 Panasonic Intellectual Property Management Co., Ltd. Vegetation index calculation method and vegetation index calculation device
US10585210B2 (en) * 2015-10-06 2020-03-10 Arable Labs, Inc. Apparatus for radiometric correction and orthorectification of aerial imagery
US9996905B2 (en) * 2016-03-16 2018-06-12 Planet Labs, Inc. Systems and methods for enhancing object visibility for overhead imaging
FR3052556B1 (en) * 2016-06-13 2018-07-06 Parrot Drones IMAGING ASSEMBLY FOR DRONE AND SYSTEM COMPRISING SUCH AN ASSEMBLY MOUNTED ON A FLYING DRONE
EP3485244A4 (en) * 2016-07-14 2020-02-26 Commonwealth Scientific and Industrial Research Organisation Apparatus for measuring spectra
US10444071B1 (en) * 2016-08-31 2019-10-15 Northrop Grumman Systems Corporation Calibration target for image sensor
US10928245B2 (en) * 2016-09-15 2021-02-23 Siteco Gmbh Light measurement using an autonomous vehicle
US20180206475A1 (en) * 2017-01-20 2018-07-26 Mark A. Carter Chemical application detection system and mobile visual sensing technology
US10352769B2 (en) * 2017-03-31 2019-07-16 The Boeing Company Self-calibrating spectral models
CN108151875A (en) * 2017-12-21 2018-06-12 长春理工大学 For the calibration method of the High Precision Automatic caliberating device of sunshine recorder
CN108362374B (en) * 2018-01-15 2020-12-25 中国科学院合肥物质科学研究院 On-site spectral calibration and radiometric calibration method for field hyperspectral irradiance instrument
US11116145B2 (en) 2018-03-30 2021-09-14 Greensight Argonomics, Inc. Automated optimization of agricultural treatments based on raster image data system
US11235874B2 (en) 2018-03-30 2022-02-01 Greensight Agronomics, Inc. Automated drone-based spraying system
US11205073B2 (en) 2018-03-30 2021-12-21 Greensight Agronomics, Inc. System to automatically detect and report changes over time in a large imaging data set
JP6798073B2 (en) * 2019-06-04 2020-12-09 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Mobile body and sensor unit
CN110411565B (en) * 2019-07-05 2021-08-03 中国船舶重工集团公司第七一六研究所 Method for deducing high-spectrum earth surface reflectivity from multi-spectrum earth surface reflectivity
US11411823B2 (en) 2019-09-20 2022-08-09 Sonatus, Inc. System, method, and apparatus to support mixed network communications on a vehicle
US11538287B2 (en) * 2019-09-20 2022-12-27 Sonatus, Inc. System, method, and apparatus for managing vehicle data collection
TWI724764B (en) * 2020-01-21 2021-04-11 國立臺灣大學 Spectral imaging device
CN113108909B (en) * 2021-04-14 2022-12-02 长光禹辰信息技术与装备(青岛)有限公司 Spectral imaging device and correction method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3392645A (en) * 1965-11-29 1968-07-16 Neasham Robert Stevenson Spectral-zonal photographic system
US20020041377A1 (en) * 2000-04-25 2002-04-11 Nikon Corporation Aerial image measurement method and unit, optical properties measurement method and unit, adjustment method of projection optical system, exposure method and apparatus, making method of exposure apparatus, and device manufacturing method
US6422508B1 (en) * 2000-04-05 2002-07-23 Galileo Group, Inc. System for robotic control of imaging data having a steerable gimbal mounted spectral sensor and methods
US20070046448A1 (en) * 2002-09-20 2007-03-01 M7 Visual Intelligence Vehicle based data collection and processing system and imaging sensor system and methods thereof
US20070200052A1 (en) * 2006-01-07 2007-08-30 Leica Microsystems Cms Gmbh Apparatus, microscope with an apparatus, and method for calibration of a photosensor chip
US20140132778A1 (en) * 1996-02-26 2014-05-15 Rah Color Technologies Llc Color calibration of color image rendering devices

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3638026A (en) 1970-06-29 1972-01-25 Honeywell Inc Or photovoltaic device
US4128760A (en) 1977-04-07 1978-12-05 Ncr Corporation Ambient light compensating circuit
US4799044A (en) 1986-02-18 1989-01-17 Amp Incorporated Phototransistor apparatus with current injection ambient compensation
JP3038810B2 (en) * 1990-06-15 2000-05-08 日本電気株式会社 Observation spectrometer
US6160902A (en) * 1997-10-10 2000-12-12 Case Corporation Method for monitoring nitrogen status using a multi-spectral imaging system
US20010016053A1 (en) * 1997-10-10 2001-08-23 Monte A. Dickson Multi-spectral imaging sensor
FI112402B (en) 1999-10-28 2003-11-28 Diware Oy Method for determining the characteristics of tree stocks and computer programs for performing the procedure
US7088261B2 (en) 2000-08-29 2006-08-08 Lailai Capital Corp. Traffic signal light having ambient light detection
US7346217B1 (en) 2001-04-25 2008-03-18 Lockheed Martin Corporation Digital image enhancement using successive zoom images
US7286261B2 (en) * 2001-10-02 2007-10-23 Hewlett-Packard Development Company, L.P. Color calibration color value correction
US7639842B2 (en) 2002-05-03 2009-12-29 Imagetree Corp. Remote sensing and probabilistic sampling based forest inventory method
US7103451B2 (en) 2002-08-19 2006-09-05 Intime, Inc. Method and system for spatially variable rate application of agricultural chemicals based on remotely sensed vegetation data
CA2547359C (en) * 2003-11-26 2012-11-27 Florida Environmental Research Institute, Inc. Spectral imaging system
US20050205758A1 (en) 2004-03-19 2005-09-22 Almeida Leo A Method and apparatus for multi-spectral photodetection
US6963405B1 (en) * 2004-07-19 2005-11-08 Itt Manufacturing Enterprises, Inc. Laser counter-measure using fourier transform imaging spectrometers
WO2006102640A2 (en) * 2005-03-24 2006-09-28 Infotonics Technology Center, Inc. Hyperspectral imaging system and methods thereof
US7580591B2 (en) 2005-07-01 2009-08-25 The Boeing Company Method for generating a synthetic perspective image
WO2008012812A2 (en) * 2006-07-24 2008-01-31 Hyspec Imaging Ltd. Snapshot spectral imaging systems and methods
US20080178653A1 (en) * 2007-01-29 2008-07-31 Applera Corporation System and Method for Interpolative Calibration
US7768645B2 (en) * 2007-11-20 2010-08-03 Siemens Healthcare Diagnostics Inc. Miniature optical readhead and colorimeter for analysis media
US8352105B2 (en) 2009-02-13 2013-01-08 The Boeing Company Unmanned underwater vehicle integrated radiation detection system
EP2264433A1 (en) * 2009-06-16 2010-12-22 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO A method and system for the remote quantitative detection of compounds in the atmosphere
US8174693B1 (en) * 2009-08-18 2012-05-08 Exelis, Inc. Calibration optic for a solar/earth spectrometer
GB0916883D0 (en) 2009-09-25 2009-11-11 St Microelectronics Ltd Ambient light detection
US8157032B2 (en) 2010-04-06 2012-04-17 Robotex Inc. Robotic system and method of use
US8665340B2 (en) * 2010-04-29 2014-03-04 Intellectual Ventures Fund 83 Llc Indoor/outdoor scene detection using GPS
JP5879745B2 (en) * 2011-05-20 2016-03-08 セイコーエプソン株式会社 Spectral estimation parameter generation apparatus and method, and computer program
US8583296B2 (en) 2011-05-21 2013-11-12 University Of Kansas Low-altitude altimeter and method
US20120321321A1 (en) * 2011-06-14 2012-12-20 Scott Riesebosch Methods of communication utilizing an led lamp
US8872093B2 (en) * 2012-04-18 2014-10-28 Apple Inc. Calibrated image-sensor-based ambient light sensor
US20140022381A1 (en) * 2012-07-17 2014-01-23 Tetracam, Inc. Radiometric multi-spectral or hyperspectral camera array using matched area sensors and a calibrated ambient light collection device
US8989501B2 (en) * 2012-08-17 2015-03-24 Ge Aviation Systems Llc Method of selecting an algorithm for use in processing hyperspectral data
US20140055784A1 (en) * 2012-08-23 2014-02-27 Logos Technologies, Llc Camera system for capturing two-dimensional spatial information and hyper-spectral information

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3392645A (en) * 1965-11-29 1968-07-16 Neasham Robert Stevenson Spectral-zonal photographic system
US20140132778A1 (en) * 1996-02-26 2014-05-15 Rah Color Technologies Llc Color calibration of color image rendering devices
US6422508B1 (en) * 2000-04-05 2002-07-23 Galileo Group, Inc. System for robotic control of imaging data having a steerable gimbal mounted spectral sensor and methods
US20020041377A1 (en) * 2000-04-25 2002-04-11 Nikon Corporation Aerial image measurement method and unit, optical properties measurement method and unit, adjustment method of projection optical system, exposure method and apparatus, making method of exposure apparatus, and device manufacturing method
US20070046448A1 (en) * 2002-09-20 2007-03-01 M7 Visual Intelligence Vehicle based data collection and processing system and imaging sensor system and methods thereof
US20070200052A1 (en) * 2006-01-07 2007-08-30 Leica Microsystems Cms Gmbh Apparatus, microscope with an apparatus, and method for calibration of a photosensor chip

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3192260A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11290623B2 (en) 2017-01-17 2022-03-29 Micasense, Inc. Multi-sensor irradiance estimation
CN110057451A (en) * 2019-05-30 2019-07-26 深圳市道创智能创新科技有限公司 Multispectral data acquisition system and method

Also Published As

Publication number Publication date
US20170010155A1 (en) 2017-01-12
CA2960375A1 (en) 2016-03-17
AU2015315327B2 (en) 2018-07-26
CA2960375C (en) 2019-07-30
EP3192260A1 (en) 2017-07-19
CA3046667C (en) 2020-02-11
AU2015315327A1 (en) 2017-03-23
US20160069741A1 (en) 2016-03-10
US9470579B2 (en) 2016-10-18
EP3192260B1 (en) 2021-08-04
US9791316B2 (en) 2017-10-17
EP3192260A4 (en) 2018-07-04
CA3046667A1 (en) 2016-03-17
ES2886556T3 (en) 2021-12-20

Similar Documents

Publication Publication Date Title
US9791316B2 (en) System and method for calibrating imaging measurements taken from aerial vehicles
Zhong et al. Mini-UAV-borne hyperspectral remote sensing: From observation and processing to applications
CN107807125B (en) Plant information calculation system and method based on unmanned aerial vehicle-mounted multispectral sensor
US10339639B2 (en) Method and system of calibrating a multispectral camera on an aerial vehicle
Stroppiana et al. Rice yield estimation using multispectral data from UAV: A preliminary experiment in northern Italy
US10585210B2 (en) Apparatus for radiometric correction and orthorectification of aerial imagery
Miyoshi et al. Radiometric block adjustment of hyperspectral image blocks in the Brazilian environment
Grenzdörffer et al. UAV based BRDF-measurements of agricultural surfaces with pfiffikus
CN108120510B (en) On-orbit absolute radiation calibration method of optical remote sensor based on reflector array
Aasen et al. Introduction and preliminary results of a calibration for full-frame hyperspectral cameras to monitor agricultural crops with UAVs
Bruegge et al. PARABOLA III: A sphere‐scanning radiometer for field determination of surface anisotropic reflectance functions
Saari et al. Novel hyperspectral imager for lightweight UAVs
JPWO2019017095A1 (en) Information processing apparatus, information processing method, program, information processing system
Gautam et al. Footprint determination of a spectroradiometer mounted on an unmanned aircraft system
FR3006296A1 (en) DRONE COMPRISING A MULTISPECTRAL IMAGE DEVICE FOR THE GENERATION OF MAPS REPRESENTING A PLANT STATE OF A CULTURE
de Oca et al. A UAS equipped with a thermal imaging system with temperature calibration for crop water stress index computation
US20170316282A1 (en) Systems and methods for object classification and selective compression in aerial imagery
Tsouvaltsidis et al. Remote spectral imaging using a low cost UAV system
Pölönen et al. UAV-based hyperspectral monitoring of small freshwater area
Honkavaara et al. Geometric and reflectance signature characterization of complex canopies using hyperspectral stereoscopic images from uav and terrestrial platforms
Gilliot et al. Correction of in-flight luminosity variations in multispectral UAS images, using a luminosity sensor and camera pair for improved biomass estimation in precision agriculture
Khalesi et al. UAV in precision agriculture: a preliminary assessment of uncertainty for vegetation health index
Arad et al. Towards, Multi-purpose system for spatial and hyperspectral sampling of crop from a moving platform
Okamura et al. In-orbit observation of the Second Generation Global Imager (SGLI) and study towards follow-on imaging radiometer
Kappus et al. Hyperspectral imager for the coastal ocean on the international space station

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15839458

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2960375

Country of ref document: CA

REEP Request for entry into the european phase

Ref document number: 2015839458

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015839458

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2015315327

Country of ref document: AU

Date of ref document: 20150908

Kind code of ref document: A