WO2014140135A1 - Emergency photo function and portable device including such an emergency photo function - Google Patents

Emergency photo function and portable device including such an emergency photo function Download PDF

Info

Publication number
WO2014140135A1
WO2014140135A1 PCT/EP2014/054893 EP2014054893W WO2014140135A1 WO 2014140135 A1 WO2014140135 A1 WO 2014140135A1 EP 2014054893 W EP2014054893 W EP 2014054893W WO 2014140135 A1 WO2014140135 A1 WO 2014140135A1
Authority
WO
WIPO (PCT)
Prior art keywords
remote device
user
digital representation
image
emergency
Prior art date
Application number
PCT/EP2014/054893
Other languages
French (fr)
Inventor
Donald Spencer
Original Assignee
Donald Spencer
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Donald Spencer filed Critical Donald Spencer
Publication of WO2014140135A1 publication Critical patent/WO2014140135A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/90Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Definitions

  • the present invention concerns an emergency photo function and a portable device including such an emergency photo function.
  • a portable device which includes a special emergency photo function.
  • an image or picture is taken using a portable device and that the image or picture is sent out as quickly as possible.
  • a possible act of violence, demolition or disintegration of the device cannot stop the image or picture.
  • acts of divulgals against the user of the device threats or fisticuffs do not help, since the user cannot delete the image or picture from the device nor can he or she delete the image or picture from the server to which it was sent.
  • the respective server is set up so that an incoming image or picture is kept for a certain period of time (e.g. 1 year). Neither the user nor any third party can cause the image or picture to be deleted.
  • the remote server provides an interface for a user of the invention to define certain settings.
  • the access to the server is thus protected by a combination of a user name and a password or by some other security feature(s). Since the portable device of the invention has to be enabled in order to send an image or picture to the server, the server is to be set up so that the respective image or picture is associated with the user's account. If one would store the user name and password or the other security feature(s) inside the portable device, then there is the risk that this access
  • the portable device in preferred embodiments of the invention thus comprises an access code (like an entry ticket) which basically can only be used in a one-way direction for the uploading of an image or picture.
  • the access code (like an entry ticket) has a time-out function and/or a counter.
  • the system can be set up or the user can set up the system so that for instance a maximum of 10 images or pictures can be uploaded using a given access code.
  • the user has to use his regular user name and password or some other security feature(s) to access the server.
  • another access code is issued and stored in the portable device or the counter of the original access code is reset.
  • the emergency photo function (called Snap'n'TrapTM) is a personal, defensive, incident photographing and recording system installed into a portable device (e.g. installed into the operating software of wireless Cellphones
  • the emergency photo function (called Snap'n'TrapTM) is implemented inside a camera device so that it able to by-pass other (basic) functions of the camera device.
  • This implementation can be carried out in hardware, software or by a combination of hardware and software.
  • the emergency photo function are implemented by means of hardware, preferably inside a communication chip, so as to ensure that the emergency photo function can be used even if the camera device is in an idle state or if certain communication function are blocked (e.g. if the roaming function of a phone is switched off).
  • the communication chip e.g. a special CPU core
  • the communication chip enables the taking of pictures and it ensures the queuing and sending of pictures or images.
  • the communication chip might use a standard
  • communication channels e.g. a UTMS or GMS channel
  • a dedicated emergency channel e.g. a UTMS or GMS channel
  • the dedicated button or icon must be always prominent on switching on the portable device (no drop down menus or searching for icons).
  • the emergency photo function inbuilt software/code will immediately commence taking pictures at the rate of say 5 per second (time lapse photography to suit the cellphone capability) or as a continuous video (if the cellphone has high bandwidth capability) both of the event, and, where the portable device has a user facing camera, also of the user and frame by frame send this, including sound, to the User's security and private datastore at a remote server.
  • pictures are automatically date and time stamped.
  • reception/transmission area it will continue (preferably ad infinitum) trying to make a connection so as to upload the time lapse pictures or video with or without sound on the chosen database provided at a remote server.
  • the user has a permanent record for him/herself that can later be forwarded to relatives, friends or to the police if needed (if for instance the user is assaulted or even killed - in this latter case the inheritors of the user's estate will have access if so willed by the user).
  • the Snap'nTrapTM emergency photo function preferably includes in all embodiments a GPS (global positioning system) location and emergency personal recovery system. It works like this:
  • the Snap'nTrapTM emergency photo function On perceiving a serious threat, not only can the Snap'nTrapTM emergency photo function take a series of pictures and forward them immediately to a secure database, but if the portable device has a GPS facility that can identify the users location, the user then presses a button or icon (e.g. the Snap'nTrap Icon twice rapidly (instead of just once as above). This activates the portable device into sending IMMEDIATELY the GPS data (e.g. the latitude and longitude) of the user by SMS (short message service) or by a similar service one, two or more than two previously nominated people with a standard installed message, such as say "SOS GET ME OUT OF HERE FAST YOUR".
  • SMS short message service
  • a similar service one, two or more than two previously nominated people with a standard installed message, such as say "SOS GET ME OUT OF HERE FAST YOUR!”.
  • the present invention provides a powerful self defence mobile phone system and the deterrent effects are obvious. E.g. a girl being followed, maybe in a lonely location, merely has to turn, press the
  • the portable device could also be provided with another button or icon which let's the user trigger the emergency personal recovery system.
  • the emergency photo function and the emergency personal recovery system are linked or combined so that always both functions are carried out.
  • the emergency personal recovery system preferably comprises a server-based infrastructure enabling a service provider (e.g. a rescue organisation) to support people who are faced with a critical situation and/or who are witness of a critical situation and/or people (e.g. relatives) who want to provide help or support to someone who was involved in or faced with a critical situation.
  • a service provider e.g. a rescue organisation
  • people e.g. relatives
  • the optional server-based infrastructure is designed to receive pictures or images of the scene plus additional data, such as one or more of the following : global positioning data (e.g. the latitude and longitude), time data (e.g. a time stamp), information regarding the camera device which was used to take the pictures or images, information regarding the person who owns and/or uses the camera device, information regarding people (e.g. relatives) who are to be informed, and so on.
  • global positioning data e.g. the latitude and longitude
  • time data e.g. a time stamp
  • the optional server server-based infrastructure might comprise a ticketing or queuing system which allows a seamless handover of a task from a first computer of the server server-based infrastructure at a first location (e.g. in Europe) to a second computer of the server server-based infrastructure at a second location (e.g. in the US).
  • This handover process is designed and implemented so that a person at the second location is enabled to continue steps or processes, which have been initiated at the first location.
  • the server-based infrastructure comprises a logging system, which keeps records of all steps taken and of all information being received and sent.
  • the portable (camera) device of the present invention may be any one of several different types of small consumer electronic devices or smart phones that can be held in the user's hands during normal use.
  • the special emergency photo function can be used in many of the existing portable devices, such as mobile phones, smart phones, PDAs, tablet PCs, palmtops, gamepads, digital cameras and the like.
  • the special emergency photo function is very simple and straight forward, which is important in critical situations.
  • the special emergency photo function can be triggered by one click only.
  • the respective providers need to a find an agreement so that pictures or images of a critical situation can be sent via a provider's network even if the user of the device is not a customer of this provider or even if the user's SIM card is locked or a pre-paid amount is used up.
  • FIG. 1A is a perspective front view of an electronic device in the form of a handheld portable electronic device, in accordance with aspects of the present disclosure
  • FIG. IB is a front view of another electronic device in the form of a handheld portable electronic device, in accordance with aspects of the present disclosure.
  • FIG. 2 is a schematic block diagram of a portable device in accordance with aspects of the present disclosure.
  • Note The figures are not drawn to scale, are provided as illustration only and serve only for better understanding but not for defining the scope of the invention. No limitations of any features of the invention should be implied form these figures.
  • portable device or portable camera device 10 are herein used as a synonym for communication devices, such as mobile phones, smart phones, cellular phones and other devices that are for instance based on wireless connection via a network of broadcast towers distributed within a certain area.
  • the portable device 10 at least needs a transceiver circuit 300 (cf. Fig. 2) using a radio- frequency communication channel 201.
  • the portable device 10 comprises a central processing unit 23 (CPU), a memory 20 (e.g. a random access memory) and a flash memory 21 , as illustrated in Fig. 2.
  • Some portable devices 10 comprise multiple CPU cores. In preferred embodiments of the invention, one of these cores is dedicated to the processing of the task of the inventive photo function.
  • the respective CPU core should be capable of operating independently from the other CPU cores and workload should not be allowed to affect the core's processing of the inventive photo function.
  • the invention will be illustrated in connection with a portable device 10 in the form of a smart phone. All statements related to the smart phone can be transferred to other portable devices 10.
  • a smart phone is a mobile phone built on a lean operating system. At the lowest level of a smart phone there is a machine code or kernel that implements the software-hardware connectivity.
  • the machine code or kernel is specific to the micro processors of the CPU of the smart phone. This machine code or kernel can be kept in the memory 20 (cf. Fig. 2), for instance.
  • Another level of the programming language hierarchy is the assembly code. It is higher in the hierarchy than the machine code.
  • a smart phone has advanced computing capabilities and good network or communications features.
  • a Smartphone typically comprises a digital camera.
  • the smart phone can load software or it can be delivered with (pre-)installed software that enables it to perform a multitude of tasks.
  • the special emergency photo function (herein also referred to a suitssnap and trapTM function”) is provided as an executable, since this can be directly executed by the CPU 23 of the portable device 10.
  • the inventive solution is provided as machine code and/or assembly code (e.g. kept in the memory 20), since a close interaction with at least one hardware device component (here the camera, for instance) is required.
  • the software implementation (no matter on what level of hierarchy) should support a real time nature by managing the execution of time-critical tasks in its real-time. High priority should be given to the respective tasks inside the device 10.
  • the present invention uses the operating system of the camera or a script (e.g. a JavaScript) or small program which is able to directly access the devices sensor(s) and camera.
  • a script e.g. a JavaScript
  • small program which is able to directly access the devices sensor(s) and camera.
  • the special emergency photo function comprises the following steps or processes:
  • the camera of the portable device 10 is going to be activated to make sure that the camera is active if needed.
  • the camera is now active and ready to use when called upon.
  • a button of the portable device 10 e.g. an icon 66
  • the camera is caused to take a photo. This can be done by sending the following command : camera. getPicture (please note that herein a pseudo-command language is used).
  • the camera might issue a PhotoSucess signal or a
  • the PhotoFail function will give the user an error message telling them why the camera failed to take the photo.
  • sendPicture can be used to send out the photo right away.
  • Fig. 1A illustrates a portable camera device 10 in which embodiments of the present invention may be practiced.
  • the device 10 may be any one of several different types of (small) consumer electronic devices or smart phones that can be held in the user's hands during normal use.
  • the device 10 may be a multi-function smart phone device such as an iPhoneTM device by Apple Inc, a GALAXYTM device by Samsung, a LuminaTM device offered by Nokia, just to mentioned some popular devices.
  • the device 10 in this case has an exterior front face in which there is a display screen 12 and an imaging lens 16 (see Fig. IB) of a front-facing camera (also referred to as a front camera or a camera that is aimed out of the front face).
  • An optional second, rear-facing camera 15 may also be included in the portable camera device 10 whose imaging lens faces out of the exterior rear or back face of the housing of the device 10.
  • the front camera is a lesser performing camera (e.g., has lower image sensor pixel resolution) than the rear camera 15, and the rear face of the housing of the device 10 has no display screen.
  • Embodiments of the present invention may also be practiced in a dedicated personal digital camera device which may have an optical viewfinder and in other camera devices, including a tablet-like computer such as an iPadTM device by Apple Inc., a Samsung tablet computer, a notebook personal computer or a desktop personal computer, all of which may have a built-in digital camera.
  • a tablet-like computer such as an iPadTM device by Apple Inc.
  • Samsung tablet computer a notebook personal computer or a desktop personal computer, all of which may have a built-in digital camera.
  • These devices 10 require a built-in, attached or connected communication device (e.g. for
  • a portable device 10 may include various I/O ports 11a, l ib, 11c.
  • the depicted I/O ports 11 may include a proprietary connection port 11a for transmitting and receiving data files or for charging a power source and an audio connection port l ib for connecting the device 10 to an audio output device (e.g., headphones or speakers).
  • the device 10 may include an I/O port 11c for receiving a subscriber identify module (SIM) card (e.g., an expansion card).
  • SIM subscriber identify module
  • the display device 12 may display various images generated by the portable device 10.
  • the display 12 may display various system indicators 64 providing feedback to a user with regard to one or more states of portable device 10, such as power status, signal strength, external device connections, and so forth.
  • the display 12 may also display a GUI 52 (graphical user interface) that allows a user to interact with the device 10, as known in the art.
  • the GUI 52 may include graphical elements, such as the icons 54 which may correspond to various
  • one of the icons 54 may represent the emergency camera application 66 of the invention that is used in conjunction with a camera 15 (shown in phantom lines in Fig. IB) for acquiring images.
  • the camera 15 is typically integrated with the housing and positioned on the rear of the portable device 10, as
  • Image data acquired using the emergency photo function and the camera 15 and/or an optional front-facing camera may be processed using an image processing circuitry 80 (see Fig. 2), which may include hardware (e.g., disposed within the enclosure of the device 10) and/or software stored on one or more storage devices (e.g., memory 20 or 21) of the device 10. Images acquired using the camera application 66 and the front-facing camera and/or the camera 15 may be stored on the device 10 (e.g., in an image storage 17 or in the memories 20 and/or 21) and may be viewed at a later time using a photo viewing application.
  • the device 10 includes in most embodiments of the invention a radio frequency functionality (e.g. a cell phone functionality). Further, in embodiments where the device 10 includes a radio frequency
  • the transceiver 300 might comprise a transmitter 200, as illustrated in Fig. 2.
  • FIG. 2 A combined circuit schematic and block diagram of some relevant constituent electronic components of a portable (camera) device 10 is presented in FIG. 2.
  • the digital camera functionality is obtained using a microelectronic image sensor array 115 (e.g. a CCD sensor or a CMOS sensor) on which light from a scene to be captured has been gathered by the imaging lens 16 of the reverse-side camera 15.
  • the image sensor array 115 is responsible for transforming light into electrical signals. This process is known as the capturing of images digitally.
  • the sensor 115 internally records the amount of light that has hit each pixel, or photo site. This is recorded as a voltage level.
  • An analogue to digital circuitry 116 of the sensor 115 or an analogue to digital circuitry 116 associated with the sensor 115 changes this analogue voltage signal into a digital representation.
  • a mechanical shutter may be included in front of the sensor array 115 to control the duration of exposure.
  • an entirely electronic shutter may be implemented using the sensor array's reset and readout signals.
  • the shutter is optional.
  • the sensor array 115 responds to the incident light and collects photo-generated charges or forms image signals during an integration interval (or exposure interval) defined by reset and readout signals.
  • (raw) image signals are read (including being digitized by the analogue to digital circuitry 116) and transferred as a captured digital image or "exposure" to an image storage 17, for instance. This may be a "final" image or picture of the scene, which may be stored in a removable user picture storage area (e.g., a removable non-volatile memory card).
  • the image storage 17 may include sufficient non-volatile memory suitable to store many digital images captured by the sensor array 115. This may also be an intermediate image or picture (e.g. in the form of raw data provided by the CCD camera sensor array 115) which is yet to be processed before it can be displayed.
  • the image sensor array 115 (e.g. a CCD sensor) outputs raw image data either in colour interpolation or in a monochrome format.
  • the camera controller 18 is designed to handle the raw image data.
  • the raw image data are data in an uncompressed image format.
  • the image format depends on the kind and type of image sensor array 115 used.
  • the image format might be a proprietary format which needs some post-processing. There are many raw formats in use by different models of digital equipment. This post-processing, if necessary, is typically done inside the device 10.
  • the post-processing might be skipped in order to make sure that no delays are introduced.
  • the raw image data will be transmitted via the transceiver 300 to a remote receiver (e.g. a remote server).
  • a remote receiver e.g. a remote server
  • the respective device information e.g. a device identifier
  • the respective device information identifies the device 10 and/or the image sensor array [0061]
  • raw image data are consider data which are not directly usable as an image, but which has all of the information needed to create/generate an image.
  • the purpose of using raw image formats in connection with the present invention is to get, with minimum loss of information, data obtained from the sensor 115, and the conditions surrounding the capturing of the image. It is to be understood that it is not a must to use and transmit raw image data. All embodiments addressed herein can also use data in another format, provided the processing after the data acquisition does not take too much time and does not consume too many resources (e.g. CPU cycles and/or battery power).
  • a raw image file may include (the following list is to be understood as a non-limiting example) :
  • sensor data e.g. the size of the sensor 115 and/or colour profile used
  • This information might at some stage be required (e.g. at the remote server) to interpret the image data.
  • Metadata which for instance may include one or more of the
  • the actual raw image data (herein also referred to as payload).
  • raw mode Using raw image data and/or raw image files is herein referred to as raw mode.
  • the raw image data need to be processed at some point in time since otherwise they are not ready to be printed, edited, displayed or further manipulated.
  • This processing in some embodiments is carried out inside the device 10 or in other embodiments by the remote server. It is also conceivable that some (pre-)processing is done inside the device 10 and some (post-) processing is carried out by the remote server.
  • the invention is independent of the fact whether the device 10 acquires large-field-of-view images, small-field-of-view images, close-up views or far-distance views.
  • the image processing may be implemented using hardware and/or software components, and may include various processing units that define a so-called image signal processing (ISP) pipeline.
  • ISP image signal processing
  • the following discussion may focus on aspects of the image processing techniques set forth in the present disclosure, particularly those relating to the taking and handling of images in an emergency situation.
  • an intermediate image or picture e.g. an image in raw data format or as raw image file
  • the "final” image or picture e.g. an image after processing
  • the image storage 17 or the memory 20 is organized as a first-in-first-out queue memory where an image or picture is stored or buffered until it is processed by an auto-transmission function.
  • a dedicated queuing device 100 e.g. a line buffer or shift register
  • the queuing device 100 or the image storage 17 or the memory 20 is connectable to a transmitter 200 of the device 10.
  • the transmitter 200 may be part of the transceiver 300 or the transmitter 200 may be a dedicated transmitter just for use in connection with the emergency photo function of the invention.
  • an image or picture which arrives in the queuing device 100 or in the image storage 17 or memory 20 triggers the auto- transmission function of the invention.
  • the triggering of the auto-transmission function and the carrying out of this function has a higher priority than other processes of the device 10. If necessary, a high priority interrupt might be issued to halt pending processes to ensure that the auto-transmission function is not delayed. This can be implemented using a single CPU 23 or a multi core CPU.
  • the transmitter 200 might be designed to use one or more of the communication channels 201 which are currently available to the device 10.
  • a smart phone might for instance use an UMTS channel.
  • a tablet PC could for instance use a WLAN connection to establish an indirect connection (via an intermediate WLAN router with network connection) to a remote server.
  • the device 10 of all embodiments might comprise a central processing unit 23 (CPU) (see for instance Fig. 2) which has some kind of a master function. If such a CPU 23 is present, it is preferred to have the CPU 23 control the capturing of an image or picture directly without another controller, such as the camera controller 18 being directly involved.
  • CPU central processing unit 23
  • the CPU 23 is hence Jinked" with a release button 19 (here one can use for instance a hardware button of the devices 10, as shown in Fig. 1A and IB, or one can use for instance an emergency camera application icon 66) and/or with the transmitter 200 and/or with the queuing device 100.
  • the respective communication links are shown as dotted lines which are directly connecting the CPU 23 with the mentioned elements. In a practical implementation, however, there is typically a bus to which most if not all elements of the device 10 are linked.
  • meta-data are collected (e.g. after the release button 19 or the
  • the meta-data comprise a timestamp and/or GPS information reflecting the current position of the device 10.
  • the emergency function includes a function which actively asks a receiver (e.g. a user defined earlier) to provide help. This could for instance been used in order to bring in help in a critical situation.
  • the emergency function can be implemented so that for instance a small SOS sign is displayed on a map of the receiver's device. The location of the SOS sign indicates the geographical position where the emergency function of the invention was invoked using the device 10.
  • the emergency function is designed and implemented so that it has a direct memory access (DMA) in order to access an image or picture in the image store 17 and/or in the memory 20 and/or in the queuing device 100.
  • DMA direct memory access
  • the emergency function is designed and implemented so that it by-passes any post-processing functions, such as a defective pixel correction process and/or a noise reduction process and/or a detection logic being typically part of an ISP processing circuitry.
  • the by-passing of these functions speeds up the handling and transmission of the image or picture data.
  • the device 10 of the invention typically comprises one or more of the following sensors:
  • - touch sensor e.g. in the form of a touch screen
  • Future devices 10 might for instance comprise a biochemical sensor and other features.
  • data provided by one or more of the above-mentioned sensors might be included in the form a meta-data, for instance. These additional data might be put into a frame together with the image or picture data (in this case the image or picture data are called payload), or these data might be transmitted separately, e.g. in the form of a dedicated data package.
  • the device 10 of the invention typically comprises one or more of the following features, elements or building blocks:
  • the inventive device 10 might use a back-illuminated sensor (also known as backside illumination (BSI or BI) sensor) to increase the amount of light captured and thereby improve low-light performance.
  • a back-illuminated sensor also known as backside illumination (BSI or BI) sensor
  • a preferred embodiment of the invention uses the same or a similar functionality as described in the preceding paragraph. In this case, the emergency photo procedure is implemented so that
  • the device 10 looks for another provider's network in order to send out the pictures or images, and/or
  • the transmission of the pictures or images is made possible, and/or in case of a password or PIN-protected device 10, the transmission of the pictures or images is made possible without having to enter the password or PIN.
  • a device 10 e.g. a GSM phone
  • a device 10 is able to send out or receive an emergency radio beacon.
  • This feature can be used to locate a phone for instance in case of an emergency.
  • An example of such a system is disclosed in the US-patent US6038438. Similar systems are disclosed in patents cited in this US- patent.
  • a preferred embodiment of the invention uses such a feature in order to locate the device 10 while or after it has sent pictures or images of a critical situation.
  • the remote device to which the pictures or images of a critical situation are uploaded can trigger the locating of the device 10 by sending a request to a service provider.
  • the device 10 of the present invention might also use the AGPS (Assisted Global Positioning System) technology in order to tell an emergency responder the approximate location of the device 10.
  • AGPS Assisted Global Positioning System
  • the device 10 can be used even if it has a touch screen lock which is in an active state.
  • the invention might be implemented so that it responds or reacts to a long press on the touch screen surface or a designated key and enables the taking of a picture or image and the automated transmission of the picture(s) or image(s) to a remote device.
  • the present invention can be based on a solution as disclosed in the published US-application
  • Preferred embodiments of the invention include a dedicated upload-only access code (UAC) inside the device 10.
  • This upload-only access code (UAC) is used by the auto-transmission process of the device 10 in order to temporarily open a dedicated upload channel of the remote device (e.g. a server).
  • the remote device carries out the following steps:
  • the camera devices gathers and transmits as much information as is available to the device. Any such information might at a later point in time be used to reconstruct the situation or scene.
  • queuing device 100 image sensor array 115 analogue to digital 116 circuitry

Abstract

Method for taking a picture or image in a critical situation using a portable camera device (10), comprising the steps: - pointing a camera sensor (115) of the device (10) in the direction of a scene to be captured, - activating a photo function which is implemented in the device (10) in order to trigger an emergency photo procedure implemented therein, wherein said procedure comprises the following steps: o automatically taking a picture or image of the scene using the camera sensor (115), o automatically converting signals provided by the camera sensor (115) into a digital representation of the scene, o automatically carrying out an auto-transmission process inside the device (10) in order to send the digital representation via a communication link (201) to a remote device, - wherein a dedicated upload-only access code, carried inside the device (10), is used by said auto-transmission process in order to temporarily open an upload channel of the remote device, and wherein said remote device carries out the following steps: - receiving the digital representation via said upload channel, - storing the digital representation in a storage section associated with said access code.

Description

Emergency Photo Function and Portable Device including
such an Emergency Photo Function
[001] The present invention concerns an emergency photo function and a portable device including such an emergency photo function.
[002] The present invention claims the priority of the European patent application EP13159319.6, which was filed on 15 march 2013.
[003] There are many critical and special situations in the interaction and the living together of human beings. In particular weak persons, children, teenager, women and handicapped are sometimes exposed to frightening, dangerous or even life-threatening situations.
[004] There is a need for a solution which helps this group of people in the said situations. The respective solution should be easily available and the cost for such a solution should be low.
[005] According to the present invention, a portable device is proposed which includes a special emergency photo function.
[006] According to the present invention a special emergency photo function is proposed and claimed.
[007] According to the present invention, it is a key aspect that an image or picture is taken using a portable device and that the image or picture is sent out as quickly as possible. As soon as the image or picture has left the device, a possible act of violence, demolition or disintegration of the device cannot stop the image or picture. Also acts of reprisals against the user of the device, threats or fisticuffs do not help, since the user cannot delete the image or picture from the device nor can he or she delete the image or picture from the server to which it was sent. The respective server is set up so that an incoming image or picture is kept for a certain period of time (e.g. 1 year). Neither the user nor any third party can cause the image or picture to be deleted.
[008] There is another aspect which is important. The remote server provides an interface for a user of the invention to define certain settings. The access to the server is thus protected by a combination of a user name and a password or by some other security feature(s). Since the portable device of the invention has to be enabled in order to send an image or picture to the server, the server is to be set up so that the respective image or picture is associated with the user's account. If one would store the user name and password or the other security feature(s) inside the portable device, then there is the risk that this access
information is misused. The portable device in preferred embodiments of the invention thus comprises an access code (like an entry ticket) which basically can only be used in a one-way direction for the uploading of an image or picture.
[009] In a preferred embodiment of the invention, the access code (like an entry ticket) has a time-out function and/or a counter. The system can be set up or the user can set up the system so that for instance a maximum of 10 images or pictures can be uploaded using a given access code. In order to reset the system, the user has to use his regular user name and password or some other security feature(s) to access the server. After having reset the system/server, another access code is issued and stored in the portable device or the counter of the original access code is reset. Such a time-limited or counter-based approach improves the overall security of the inventive system.
[0010] In a preferred embodiment of the invention, the emergency photo function (called Snap'n'Trap™) is a personal, defensive, incident photographing and recording system installed into a portable device (e.g. installed into the operating software of wireless Cellphones
(mobilephones)) with a built in digital camera and essential data
transmission capabilities.
[0011] In a preferred embodiment of the invention, the emergency photo function (called Snap'n'Trap™) is implemented inside a camera device so that it able to by-pass other (basic) functions of the camera device. This implementation can be carried out in hardware, software or by a combination of hardware and software.
[0012] In a preferred embodiment of the invention, at least some basic aspects of the emergency photo function are implemented by means of hardware, preferably inside a communication chip, so as to ensure that the emergency photo function can be used even if the camera device is in an idle state or if certain communication function are blocked (e.g. if the roaming function of a phone is switched off). In such a hardware centric implementation the communication chip (e.g. a special CPU core) enables the taking of pictures and it ensures the queuing and sending of pictures or images. For this purpose, depending on the actual implementation of the invention, the communication chip might use a standard
communication channels (e.g. a UTMS or GMS channel) or it might use a dedicated emergency channel.
[0013] In the event a user of such a portable device feels threatened or wishes to record other persons being threatened or at risk, then the user has merely to point the portable device in the general direction of the event to be recorded and press a button or icon (e.g. a dedicated
Snap'n'Trap Logo Icon ON THE FACE of a cellphone). [0014] In preferred embodiments of the invention, the dedicated button or icon must be always prominent on switching on the portable device (no drop down menus or searching for icons).
[0015] Immediately, (of course, the portable device should be in a mode to receive and send phone calls, SMS or Data) the emergency photo function inbuilt software/code will immediately commence taking pictures at the rate of say 5 per second (time lapse photography to suit the cellphone capability) or as a continuous video (if the cellphone has high bandwidth capability) both of the event, and, where the portable device has a user facing camera, also of the user and frame by frame send this, including sound, to the User's security and private datastore at a remote server. In preferred embodiments such pictures are automatically date and time stamped.
[0016] Should the portable device be in a poor wireless
reception/transmission area it will continue (preferably ad infinitum) trying to make a connection so as to upload the time lapse pictures or video with or without sound on the chosen database provided at a remote server.
[0017] Thus, the user has a permanent record for him/herself that can later be forwarded to relatives, friends or to the Police if needed (if for instance the user is assaulted or even killed - in this latter case the inheritors of the user's estate will have access if so willed by the user).
[0018] Should a felonious person being recorded be angered and snatch the portable device away from the user, it matters not, as the pictures taken will in most cases already have been sent (at least the first few frames). Likewise should the felon demand by threatening behaviour that the user show him/her the pictures taken or demand the pictures be destroyed by deletion, neither is possible as the cellphone will not retain photograph copies for safety reasons i.e. the felon may not be completely clear but he/she will assume it is clear. This obviates the felon's ability or need to threaten the user of the portable device.
[0019] Once the general public are aware most people have the emergency photo function inbuilt software/code (Snap'nTrap™ software) installed on their portable device, it should be a major deterrent to potential felons to undertake crimes against the person or property if witnessed.
[0020] Where the portable device (e.g. the cellphones) are technically able to do so, the Snap'nTrap™ emergency photo function preferably includes in all embodiments a GPS (global positioning system) location and emergency personal recovery system. It works like this:
On perceiving a serious threat, not only can the Snap'nTrap™ emergency photo function take a series of pictures and forward them immediately to a secure database, but if the portable device has a GPS facility that can identify the users location, the user then presses a button or icon (e.g. the Snap'nTrap Icon twice rapidly (instead of just once as above). This activates the portable device into sending IMMEDIATELY the GPS data (e.g. the latitude and longitude) of the user by SMS (short message service) or by a similar service one, two or more than two previously nominated people with a standard installed message, such as say "SOS GET ME OUT OF HERE FAST PLEASE". At some stage with GOOGLE MAP cooperation or in cooperation with other providers it will be possible to send not only the SMS or by a similar notification but also a map showing the precise point (say a red spot) on a street map or countryside area where the user is and wants to be rescued from. It is likely that this pictorial option will only be possible with more powerful portable devices and if sufficient bandwidth is available. But Lat/Long is in any case a very good and precise location method. The person(s) receiving such an emergency message are likely to be parents/spouses/adult children or close friends who can raise the alarm with POLICE or other rescue services.
Thus the user knows he/she has immediate pictures on file and help has been called for urgently.
[0021] The present invention provides a powerful self defence mobile phone system and the deterrent effects are obvious. E.g. a girl being followed, maybe in a lonely location, merely has to turn, press the
Snap'nTrap icon or button and shout "you have been Snapped and
Trapped, now go away unless you want the Police on your tail !"
[0022] Instead of having to press the Snap'n rap Icon twice rapidly, the portable device could also be provided with another button or icon which let's the user trigger the emergency personal recovery system.
[0023] In a preferred embodiment, the emergency photo function and the emergency personal recovery system are linked or combined so that always both functions are carried out.
[0024] The emergency personal recovery system preferably comprises a server-based infrastructure enabling a service provider (e.g. a rescue organisation) to support people who are faced with a critical situation and/or who are witness of a critical situation and/or people (e.g. relatives) who want to provide help or support to someone who was involved in or faced with a critical situation.
[0025] The optional server-based infrastructure is designed to receive pictures or images of the scene plus additional data, such as one or more of the following : global positioning data (e.g. the latitude and longitude), time data (e.g. a time stamp), information regarding the camera device which was used to take the pictures or images, information regarding the person who owns and/or uses the camera device, information regarding people (e.g. relatives) who are to be informed, and so on.
[0026] The optional server server-based infrastructure might comprise a ticketing or queuing system which allows a seamless handover of a task from a first computer of the server server-based infrastructure at a first location (e.g. in Europe) to a second computer of the server server-based infrastructure at a second location (e.g. in the US). This handover process is designed and implemented so that a person at the second location is enabled to continue steps or processes, which have been initiated at the first location.
[0027] Preferably, the server-based infrastructure comprises a logging system, which keeps records of all steps taken and of all information being received and sent.
[0028] The portable (camera) device of the present invention may be any one of several different types of small consumer electronic devices or smart phones that can be held in the user's hands during normal use.
ADVANTAGEOUS EFFECTS
[0029] One of the most important advantages of the present invention is that the special emergency photo function can be used in many of the existing portable devices, such as mobile phones, smart phones, PDAs, tablet PCs, palmtops, gamepads, digital cameras and the like.
[0030] The use of the special emergency photo function is very simple and straight forward, which is important in critical situations. In a preferred embodiment of the invention, the special emergency photo function can be triggered by one click only. [0031] It is an advantage of the present invention that in most cases its implementation does not require any modifications of the existing infrastructure or mobile network implementation. This means that portable devices with the inventive feature(s) can coexist with other devices.
[0032] If one wants to use invention in connection with the so-called „emergency call only" feature, which is available in some regions or countries, the respective providers need to a find an agreement so that pictures or images of a critical situation can be sent via a provider's network even if the user of the device is not a customer of this provider or even if the user's SIM card is locked or a pre-paid amount is used up.
BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Further characteristics and advantages of the invention will in the following be described in detail by means of the description and by making reference to the drawings.
FIG. 1A is a perspective front view of an electronic device in the form of a handheld portable electronic device, in accordance with aspects of the present disclosure;
FIG. IB is a front view of another electronic device in the form of a handheld portable electronic device, in accordance with aspects of the present disclosure;
FIG. 2 is a schematic block diagram of a portable device in accordance with aspects of the present disclosure. [0034] Note : The figures are not drawn to scale, are provided as illustration only and serve only for better understanding but not for defining the scope of the invention. No limitations of any features of the invention should be implied form these figures.
DESCRIPTION OF PREFERRED EMBODIMENTS
[0035] Certain terms will be used in this patent application, the formulation of which should not be interpreted to be limited by the specific term chosen, but as to relate to the general concept behind the specific term.
[0036] The words portable device or portable camera device 10 are herein used as a synonym for communication devices, such as mobile phones, smart phones, cellular phones and other devices that are for instance based on wireless connection via a network of broadcast towers distributed within a certain area.
[0037] As far as the present invention is concerned, the portable device 10 at least needs a transceiver circuit 300 (cf. Fig. 2) using a radio- frequency communication channel 201. In order to perform the most basic functions, the portable device 10 comprises a central processing unit 23 (CPU), a memory 20 (e.g. a random access memory) and a flash memory 21 , as illustrated in Fig. 2.
[0038] Some portable devices 10 comprise multiple CPU cores. In preferred embodiments of the invention, one of these cores is dedicated to the processing of the task of the inventive photo function. The respective CPU core should be capable of operating independently from the other CPU cores and workload should not be allowed to affect the core's processing of the inventive photo function. [0039] In the following, the invention will be illustrated in connection with a portable device 10 in the form of a smart phone. All statements related to the smart phone can be transferred to other portable devices 10.
[0040] A smart phone is a mobile phone built on a lean operating system. At the lowest level of a smart phone there is a machine code or kernel that implements the software-hardware connectivity. The machine code or kernel is specific to the micro processors of the CPU of the smart phone. This machine code or kernel can be kept in the memory 20 (cf. Fig. 2), for instance.
[0041] Another level of the programming language hierarchy is the assembly code. It is higher in the hierarchy than the machine code.
[0042] A smart phone has advanced computing capabilities and good network or communications features. A Smartphone typically comprises a digital camera.
[0043] With a suitable configuration of hardware, the smart phone can load software or it can be delivered with (pre-)installed software that enables it to perform a multitude of tasks.
[0044] In preferred implementations of the invention, the special emergency photo function (herein also referred to a„snap and trap™ function") is provided as an executable, since this can be directly executed by the CPU 23 of the portable device 10. Preferrably, the inventive solution is provided as machine code and/or assembly code (e.g. kept in the memory 20), since a close interaction with at least one hardware device component (here the camera, for instance) is required. [0045] In preferred implementations of the invention, the software implementation (no matter on what level of hierarchy) should support a real time nature by managing the execution of time-critical tasks in its real-time. High priority should be given to the respective tasks inside the device 10.
[0046] The present invention uses the operating system of the camera or a script (e.g. a JavaScript) or small program which is able to directly access the devices sensor(s) and camera.
[0047] Preferrably, the special emergency photo function comprises the following steps or processes:
1. Typically, in a first step the camera of the portable device 10 is going to be activated to make sure that the camera is active if needed. The camera is now active and ready to use when called upon.
2. If a button of the portable device 10 (e.g. an icon 66) is activated, the camera is caused to take a photo. This can be done by sending the following command : camera. getPicture (please note that herein a pseudo-command language is used).
3. Depending on the hardware and/or software implementation of the invention, the camera might issue a PhotoSucess signal or a
PhotoFail signal. The PhotoFail function will give the user an error message telling them why the camera failed to take the photo.
4. Rather than showing the photo on a display screen 12 of the
portable device 10, the following command phone. sendPicture can be used to send out the photo right away.
[0048] Fig. 1A illustrates a portable camera device 10 in which embodiments of the present invention may be practiced. The device 10 may be any one of several different types of (small) consumer electronic devices or smart phones that can be held in the user's hands during normal use. In particular, the device 10 may be a multi-function smart phone device such as an iPhone™ device by Apple Inc, a GALAXY™ device by Samsung, a Lumina™ device offered by Nokia, just to mentioned some popular devices.
[0049] The device 10 in this case has an exterior front face in which there is a display screen 12 and an imaging lens 16 (see Fig. IB) of a front-facing camera (also referred to as a front camera or a camera that is aimed out of the front face). An optional second, rear-facing camera 15 (see Fig. IB and 2) may also be included in the portable camera device 10 whose imaging lens faces out of the exterior rear or back face of the housing of the device 10.
[0050] In one embodiment, the front camera is a lesser performing camera (e.g., has lower image sensor pixel resolution) than the rear camera 15, and the rear face of the housing of the device 10 has no display screen.
[0051] Embodiments of the present invention may also be practiced in a dedicated personal digital camera device which may have an optical viewfinder and in other camera devices, including a tablet-like computer such as an iPad™ device by Apple Inc., a Samsung tablet computer, a notebook personal computer or a desktop personal computer, all of which may have a built-in digital camera. These devices 10, however, require a built-in, attached or connected communication device (e.g. for
establishing a WLAN-link to a remote device, where the remote device has a network connection to a remote server.)
[0052] As shown in Fig. IB, a portable device 10 may include various I/O ports 11a, l ib, 11c. For instance, the depicted I/O ports 11 may include a proprietary connection port 11a for transmitting and receiving data files or for charging a power source and an audio connection port l ib for connecting the device 10 to an audio output device (e.g., headphones or speakers). Further, in embodiments where the portable device 10 provides mobile phone functionality, the device 10 may include an I/O port 11c for receiving a subscriber identify module (SIM) card (e.g., an expansion card).
[0053] The display device 12, which may be an LCD, OLED, or any suitable type of display, may display various images generated by the portable device 10. For example, the display 12 may display various system indicators 64 providing feedback to a user with regard to one or more states of portable device 10, such as power status, signal strength, external device connections, and so forth. The display 12 may also display a GUI 52 (graphical user interface) that allows a user to interact with the device 10, as known in the art. The GUI 52 may include graphical elements, such as the icons 54 which may correspond to various
applications that may be opened or executed upon detecting a user selection of a respective icon 54. By way of example, one of the icons 54 may represent the emergency camera application 66 of the invention that is used in conjunction with a camera 15 (shown in phantom lines in Fig. IB) for acquiring images. The camera 15 is typically integrated with the housing and positioned on the rear of the portable device 10, as
mentioned.
[0054] Image data acquired using the emergency photo function and the camera 15 and/or an optional front-facing camera may be processed using an image processing circuitry 80 (see Fig. 2), which may include hardware (e.g., disposed within the enclosure of the device 10) and/or software stored on one or more storage devices (e.g., memory 20 or 21) of the device 10. Images acquired using the camera application 66 and the front-facing camera and/or the camera 15 may be stored on the device 10 (e.g., in an image storage 17 or in the memories 20 and/or 21) and may be viewed at a later time using a photo viewing application. [0055] The device 10 includes in most embodiments of the invention a radio frequency functionality (e.g. a cell phone functionality). Further, in embodiments where the device 10 includes a radio frequency
functionality, an antenna (not shown) and a transceiver 300 are included. The transceiver 300 might comprise a transmitter 200, as illustrated in Fig. 2.
[0056] A combined circuit schematic and block diagram of some relevant constituent electronic components of a portable (camera) device 10 is presented in FIG. 2. The digital camera functionality is obtained using a microelectronic image sensor array 115 (e.g. a CCD sensor or a CMOS sensor) on which light from a scene to be captured has been gathered by the imaging lens 16 of the reverse-side camera 15. The image sensor array 115 is responsible for transforming light into electrical signals. This process is known as the capturing of images digitally. The sensor 115 internally records the amount of light that has hit each pixel, or photo site. This is recorded as a voltage level. An analogue to digital circuitry 116 of the sensor 115 or an analogue to digital circuitry 116 associated with the sensor 115 changes this analogue voltage signal into a digital representation.
[0057] A mechanical shutter (not shown) may be included in front of the sensor array 115 to control the duration of exposure. Alternatively, an entirely electronic shutter may be implemented using the sensor array's reset and readout signals. The shutter is optional. The sensor array 115 responds to the incident light and collects photo-generated charges or forms image signals during an integration interval (or exposure interval) defined by reset and readout signals. At the end of the integration interval, (raw) image signals are read (including being digitized by the analogue to digital circuitry 116) and transferred as a captured digital image or "exposure" to an image storage 17, for instance. This may be a "final" image or picture of the scene, which may be stored in a removable user picture storage area (e.g., a removable non-volatile memory card). The image storage 17 may include sufficient non-volatile memory suitable to store many digital images captured by the sensor array 115. This may also be an intermediate image or picture (e.g. in the form of raw data provided by the CCD camera sensor array 115) which is yet to be processed before it can be displayed.
[0058] The image sensor array 115 (e.g. a CCD sensor) outputs raw image data either in colour interpolation or in a monochrome format. The camera controller 18 is designed to handle the raw image data.
[0059] The raw image data are data in an uncompressed image format. Typically, the image format depends on the kind and type of image sensor array 115 used. The image format might be a proprietary format which needs some post-processing. There are many raw formats in use by different models of digital equipment. This post-processing, if necessary, is typically done inside the device 10.
[0060] According to the invention, the post-processing might be skipped in order to make sure that no delays are introduced. In
embodiments where the post-processing is skipped, the raw image data will be transmitted via the transceiver 300 to a remote receiver (e.g. a remote server). In order to condition or format these data, there needs to be a post-processing function of some kind at the receiver side. In this context, either the user has to define the type of device 10 so that the post-processing function at the receiver side can use the right tools or processes, or the respective device information (e.g. a device identifier) is transmitted together with or in addition to the raw data. The respective device information identifies the device 10 and/or the image sensor array [0061] For the purposes of the present invention, raw image data are consider data which are not directly usable as an image, but which has all of the information needed to create/generate an image.
[0062] The purpose of using raw image formats in connection with the present invention is to get, with minimum loss of information, data obtained from the sensor 115, and the conditions surrounding the capturing of the image. It is to be understood that it is not a must to use and transmit raw image data. All embodiments addressed herein can also use data in another format, provided the processing after the data acquisition does not take too much time and does not consume too many resources (e.g. CPU cycles and/or battery power).
[0063] Depending on the actual image sensor 115 used, some data conversion and/or decoding will be required to bring the image data into a format which can be handled or processed more easily using standard devices and or (software) tools.
[0064] Instead of using raw image data, the invention works as well by using raw image files. The major difference lies in the fact that a raw image file contains more (side or auxiliary) information than the pure raw image data. A raw image file may include (the following list is to be understood as a non-limiting example) :
- a file header which identifies the ordering or structure of the file;
- sensor data (e.g. the size of the sensor 115 and/or colour profile used) which for instance identify the type of sensor 115 used. This information might at some stage be required (e.g. at the remote server) to interpret the image data.
- Metadata which for instance may include one or more of the
following : the exposure settings, camera model, scanner model, lens model, date, place and other conditions/parameters of the shoot or scan. - The actual raw image data (herein also referred to as payload).
[0065] Using raw image data and/or raw image files is herein referred to as raw mode.
[0066] The raw image data need to be processed at some point in time since otherwise they are not ready to be printed, edited, displayed or further manipulated. This processing in some embodiments is carried out inside the device 10 or in other embodiments by the remote server. It is also conceivable that some (pre-)processing is done inside the device 10 and some (post-) processing is carried out by the remote server.
[0067] The invention is independent of the fact whether the device 10 acquires large-field-of-view images, small-field-of-view images, close-up views or far-distance views.
[0068] Having now provided some context with regard to various forms that the device 10 may take, the present discussion will now focus on the image processing aspects.
[0069] The image processing may be implemented using hardware and/or software components, and may include various processing units that define a so-called image signal processing (ISP) pipeline. In
particular, the following discussion may focus on aspects of the image processing techniques set forth in the present disclosure, particularly those relating to the taking and handling of images in an emergency situation.
[0070] According to the present invention, an intermediate image or picture (e.g. an image in raw data format or as raw image file) and/or the "final" image or picture (e.g. an image after processing) is/are
automatically put in a queue 100 for auto-transmission. [0071] In a preferred embodiment of the invention, the image storage 17 or the memory 20 is organized as a first-in-first-out queue memory where an image or picture is stored or buffered until it is processed by an auto-transmission function.
[0072] In another embodiment, a dedicated queuing device 100 (e.g. a line buffer or shift register) is linked with the image storage 17 and/or with the memory 20 and/or with the sensor array 115 (as depicted in Fig. 2) and/or with the camera controller 18.
[0073] The queuing device 100 or the image storage 17 or the memory 20 is connectable to a transmitter 200 of the device 10. The transmitter 200 may be part of the transceiver 300 or the transmitter 200 may be a dedicated transmitter just for use in connection with the emergency photo function of the invention.
[0074] Preferably, an image or picture which arrives in the queuing device 100 or in the image storage 17 or memory 20 triggers the auto- transmission function of the invention.
[0075] Preferably, the triggering of the auto-transmission function and the carrying out of this function has a higher priority than other processes of the device 10. If necessary, a high priority interrupt might be issued to halt pending processes to ensure that the auto-transmission function is not delayed. This can be implemented using a single CPU 23 or a multi core CPU.
[0076] The transmitter 200 might be designed to use one or more of the communication channels 201 which are currently available to the device 10. A smart phone might for instance use an UMTS channel. A tablet PC could for instance use a WLAN connection to establish an indirect connection (via an intermediate WLAN router with network connection) to a remote server. [0077] The device 10 of all embodiments might comprise a central processing unit 23 (CPU) (see for instance Fig. 2) which has some kind of a master function. If such a CPU 23 is present, it is preferred to have the CPU 23 control the capturing of an image or picture directly without another controller, such as the camera controller 18 being directly involved.
[0078] In Fig. 2, the CPU 23 is hence Jinked" with a release button 19 (here one can use for instance a hardware button of the devices 10, as shown in Fig. 1A and IB, or one can use for instance an emergency camera application icon 66) and/or with the transmitter 200 and/or with the queuing device 100. The respective communication links are shown as dotted lines which are directly connecting the CPU 23 with the mentioned elements. In a practical implementation, however, there is typically a bus to which most if not all elements of the device 10 are linked.
[0079] According to preferred embodiments of the invention, so-called meta-data are collected (e.g. after the release button 19 or the
emergency camera application icon 66 has been pressed). These metadata are made available to the transmitter 200 so that they can be sent out together with the image or picture or right after the image or picture was sent out).
[0080] In the following example the meta-data comprise a timestamp and/or GPS information reflecting the current position of the device 10.
[0081] According to a preferred embodiment of the invention, the emergency function includes a function which actively asks a receiver (e.g. a user defined earlier) to provide help. This could for instance been used in order to bring in help in a critical situation. The emergency function can be implemented so that for instance a small SOS sign is displayed on a map of the receiver's device. The location of the SOS sign indicates the geographical position where the emergency function of the invention was invoked using the device 10.
[0082] According to a preferred embodiment of the invention, the emergency function is designed and implemented so that it has a direct memory access (DMA) in order to access an image or picture in the image store 17 and/or in the memory 20 and/or in the queuing device 100.
[0083] According to a preferred embodiment of the invention, the emergency function is designed and implemented so that it by-passes any post-processing functions, such as a defective pixel correction process and/or a noise reduction process and/or a detection logic being typically part of an ISP processing circuitry. The by-passing of these functions speeds up the handling and transmission of the image or picture data.
[0084] The device 10 of the invention typically comprises one or more of the following sensors:
- (3-axis) accelerometer,
- (3-axis) gyroscope,
- (3-axis) magnetometer,
- pressure sensor,
- humidity sensor,
- temperature sensor,
- electronic compass
- proximity sensor,
- light sensor (Ambient light (ALS)),
- touch sensor (e.g. in the form of a touch screen),
- back-illuminated sensor.
[0085] Future devices 10 might for instance comprise a biochemical sensor and other features. [0086] When transmitting image or picture data, data provided by one or more of the above-mentioned sensors might be included in the form a meta-data, for instance. These additional data might be put into a frame together with the image or picture data (in this case the image or picture data are called payload), or these data might be transmitted separately, e.g. in the form of a dedicated data package.
[0087] The device 10 of the invention typically comprises one or more of the following features, elements or building blocks:
- (GPS) Global Positioning System,
- WiFi system,
- Bluetooth system,
- WLAN system,
- GSM/CDMA cell system,
- Near Field communications system.
[0088] The inventive device 10 might use a back-illuminated sensor (also known as backside illumination (BSI or BI) sensor) to increase the amount of light captured and thereby improve low-light performance.
[0089] Some of today's mobile phones (for instance GSM phones;
phone which support/implement the Global System for Mobile
communications) have a feature called„emergency calls only". This feature allows the user of such a phone to call the police even if the phone's SIM card is not activated or if there is no credit balance available on a prepaid SIM card. On some phones this feature is available even if a user's network is not available, e.g. because the signal is too weak. In this case some kind of roaming function lets the phone access and use another network in order to place an emergency call. In some countries this is actually a matter which is being dealt with by appropriate agreements between the various mobile phone providers. [0090] A preferred embodiment of the invention uses the same or a similar functionality as described in the preceding paragraph. In this case, the emergency photo procedure is implemented so that
in case of a weak signal of the regular network (e.g. the network of a first provider), the device 10 looks for another provider's network in order to send out the pictures or images, and/or
in case of a blocked or not available SIM card inside the device 10, the transmission of the pictures or images is made possible, and/or in case of a password or PIN-protected device 10, the transmission of the pictures or images is made possible without having to enter the password or PIN.
[0091] There are mobile communication systems where a device 10 (e.g. a GSM phone) is able to send out or receive an emergency radio beacon. This feature can be used to locate a phone for instance in case of an emergency. An example of such a system is disclosed in the US-patent US6038438. Similar systems are disclosed in patents cited in this US- patent. A preferred embodiment of the invention uses such a feature in order to locate the device 10 while or after it has sent pictures or images of a critical situation. The remote device to which the pictures or images of a critical situation are uploaded can trigger the locating of the device 10 by sending a request to a service provider.
[0092] The device 10 of the present invention might also use the AGPS (Assisted Global Positioning System) technology in order to tell an emergency responder the approximate location of the device 10.
[0093] In a further embodiment of the invention the device 10 can be used even if it has a touch screen lock which is in an active state. The invention might be implemented so that it responds or reacts to a long press on the touch screen surface or a designated key and enables the taking of a picture or image and the automated transmission of the picture(s) or image(s) to a remote device. The present invention can be based on a solution as disclosed in the published US-application
US20050085215.
[0094] Preferred embodiments of the invention include a dedicated upload-only access code (UAC) inside the device 10. This upload-only access code (UAC) is used by the auto-transmission process of the device 10 in order to temporarily open a dedicated upload channel of the remote device (e.g. a server). The remote device carries out the following steps:
- receiving the digital representation via the dedicated upload channel,
- storing the digital representation in a storage section associated with the access code (UAC).
[0095] In a preferred embodiment of the invention the camera devices gathers and transmits as much information as is available to the device. Any such information might at a later point in time be used to reconstruct the situation or scene.
Figure imgf000024_0001
GUI 52 icons 54 system indicators 64 emergency camera 66 application audio input/output 70 elements
image processing 80 circuitry
queuing device 100 image sensor array 115 analogue to digital 116 circuitry
transmitter 200 communication channel 201 transceiver 300 central processing unit CPU upload-only access code UAC

Claims

Claims:
1. Method for taking a picture or image in a critical situation using a
portable camera device (10), comprising the steps:
- pointing a camera sensor (115) of the device (10) in the direction of a scene to be captured,
- activating a photo function (19, 66) which is implemented in the device (10) in order to trigger an emergency photo procedure implemented therein, wherein said procedure comprises the following steps:
o automatically taking a picture or image of the scene using the camera sensor (115),
o automatically converting signals provided by the camera
sensor (115) into a digital representation of the scene,
o automatically carrying out an auto-transmission process inside the device (10) in order to send the digital representation via a communication link (201) to a remote device,
- wherein a dedicated upload-only access code (UAC), carried inside the device (10), is used by said auto-transmission process in order to temporarily open an upload channel of the remote device, and wherein said remote device carries out the following steps:
- receiving the digital representation via said upload channel,
- storing the digital representation in a storage section associated with said access code (UAC).
2. The method of claim 1, wherein said upload channel is a unidirectional upload channel.
3. The method of claim 1 or 2, wherein said upload channel is set up so that only a predefined format of the digital representation is routed through said upload channel into said storage section and wherein digital representations which do not correspond to the predefined format are prevented from being routed through said upload channel.
4. The method of claim 1, 2 or 3, wherein said access code (UAC) is a secret access code hidden inside the device (10).
5. The method of one of the preceding claims, wherein said remote
device is implemented so as to carry out the following steps:
- providing an entry panel in order to give a user, who is using a
remote device, access to a user-dedicated section of the remote device,
- prompting the user to enter a user identification other than the
access code,
- if a valid user identification has been entered, granting the user access to the user-dedicated section and/or to a digital
representation stored in a storage section of said remote device.
6. The method of claim 5, wherein the remote device is implemented so that, once a user has been granted access to the user-dedicated section, the user is enabled to define a rule or setting for the handling of digital representations which have been or will be received through said upload channel.
7. The method of claim 5 or 6, wherein the remote device is implemented so that a digital representation is forwarded from the storage section to another remote device, such as another mobile device.
8. The method of claim 7, wherein the forwarding is carried out without deleting the digital representation from the storage section of the remote device.
9. The method of claim 5, wherein the remote device is implemented so that is able to carry out one or more of the following steps:
- Auto-forwarding a digital representation from the storage section to another remote device;
- Sending out a notification or alert after a digital representation has been uploaded through the upload channel into the storage section;
- Post-processing the digital representation which has been uploaded through the upload channel.
10. The method of one of the preceding claims, wherein the storing of the digital representation is done so that the digital representation cannot be deleted during a predefined period of time or cannot be deleted at all.
11. The method of one of the preceding claims, wherein the remote device is equipped with a fire-wall hard- and/or software which is designed to control and protect the upload channel against outside attacks and/or manipulations.
12. The method of one of the preceding claims, wherein the emergency photo procedure is implemented so that the following steps are carried out:
- Automatically taking multiple pictures or images of the scene using the camera sensor (115),
- Putting said pictures or images into a queuing device (100) of the device (10), and
wherein said auto-transmission process picks the digital
representations of one picture or image after the other out of said queuing device (100) in order to send the respective digital
representations via a communication link (201) to a remote device.
13. The method of one of the preceding claims, wherein the emergency photo procedure is implemented so that in addition an emergency personal recovery system or function is invoked.
14. The method of claim 13, wherein the invoking of the emergency
personal recovery system or function causes the following steps to be carried out:
- obtaining data about the current position of the portable camera device (10),
- sending these data to a remote device or user,
- asking the remote device or user for help.
PCT/EP2014/054893 2013-03-15 2014-03-12 Emergency photo function and portable device including such an emergency photo function WO2014140135A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP13159319.6 2013-03-15
EP13159319 2013-03-15

Publications (1)

Publication Number Publication Date
WO2014140135A1 true WO2014140135A1 (en) 2014-09-18

Family

ID=48013731

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2014/054893 WO2014140135A1 (en) 2013-03-15 2014-03-12 Emergency photo function and portable device including such an emergency photo function

Country Status (1)

Country Link
WO (1) WO2014140135A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10021002B2 (en) 2016-06-24 2018-07-10 Qualcomm Incorporated Sensor data acquisition in a user equipment
WO2020168932A1 (en) * 2019-02-18 2020-08-27 上海救要救信息科技有限公司 Method and device for managing wearable rescue device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2401752A (en) * 2003-05-13 2004-11-17 Guy Frank Howard Walker Mobile personal security eyewitness device
US20060158525A1 (en) * 2005-01-14 2006-07-20 Skillman Gilbert W Photo protection device and method
US20080132199A1 (en) * 2004-12-27 2008-06-05 Jupiter Net Incorporated Portable Radio Device Having Emergency Notifying Function, Emergency Notification Apparatus, and Emergency Notification System
US20100283609A1 (en) * 2009-05-07 2010-11-11 Perpcast, Inc. Personal safety system, method, and apparatus
US20120329420A1 (en) * 2009-11-12 2012-12-27 Soteria Systems, Llc Personal safety application for mobile device and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2401752A (en) * 2003-05-13 2004-11-17 Guy Frank Howard Walker Mobile personal security eyewitness device
US20080132199A1 (en) * 2004-12-27 2008-06-05 Jupiter Net Incorporated Portable Radio Device Having Emergency Notifying Function, Emergency Notification Apparatus, and Emergency Notification System
US20060158525A1 (en) * 2005-01-14 2006-07-20 Skillman Gilbert W Photo protection device and method
US20100283609A1 (en) * 2009-05-07 2010-11-11 Perpcast, Inc. Personal safety system, method, and apparatus
US20120329420A1 (en) * 2009-11-12 2012-12-27 Soteria Systems, Llc Personal safety application for mobile device and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10021002B2 (en) 2016-06-24 2018-07-10 Qualcomm Incorporated Sensor data acquisition in a user equipment
WO2020168932A1 (en) * 2019-02-18 2020-08-27 上海救要救信息科技有限公司 Method and device for managing wearable rescue device

Similar Documents

Publication Publication Date Title
CN109891874B (en) Panoramic shooting method and device
WO2021052292A1 (en) Video acquisition method and electronic device
RU2640646C2 (en) Method and device for cloud card transmission
CN109729279B (en) Image shooting method and terminal equipment
RU2649862C2 (en) Method and device for shooting management
JP2007102575A (en) Photography system
CN105812660A (en) Video processing method based on geographic position
KR20100017165A (en) System and method of photography using desirable feature recognition
JP2006516844A (en) Imaging request method and system
CN114189625B (en) Shooting control method and terminal
WO2019148317A1 (en) Uav service supporting method and device
US9052866B2 (en) Method, apparatus and computer-readable medium for image registration and display
CN114009003A (en) Image acquisition method, device, equipment and storage medium
JP2008244660A (en) Image analysis system automatically acquiring related information from captured image, mobile terminal, method, and program
JP2011142370A (en) Cellular phone for transmitting urgent report message, program, and reporting method
WO2021190621A1 (en) Data sharing and instruction operation control method and system
JP2008131412A (en) Video telephone system and program
WO2014140135A1 (en) Emergency photo function and portable device including such an emergency photo function
US10447910B2 (en) Camera notification and filtering of content for restricted sites
US10630894B2 (en) Notification system, wearable device, information processing apparatus, control method thereof, and computer-readable storage medium
WO2022095712A1 (en) Data sharing method, apparatus and system, and electronic device
KR20210141427A (en) Method and apparatus for providing safeguard service for lost mobile terminal
JP2003134258A (en) Digital camera mount type mobile phone, image information service system, and emergency notice system
JP2005136605A (en) Image photographing control apparatus and program
WO2020062308A1 (en) Location information processing method and related device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14710237

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14710237

Country of ref document: EP

Kind code of ref document: A1