US20130077835A1 - Searching with face recognition and social networking profiles - Google Patents
Searching with face recognition and social networking profiles Download PDFInfo
- Publication number
- US20130077835A1 US20130077835A1 US13/455,658 US201213455658A US2013077835A1 US 20130077835 A1 US20130077835 A1 US 20130077835A1 US 201213455658 A US201213455658 A US 201213455658A US 2013077835 A1 US2013077835 A1 US 2013077835A1
- Authority
- US
- United States
- Prior art keywords
- mobile device
- search
- face
- social networking
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
Definitions
- the present disclosure relates generally to on-line searching methods, and particularly, to searching with face recognition and social networking profiles.
- a method for interacting with a social networking service using a mobile device wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the method comprising: receiving at a search service, from the mobile device, at least one search term and at least one source image, wherein the source image includes a plurality of representations of a plurality of faces; comparing, using the search service, the search term to at least some of the member descriptors; comparing, using the search service, at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member
- FIG. 1 depicts a block diagram of a system according to one embodiment of the present invention
- FIG. 2 depicts a block diagram of a system according to another embodiment of the present invention.
- FIG. 3 depicts a mobile device and application according to another embodiment of the present invention.
- FIG. 4 depicts again the mobile device and application of FIG. 3 ;
- FIG. 5 depicts a flow chart relating to FIGS. 3 and 4 ;
- FIG. 6 depicts a block diagram according to another embodiment of the present invention.
- one or more systems may be provided with regard to searching with face recognition and social networking profiles.
- one or more methods may be provided with regard to searching with face recognition and social networking profiles.
- social networking service is intended to refer to an online service, platform or website that: (a) focuses on building, among a plurality of people, social network(s) and/or social relationship(s); (b) focuses on reflecting, as to a plurality of people, social network(s) and/or social relationship(s); and/or (c) includes a database containing, for each member of the database, at least a photograph and a profile containing descriptive information.
- a social networking service as applied to an embodiment of the present invention may be selected from the group including (but not limited to): GOOGLE+, GOOGLE BUZZ, FACEBOOK, TWITTER, FOURSQUARE, LINKEDIN and FLICKR.
- a mobile device is intended to refer to any generally portable device having network access (e.g. Internet access) and including a camera mechanism.
- a mobile device as applied to embodiments of the present invention may be selected from the group including (but not limited to): a mobile phone (e.g., a “smart phone” or a “feature phone”), a tablet (e.g., an iPad), a PDA (personal digital assistant), and a dedicated camera (including network access).
- a mobile phone e.g., a “smart phone” or a “feature phone”
- a tablet e.g., an iPad
- PDA personal digital assistant
- a dedicated camera including network access
- network access may be available to the mobile device wirelessly and/or through a wired mechanism (such a wired mechanism may include a removable plug or the like, so that portability is maintained).
- search service is intended to refer to an online service, platform or website that: provides the search functionality described herein.
- a search service may comprise: (a) computer software; (b) computer hardware; (c) computer firmware; and/or (d) a combination thereof.
- an application (such as used in the context of an application associated with a mobile device) is intended to refer to a mechanism that provides the functionality described herein.
- an application may comprise: (a) computer software; (b) computer hardware; (c) computer firmware; and/or (d) a combination thereof.
- the term “camera” (such as used in the context of a camera included with a mobile device) is intended to refer to a mechanism that provides still image capture and/or video image capture.
- Internet access is intended to refer to the ability to connect (e.g., bi-directionally) with the Internet.
- Internet access as applied to embodiments of the present invention may be selected from the group including (but not limited to): access via Wi-Fi, access via Bluetooth, access via a cell phone network (e.g., a 2G network, a 3G network, or a 4G network), and access via a wired mechanism (such a wired mechanism may include a removable plug or the like, so that portability is maintained).
- friend is intended to refer to a member of a social networking service who has indicated a willingness to be identified as such with respect to another person or persons.
- friend identifier is intended to refer to an indication identifying a person's social networking service friend.
- friend level indicator is intended to refer to how many search iterations regarding friends-of-friends are to be performed (for example, a friend level indicator of 2 would mean that a search should encompass friends as well as friends-of-friends; in another example, a friend level indicator of 3 would mean that a search should encompass friends, friends-of-friends, as well as friends-of-friends-of-friends).
- representation of a face is intended to refer to a representation of all or part of a face.
- an approximate match within a degree of confidence is intended to refer to a facial recognition match that is not an exact match but that is deemed a match by meeting certain parameters defined by a facial recognition algorithm.
- an approximate match within a degree of confidence may be found by comparing selected facial features.
- an approximate match within a degree of confidence may depend upon factors including (but not limited to) the following parameters: appearance of facial hair and/or accessories such as glasses etc.
- a computer-implemented system for interacting with a social networking service using a mobile device wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the user interface at least one search term, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access
- the search service may provide at least a first result identifying at least a first member who has: (a) a descriptor that is a match to the search term from the mobile device; and (b) a member image including a representation of a face that is a match to a first one of the representation of faces in the source image; and the search service may provide at least a second result identifying at least a second member who has: (a) a member descriptor that is a match to the search term from the mobile device; and (b) a member image including a representation of a face that is a match to a second one of the representation of faces in the source image.
- the first result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a first indicium identifying the first member; and the second result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a second indicium identifying the second member.
- the search service may be integrated into the social networking service.
- a member descriptor that is a match to the search term from the mobile device may be an essentially exact match to the search term.
- a member descriptor that is a match to the search term from the mobile device may be a match to the search term that is an approximate match within a degree of confidence.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence.
- a user may have an option to change a “degree of confidence level” (e.g., a user may change a % age match from 100% to 75% match etc.).
- the present invention may utilize any conventional facial detection/recognition software and/or algorithms.
- the search term may comprise a plurality of search terms.
- the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- a computer-implemented system for interacting with a social networking service using a mobile device wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen)
- the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the user interface at least one friend identifier, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access mechanism associated with the mobile device, wherein the Internet access mechanism is in operative communication with the
- the search service may provide at least a first result identifying at least a first member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image; and the search service may provide at least a second result identifying at least a second member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image.
- the first result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a first indicium identifying the first member; and the second result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a second indicium identifying the second member.
- the search service may be integrated into the social networking service.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence.
- the friend identifier may comprise a plurality of friend identifiers.
- the application may further receive from the user interface a friend level indicator; and the search service may perform iterative searching of friends-of-friends based at least in part upon the friend level indicator and the friend identifier.
- the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- a computer-implemented system for interacting with a social networking service using a mobile device wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein at least one of the member profiles includes advertisement information associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access mechanism associated with the mobile device, wherein the Internet access mechanism is in operative communication with
- At least one of the result and the advertisement information that are sent back to the mobile device may be displayed on a screen (e.g., a display screen and/or a touch screen) of the mobile device.
- the search service may be integrated into the social networking service.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence.
- the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- a method for interacting with a social networking service using a mobile device wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the method comprising: receiving at a search service, from the mobile device, at least one search term and at least one source image, wherein the source image includes a plurality of representations of a plurality of faces; comparing, using the search service, the search term to at least some of the member descriptors; comparing, using the search service, at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member
- the mobile device produces the augmented source image based upon the original source image and the result that is sent back to the mobile device.
- the result that is sent back to the mobile device includes the augmented source image from the search service (in this example, the search service may produce the augmented source image based upon the original source image that is provided to the search service from the mobile device).
- mobile device 101 may communicate (e.g., bi-directionally) with Search Service 103 via Internet 105 .
- mobile device 101 may include a display device screen 101 A and Camera 101 B.
- Search Service 103 may be a website, one or more server computers, and/or other mechanism for providing various search functionality as described herein.
- Search Service 103 may communicate (e.g., bi-directionally) with Social Networking Service 107 via Internet 105 .
- Social Networking Service 107 may be a website, one or more server computers, and/or other mechanism for providing various social networking service functionality.
- Search Service 103 may communicate (e.g., bi-directionally) with Social Networking Service 107 via a private communication channel (e.g., private network).
- a private communication channel e.g., private network
- Such private communication channel may supplement or replace the Internet communication between Search Service 103 and Social Networking Service 107 .
- mobile device 201 may communicate (e.g., bi-directionally) with Search Service 203 via Internet 205 .
- mobile device 201 may include screen 201 A and Camera 201 B.
- the system of this FIG. 2 is similar to the system of FIG. 1 , with the main difference being that in the system of this FIG. 2 , Search Service 203 may be integrated with Social Networking Service 207 (e.g., Search Service 203 and Social Networking Service 207 may be a website, one or more server computers, and/or other mechanism for providing various social networking service and search functionality described herein).
- Social Networking Service 207 e.g., Search Service 203 and Social Networking Service 207 may be a website, one or more server computers, and/or other mechanism for providing various social networking service and search functionality described herein).
- FIGS. 3 and 4 show a mobile device and application according to an embodiment of the present invention.
- the mobile device may be a phone.
- FIG. 5 shows a flowchart depicting the methodology for the social networking service interaction according to one embodiment that is associated with the mobile device and application of FIGS. 3 and 4 .
- mobile device 301 may have associated therewith a screen 303 (in various examples, screen 303 may be a display screen or a touch screen). Further, mobile device 301 may have associated therewith a camera.
- the user has focused the camera of the mobile device on a group of people and the camera has been used to take a photograph of the group of people—the photograph is shown on the screen 303 (this embodiment will be described with reference to the camera taking a single still digital image or photograph; in other examples, the camera may be a video camera and the resultant video stream (or portion thereof) may be used essentially as described herein in place of the single still photograph).
- facial detection has been performed on the photograph (e.g., via facial detection software using one or more appropriate algorithms) to detect a plurality of faces (e.g., every human face in the photograph).
- the facial detection is carried out at the mobile device.
- the source image may be sent from the mobile device to the search service to carry out the facial detection at the search service.
- the application on the mobile device gathers, from a user of the mobile device, one more search terms (this may be carried out, for example, via the user interface 305 seen in FIGS. 3 and 4 ).
- the user may be presented with a text box (or the like) to type in one or more search terms and the user may be presented with a search button (or the like) to initiate searching.
- the two search terms such as specific Nationality and specific Language have been entered by the user.
- Boolean AND operators may applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- Boolean OR operators may be applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- Boolean NOT operators may be applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- Boolean NAND operators may be applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- Boolean NOR operators may be applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- Boolean XOR operators may be applied to the search terms to generate the “search term matches” (see step 505 carried out by the Search Service below).
- the search term(s) and the face information are sent to a Search Service (see, e.g., Search Service 103 of FIG. 1 or Search Service 203 of FIG. 2 ).
- the Search Service will interact with a Social Networking Service (see, e.g., Social Networking Service 107 of FIG. 1 or Social Networking Service 207 of FIG. 2 ) to identify members of the Social Networking Service having profile information that matches one or more of the search terms (in this example, Nationality and Language)—these matches may be referred to as “search term matches”.
- the Search Service will also interact with the Social Networking Service to identify faces of members of the Social Networking Service that match the face information from the image or photograph of the group of people taken by the camera—these matches may be referred to as “face matches.”
- the search term comparison may be done first, to minimize the size of the set of test data for the facial identification aspect.
- the search term comparison may be done after the facial identification aspect.
- the search term comparison may be done essentially in parallel with the facial identification aspect.
- one or more results may be sent back to the application on the mobile device.
- the results may reflect a set of Boolean “search term matches” AND “face matches” (wherein the results comprise face matches for members having profile information matching one or more search terms).
- the result(s) may be indicated on the screen 303 of the mobile device 301 by highlighting (or otherwise identifying) in the image or photograph of the group of people one or more faces (see 307 of FIG. 4 ) of social networking service members identified at step 505 .
- the Search Service will interact with the Social Networking Service using facial recognition software and/or algorithms to identify faces of members of the Social Networking Service that match the face information from the photograph of the group of people taken by the camera.
- the mobile device will detect face(s) in an original image, the mobile device will store the original image, the mobile device will send one or more search terms along with face information describing the detected face(s) to a Search Service, the Search Service will return one or more results as described herein, and the mobile device will augment (based on the returned results) the original image as described herein.
- the face information describing the detected face(s) may be in the form of metadata.
- the returned results may be in the form of metadata.
- the mobile device sends one or more search terms along with an original image to a Search Service and the Search Service returns one or more results as described herein.
- the returned results may be in the form of an augmented original image with one or more faces highlighted (or otherwise identified).
- the Search Service may interact with the Social Networking Service to perform the “search term matches” as follows:
- search term matches a user profile (with given search criteria) will be searched for the identified faces.
- the Search Service may interact with the Social Networking Service to perform the “face matches” as follows:
- a validation method in the Social Networking Service while creating the user profile, a web cam installed in the computer will capture the photograph of the user, and a digital photo ID card can be scanned to create user profile. Once the person is recognized, then software will use that face to identify the person uniquely. This Face information can be different from that of the profile photo. This face information may be used for identifying any person uniquely.
- the mobile device e.g., phone
- the identified human face will be searched against the user's photograph in the Social Networking Service as mentioned above. This is refers “face matches”
- any programming language which can perform internet search can be used.
- C++ Java
- Java any programming language which can perform internet search
- any platform which supports internet search e.g., Android, iPhone
- any platform which supports internet search e.g., Android, iPhone
- a mobile device does the face search (in this example, a database of all faces from the Social Networking Service may be on (or accessible by) the mobile device.
- mobile device sends pictures of faces to the Search Service.
- the faces can be recognized (e.g., at the Search Service side) automatically based on different face detection/recognition methods. Images may be sent to one or more Social Networking Services to find matching faces and/or user profile. In one specific example:
- Images are analyzed on the mobile device and broken into a set of subimages of individual faces. 2. These individual faces are sent from the mobile device to the Search Service/Social Networking Service for potential recognition 3.
- the Search Service/Social Networking Service compares each of the individual faces to compare for matches vs the profile faces stored on the Social Networking Service (e.g., Social Networking Service profile server). 4. Every individual face image search request is responded to from the Search Service/Social Networking Service server. Matching faces are identified and profile information is retrieved from the Social Networking Service profile server. Non-matching faces get a response indicating there is no profile information. 5. Results are sent back to the mobile device.
- any desired face detection and/or recognition methods known by those of ordinary skill in the art may be utilized.
- Specific examples include (but are not limited to) the following (each of the following documents is incorporated herein by reference in its entirety): (a) http://www.facedetection.com/facedetection/techniques.htm; (b) http://www.stanford.edu/class/ee368/Project — 03/Project/reports/ee368group02.pdf (“face Detection” by Kim, Shim and Yang); (c) http://en.wikipedia.org/wiki/Face_detection; (d) “http://www.tlc2.uh.edu/swtc/RnD/RD_Projects/facial_recognition/; and (e) http://en.wikipedia.org/wiki/Facial_recognition_system.
- the form of the data in the results (that are returned to the mobile device) that enables the mobile device to augment the original image may include (but not be limited to) one or more of the following:
- faces with specified criteria may be identified. And the faces may be highlighted (e.g., with block or other indicium). Further, advertisement or any other information may be displayed (e.g., over the identified face).
- profile info that is accessible (e.g., based on the security level of the requestor) like telephone numbers, occupation, email/SMS info, address, friend level could be returned to be viewed and/or used to call, SMS and/or email the person.
- the indicia could, based on the friend level, have a different block highlighting, shading or the like.
- the format of the data could be an XML Tag/Value type of format so that the type of information and value are clearly identified.
- a mobile device may correlate the results that are returned to the faces in the original image by a mechanism or process that may include (but not be limited to) one or more of the following:
- the faces may be identified based on the user's profile search.
- some identified advertisements may (also) be displayed along with the identified faces.
- the image (e.g., the original image) is split into individual faces at the mobile device, and each face given a tag before being sent to the Search Service/Social Networking Service.
- the Search Service/Social Networking Service then responds with the tag number and the results info. That way the info can be easily correlated back to the original image (e.g., for augmentation at the mobile device).
- the mobile device may send the original image (or a copy of the original image) to the Search Service (or to any desired other computer) to detect the faces for the mobile device.
- the Search Service (or any desired other computer) may send back to the mobile device an indication of where in the original image each face occurs. The mobile device may then use this information to augment the original image as described herein.
- this hardware configuration has at least one processor or central processing unit (CPU) 611 .
- the CPUs 611 are interconnected via a system bus 612 to a random access memory (RAM) 614 , read-only memory (ROM) 616 , input/output (I/O) adapter 618 (for connecting peripheral devices such as disk units 621 and tape drives 640 to the bus 612 ), user interface adapter 622 (for connecting a keyboard 624 , mouse 626 , speaker 628 , microphone 632 , and/or other user interface device to the bus 612 ), a communications adapter 634 for connecting the system 600 to a data processing network, the Internet, an Intranet, a local area network (LAN), etc., and a display adapter 636 for connecting the bus 612 to a display device 638 and/or printer 639 (e.g., a digital printer or the like).
- RAM random access memory
- ROM read-only memory
- I/O input/output
- user interface adapter 622 for connecting
- Various embodiments of the present invention may help the new person to establish social networking contacts (in one example, one or more images may be used to find a specific human being from a crowd based on some search criteria).
- the present invention may provide a way to find this out by linking facial recognition with searches of Social Networking Services that associate a photo of a person with his or her personal data.
- various embodiments of the present invention may provide for using a mobile phone camera, a PDA, a camera with internet access, or the like to match human faces in a photo with some search criteria.
- a Social Networking Service containing a suitable facial image
- this profile information may be searched to find matches for faces in the photo.
- profile information may be of the type shown in Tables 1 and 2, below (various information may be made available by a Social Networking Service to everyone (e.g., the entire world) or a restricted group of people):
- a “friend” level search request e.g., level 2 to identify “Friends” and “Friends-Of-Friends”
- face information e.g., image(s)
- this technique may sometimes be referred to herein as “Technique 2”.
- Sending face information e.g., image(s)
- a plurality of people in a group photograph along with at least one of: specific profile search terms (see Technique 1 above); and/or a “friend” level search request (see Technique 2 above) and using the search result(s) to augment the original group photo with highlighted matches.
- specific profile search terms see Technique 1 above
- a “friend” level search request see Technique 2 above
- Sending face information e.g., image(s)
- image(s) corresponding to one or more people
- a social networking service contains user profiles. Associated with at least some of the user profiles are one or more advertisements (in one example, the advertisements may be placed in a dedicated section called “advertisements” or the like).
- the advertisement(s) may be placed by user(s) desiring to provide information related to their work, the services that they can provide, the products that they can provide or the like.
- one social networking service user (“User A”) may provide advertisement information to the effect that “I sell real estate”.
- one social networking service user (“User B”) may provide advertisement information to the effect that “I am a plumber, and I charge $40/hour”.
- the advertisement may be returned and shown (along with the other result(s)) to the user (even though the text in the advertisement is not in the search criteria).
- the advertisement may be displayed in a different color (e.g., a color different from the surrounding color).
- the user may utilize the invention to find friends, friends-of-friends, etc. by focusing a mobile device camera on a group of people.
- the user may type “Friend” in the search box as a search request.
- the user may type “Friend+1” in the search box as a search request.
- the user may type “Friend+2” in the search box as a search request.
- search results from these types of searches may be displayed to the user as described herein (e.g., one or more faces in a group of people may be highlighted or otherwise identified on the mobile device display screen).
- This “friend-of-friend” type searching may make use of the idea of “Six degrees of separation (also referred to as the “Human Web”) that describes the idea that everyone is on average approximately six “steps” away from another person on earth so that a chain of “a friend of a friend” statements can be made, on average, to connect any two people in six steps or fewer. This is thus a very powerful way to navigate the Human Web. It may be particularly powerful and useful when a person is traveling in a foreign country and the chances of finding a “Friend” or even a “Friend+1” would typically be fairly remote.
- a method and/or system that provides searching of a human being via use of a mobile phone camera to match human faces in a photo with some search criteria.
- Searching with face recognition and social networking profiles storing the profile information in a social networking channel associated with one or more social networking services; enabling a user to type his or her search requirement(s); enabling a user to focus a mobile phone camera on a group of people; enabling the detection of the identification of one or more human beings based at least in part upon the search requirement(s); enabling users to advertise themselves; enabling a user to find friends by focusing the mobile phone camera toward an individual or a crowd and providing a friend level search requirement; and a six-step procedure for providing a highlighting for the identified faces in the captured image from a mobile phone camera (e.g., (1) user has focused the mobile phone camera on a crowd; (2) with face detection software every human face in the crowd will be identified (or detected), (3) software will gather the search requirement(s) of the user, (4) the search requirement(s) and identified face information will be sent to a social networking channel associated with one or more social networking services, (5) using facial recognition (or detection) software to identify faces which match the search criteria
- the present invention may provide a mobile device with augmented reality functionality.
- aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
- the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
- a computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
- a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
- the containment (or storage) of the program may be non-transitory.
- a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof.
- a computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
- Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
- Computer program code for carrying out operations for aspects of the present invention may be written in any programming language or any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like or a procedural programming language, such as the “C” programming language or similar programming languages.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- LAN local area network
- WAN wide area network
- Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
- These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus or other devices provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Processing Or Creating Images (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Methods for performing on-line searching, and particularly, to searching with face recognition and social networking profiles. In one example, one or more methods may be provided with regard to searching with face recognition and social networking profiles.
Description
- This application is a continuation of U.S. application Ser. No. 13/240,022 filed Sep. 22, 2011, the entire content and disclosure of which is incorporated by reference
- The present disclosure relates generally to on-line searching methods, and particularly, to searching with face recognition and social networking profiles.
- Various face detection and image searching patent-related documents have been published. These include the following: United States Patent Application Publication 2009/0234842 in the name of Luo et al., entitled IMAGE SEARCH USING FACE DETECTION; United States Patent Application Publication 2010/0135584 in the name of Tang et al., entitled IMAGE-BASED FACE SEARCH; and United States Patent Application Publication 2010/0272363 in the name of Steinberg et al., entitled FACE SEARCHING AND DETECTION IN A DIGITAL IMAGE ACQUISITION SYSTEM.
- In one embodiment a method for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the method comprising: receiving at a search service, from the mobile device, at least one search term and at least one source image, wherein the source image includes a plurality of representations of a plurality of faces; comparing, using the search service, the search term to at least some of the member descriptors; comparing, using the search service, at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images; and sending back to the mobile device, from the search service, at least one result identifying at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image; wherein the result that is sent back to the mobile device is used to display on the screen (e.g., a display screen and/or a touch screen) of the mobile device an augmented source image with at least one indicium identifying the at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image.
- Various objects, features and advantages of the present invention will become apparent to one skilled in the art, in view of the following detailed description taken in combination with the attached drawings, in which:
-
FIG. 1 depicts a block diagram of a system according to one embodiment of the present invention; -
FIG. 2 depicts a block diagram of a system according to another embodiment of the present invention; -
FIG. 3 depicts a mobile device and application according to another embodiment of the present invention; -
FIG. 4 depicts again the mobile device and application ofFIG. 3 ; -
FIG. 5 depicts a flow chart relating toFIGS. 3 and 4 ; and -
FIG. 6 depicts a block diagram according to another embodiment of the present invention. - In one example, one or more systems may be provided with regard to searching with face recognition and social networking profiles.
- In another example, one or more methods may be provided with regard to searching with face recognition and social networking profiles.
- For the purposes of describing and claiming the present invention the term “social networking service” is intended to refer to an online service, platform or website that: (a) focuses on building, among a plurality of people, social network(s) and/or social relationship(s); (b) focuses on reflecting, as to a plurality of people, social network(s) and/or social relationship(s); and/or (c) includes a database containing, for each member of the database, at least a photograph and a profile containing descriptive information. In various examples, a social networking service as applied to an embodiment of the present invention may be selected from the group including (but not limited to): GOOGLE+, GOOGLE BUZZ, FACEBOOK, TWITTER, FOURSQUARE, LINKEDIN and FLICKR.
- For the purposes of describing and claiming the present invention the term “mobile device” is intended to refer to any generally portable device having network access (e.g. Internet access) and including a camera mechanism. In various examples, a mobile device as applied to embodiments of the present invention may be selected from the group including (but not limited to): a mobile phone (e.g., a “smart phone” or a “feature phone”), a tablet (e.g., an iPad), a PDA (personal digital assistant), and a dedicated camera (including network access). Of note, such network access may be available to the mobile device wirelessly and/or through a wired mechanism (such a wired mechanism may include a removable plug or the like, so that portability is maintained).
- For the purposes of describing and claiming the present invention the term “search service” is intended to refer to an online service, platform or website that: provides the search functionality described herein. In various examples, such a search service may comprise: (a) computer software; (b) computer hardware; (c) computer firmware; and/or (d) a combination thereof.
- For the purposes of describing and claiming the present invention the term “application” (such as used in the context of an application associated with a mobile device) is intended to refer to a mechanism that provides the functionality described herein. In various examples, such an application may comprise: (a) computer software; (b) computer hardware; (c) computer firmware; and/or (d) a combination thereof.
- For the purposes of describing and claiming the present invention the term “camera” (such as used in the context of a camera included with a mobile device) is intended to refer to a mechanism that provides still image capture and/or video image capture.
- For the purposes of describing and claiming the present invention the term “Internet access” is intended to refer to the ability to connect (e.g., bi-directionally) with the Internet. In various examples Internet access as applied to embodiments of the present invention may be selected from the group including (but not limited to): access via Wi-Fi, access via Bluetooth, access via a cell phone network (e.g., a 2G network, a 3G network, or a 4G network), and access via a wired mechanism (such a wired mechanism may include a removable plug or the like, so that portability is maintained).
- For the purposes of describing and claiming the present invention the term “friend” is intended to refer to a member of a social networking service who has indicated a willingness to be identified as such with respect to another person or persons.
- For the purposes of describing and claiming the present invention the term “friend identifier” is intended to refer to an indication identifying a person's social networking service friend.
- For the purposes of describing and claiming the present invention the term “friend level indicator” is intended to refer to how many search iterations regarding friends-of-friends are to be performed (for example, a friend level indicator of 2 would mean that a search should encompass friends as well as friends-of-friends; in another example, a friend level indicator of 3 would mean that a search should encompass friends, friends-of-friends, as well as friends-of-friends-of-friends).
- For the purposes of describing and claiming the present invention the term “representation of a face” is intended to refer to a representation of all or part of a face.
- For the purposes of describing and claiming the present invention the term “approximate match within a degree of confidence” is intended to refer to a facial recognition match that is not an exact match but that is deemed a match by meeting certain parameters defined by a facial recognition algorithm. In one example, an approximate match within a degree of confidence may be found by comparing selected facial features. In another example, an approximate match within a degree of confidence may depend upon factors including (but not limited to) the following parameters: appearance of facial hair and/or accessories such as glasses etc.
- In one embodiment a computer-implemented system for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the user interface at least one search term, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access mechanism associated with the mobile device, wherein the Internet access mechanism is in operative communication with the application and wherein the Internet access mechanism provides at least the search term and at least some of the representations of the faces in the source image to the search service; wherein the search service is in operative communication with the social networking service, wherein the search service compares the search term to at least some of the member descriptors; wherein the search service compares at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images, and wherein the search service provides at least one result identifying at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image; wherein the search service sends the result back to the mobile device via at least the Internet access mechanism of the mobile device; and wherein the result that is sent back to the mobile device is displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least one indicium identifying the at least one member who has: (a) a descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image.
- In one example: the search service may provide at least a first result identifying at least a first member who has: (a) a descriptor that is a match to the search term from the mobile device; and (b) a member image including a representation of a face that is a match to a first one of the representation of faces in the source image; and the search service may provide at least a second result identifying at least a second member who has: (a) a member descriptor that is a match to the search term from the mobile device; and (b) a member image including a representation of a face that is a match to a second one of the representation of faces in the source image.
- In another example: the first result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a first indicium identifying the first member; and the second result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a second indicium identifying the second member.
- In another example, the search service may be integrated into the social networking service.
- In another example, a member descriptor that is a match to the search term from the mobile device may be an essentially exact match to the search term.
- In another example, a member descriptor that is a match to the search term from the mobile device may be a match to the search term that is an approximate match within a degree of confidence.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence. In another example, a user may have an option to change a “degree of confidence level” (e.g., a user may change a % age match from 100% to 75% match etc.).
- In another example, the present invention may utilize any conventional facial detection/recognition software and/or algorithms.
- In another example, the search term may comprise a plurality of search terms.
- In another example, the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- In one embodiment a computer-implemented system for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the user interface at least one friend identifier, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access mechanism associated with the mobile device, wherein the Internet access mechanism is in operative communication with the application and wherein the Internet access mechanism provides at least the friend identifier and at least some of the representations of the faces in the source image to the search service; wherein the search service is in operative communication with the social networking service, wherein the search service compares at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images associated with members who are indicated in the social networking service as friends of the member identified by the friend identifier, and wherein the search service provides at least one result identifying at least one member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image; wherein the search service sends the result back to the mobile device via at least the Internet access mechanism of the mobile device; and wherein the result that is sent back to the mobile device is displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least one indicium identifying the at least one member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image.
- In one example: the search service may provide at least a first result identifying at least a first member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image; and the search service may provide at least a second result identifying at least a second member who is indicated in the social networking service as a friend of the member identified by the friend identifier and who has a member image including a representation of a face that is a match to a representation of a face in the source image.
- In another example: the first result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a first indicium identifying the first member; and the second result that is sent back to the mobile device may be displayed on the screen (e.g., a display screen and/or a touch screen) of the mobile device by augmenting the source image with at least a second indicium identifying the second member.
- In another example, the search service may be integrated into the social networking service.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence.
- In another example, the friend identifier may comprise a plurality of friend identifiers.
- In another example: the application may further receive from the user interface a friend level indicator; and the search service may perform iterative searching of friends-of-friends based at least in part upon the friend level indicator and the friend identifier.
- In another example, the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- In another embodiment a computer-implemented system for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein at least one of the member profiles includes advertisement information associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the system comprising: a search service associated with the social networking service; an application associated with the mobile device, wherein the application is in operative communication with the camera, wherein the application provides a user interface, wherein the application receives from the camera at least one source image, and wherein the source image includes a plurality of representations of a plurality of faces; and an Internet access mechanism associated with the mobile device, wherein the Internet access mechanism is in operative communication with the application and wherein the Internet access mechanism provides at least some of the representations of the faces in the source image to the search service; wherein the search service is in operative communication with the social networking service, wherein the search service compares at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images, and wherein the search service provides at least one result identifying at least one member who has a member image including a representation of a face that is a match to a representation of a face in the source image; wherein the search service sends the result back to the mobile device via at least the Internet access mechanism of the mobile device; and wherein the search service sends at least some of the advertisement information associated with the member who has a member image including a representation of a face that is a match to a representation of a face in the source image back to the mobile device via at least the Internet access mechanism of the mobile device.
- In one example, at least one of the result and the advertisement information that are sent back to the mobile device may be displayed on a screen (e.g., a display screen and/or a touch screen) of the mobile device.
- In another example, the search service may be integrated into the social networking service.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an essentially exact match.
- In another example, a representation of a face in a member image that is a match to a representation of a face in the source image may be an approximate match within a degree of confidence.
- In another example, the mobile device may be selected from the group including (but not limited to): (a) a mobile phone, (b) a tablet, (c) a PDA, and (d) a dedicated camera, video or like image capture device.
- In another embodiment a method for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen (e.g., a display screen and/or a touch screen) is provided, the method comprising: receiving at a search service, from the mobile device, at least one search term and at least one source image, wherein the source image includes a plurality of representations of a plurality of faces; comparing, using the search service, the search term to at least some of the member descriptors; comparing, using the search service, at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images; and sending back to the mobile device, from the search service, at least one result identifying at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image; wherein the result that is sent back to the mobile device is used to display on the screen (e.g., a display screen and/or a touch screen) of the mobile device by an augmented source image with at least one indicium identifying the at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image. In one example, the mobile device produces the augmented source image based upon the original source image and the result that is sent back to the mobile device. In another example, the result that is sent back to the mobile device includes the augmented source image from the search service (in this example, the search service may produce the augmented source image based upon the original source image that is provided to the search service from the mobile device).
- Referring now to
FIG. 1 , a block diagram according to one embodiment of the present invention is shown. As seen in thisFIG. 1 ,mobile device 101 may communicate (e.g., bi-directionally) withSearch Service 103 viaInternet 105. In one example,mobile device 101 may include adisplay device screen 101A andCamera 101B. In one example,Search Service 103 may be a website, one or more server computers, and/or other mechanism for providing various search functionality as described herein. Further,Search Service 103 may communicate (e.g., bi-directionally) withSocial Networking Service 107 viaInternet 105. In one example,Social Networking Service 107 may be a website, one or more server computers, and/or other mechanism for providing various social networking service functionality. In another example,Search Service 103 may communicate (e.g., bi-directionally) withSocial Networking Service 107 via a private communication channel (e.g., private network). Such private communication channel (shown inFIG. 1 as a dashed line) may supplement or replace the Internet communication betweenSearch Service 103 andSocial Networking Service 107. - Referring now to
FIG. 2 , a block diagram according to another embodiment of the present invention is shown. As seen in thisFIG. 2 ,mobile device 201 may communicate (e.g., bi-directionally) withSearch Service 203 viaInternet 205. In one example,mobile device 201 may includescreen 201A andCamera 201B. The system of thisFIG. 2 is similar to the system ofFIG. 1 , with the main difference being that in the system of thisFIG. 2 ,Search Service 203 may be integrated with Social Networking Service 207 (e.g.,Search Service 203 andSocial Networking Service 207 may be a website, one or more server computers, and/or other mechanism for providing various social networking service and search functionality described herein). - Reference will now be made to
FIGS. 3-5 .FIGS. 3 and 4 show a mobile device and application according to an embodiment of the present invention. In one example, the mobile device may be a phone.FIG. 5 shows a flowchart depicting the methodology for the social networking service interaction according to one embodiment that is associated with the mobile device and application ofFIGS. 3 and 4 . As seen in these Figs,mobile device 301 may have associated therewith a screen 303 (in various examples,screen 303 may be a display screen or a touch screen). Further,mobile device 301 may have associated therewith a camera. - As seen in
FIGS. 3 and 4 , and as described atstep 501 ofFIG. 5 , the user has focused the camera of the mobile device on a group of people and the camera has been used to take a photograph of the group of people—the photograph is shown on the screen 303 (this embodiment will be described with reference to the camera taking a single still digital image or photograph; in other examples, the camera may be a video camera and the resultant video stream (or portion thereof) may be used essentially as described herein in place of the single still photograph). - Next, at
step 502 ofFIG. 5 , facial detection has been performed on the photograph (e.g., via facial detection software using one or more appropriate algorithms) to detect a plurality of faces (e.g., every human face in the photograph). In this example, the facial detection is carried out at the mobile device. In another example, the source image may be sent from the mobile device to the search service to carry out the facial detection at the search service. - Next, at
step 503 ofFIG. 5 , the application on the mobile device gathers, from a user of the mobile device, one more search terms (this may be carried out, for example, via theuser interface 305 seen inFIGS. 3 and 4 ). In one example, the user may be presented with a text box (or the like) to type in one or more search terms and the user may be presented with a search button (or the like) to initiate searching. In the example shown in these Figs. (which example is intended to be illustrative and not restrictive), the two search terms such as specific Nationality and specific Language have been entered by the user. In another example, Boolean AND operators may applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). In another example, Boolean OR operators may be applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). In another example, Boolean NOT operators may be applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). In another example, Boolean NAND operators may be applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). In another example, Boolean NOR operators may be applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). In another example, Boolean XOR operators may be applied to the search terms to generate the “search term matches” (seestep 505 carried out by the Search Service below). - Next, at
step 504 ofFIG. 5 , the search term(s) and the face information (identified at step 502) are sent to a Search Service (see, e.g.,Search Service 103 ofFIG. 1 orSearch Service 203 ofFIG. 2 ). - Next, at
step 505 ofFIG. 5 , the Search Service will interact with a Social Networking Service (see, e.g.,Social Networking Service 107 ofFIG. 1 orSocial Networking Service 207 ofFIG. 2 ) to identify members of the Social Networking Service having profile information that matches one or more of the search terms (in this example, Nationality and Language)—these matches may be referred to as “search term matches”. The Search Service will also interact with the Social Networking Service to identify faces of members of the Social Networking Service that match the face information from the image or photograph of the group of people taken by the camera—these matches may be referred to as “face matches.” In one example, the search term comparison may be done first, to minimize the size of the set of test data for the facial identification aspect. In another example, the search term comparison may be done after the facial identification aspect. In another example, the search term comparison may be done essentially in parallel with the facial identification aspect. - Next, at
step 506 ofFIG. 5 , one or more results may be sent back to the application on the mobile device. In one example, the results may reflect a set of Boolean “search term matches” AND “face matches” (wherein the results comprise face matches for members having profile information matching one or more search terms). In another example, the result(s) may be indicated on thescreen 303 of themobile device 301 by highlighting (or otherwise identifying) in the image or photograph of the group of people one or more faces (see 307 ofFIG. 4 ) of social networking service members identified atstep 505. - In one example, the Search Service will interact with the Social Networking Service using facial recognition software and/or algorithms to identify faces of members of the Social Networking Service that match the face information from the photograph of the group of people taken by the camera.
- In another example, the mobile device will detect face(s) in an original image, the mobile device will store the original image, the mobile device will send one or more search terms along with face information describing the detected face(s) to a Search Service, the Search Service will return one or more results as described herein, and the mobile device will augment (based on the returned results) the original image as described herein. In one specific example, the face information describing the detected face(s) may be in the form of metadata. In another specific example, the returned results may be in the form of metadata.
- In another example, the mobile device sends one or more search terms along with an original image to a Search Service and the Search Service returns one or more results as described herein. In one specific example, the returned results may be in the form of an augmented original image with one or more faces highlighted (or otherwise identified).
- In another example, the Search Service may interact with the Social Networking Service to perform the “search term matches” as follows:
- 1. User provides any search term with AND . . . OR condition, following is one specific example: “Doctor” AND “Spanish” AND “Gold Medalists.” This may be a free text keyword.
2. Once any mobile device (e.g., phone) software (using camera) detects any one or more human faces, then the identified faces will be searched in the Social Networking Service (e.g., Facebook, LinkedIn, etc).
3. Once the faces are identified in the Social Networking Service then based on the text search criteria, the software will search the profile of each identified person (Faces).
4. In a social network profile setting, a user may have provided his education, language known, profession etc. So the search will be performed in the user profile.
5. Once the software identifies any such matching criteria, the appropriate faces will be highlighted on the mobile device screen. - So, in the above example of “search term matches”, a user profile (with given search criteria) will be searched for the identified faces.
- In another example, the Search Service may interact with the Social Networking Service to perform the “face matches” as follows:
- While creating any social network profile, user uploads his photograph.
- In this case, there can be a validation method in the Social Networking Service while creating the user profile. For example, while creating the user profile, a web cam installed in the computer will capture the photograph of the user, and a digital photo ID card can be scanned to create user profile. Once the person is recognized, then software will use that face to identify the person uniquely. This Face information can be different from that of the profile photo. This face information may be used for identifying any person uniquely.
- Now, once any human face is identified by the mobile device (e.g., phone), then the identified human face will be searched against the user's photograph in the Social Networking Service as mentioned above. This is refers “face matches”
- In another example, any programming language which can perform internet search can be used. For example, C++, Java.
- In another example, any platform which supports internet search. (e.g., Android, iPhone) may be utilized.
- In another example, a mobile device does the face search (in this example, a database of all faces from the Social Networking Service may be on (or accessible by) the mobile device.
- In another example, mobile device sends pictures of faces to the Search Service.
- In another example, the faces can be recognized (e.g., at the Search Service side) automatically based on different face detection/recognition methods. Images may be sent to one or more Social Networking Services to find matching faces and/or user profile. In one specific example:
- 1. Images are analyzed on the mobile device and broken into a set of subimages of individual faces.
2. These individual faces are sent from the mobile device to the Search Service/Social Networking Service for potential recognition
3. The Search Service/Social Networking Service compares each of the individual faces to compare for matches vs the profile faces stored on the Social Networking Service (e.g., Social Networking Service profile server).
4. Every individual face image search request is responded to from the Search Service/Social Networking Service server. Matching faces are identified and profile information is retrieved from the Social Networking Service profile server. Non-matching faces get a response indicating there is no profile information.
5. Results are sent back to the mobile device. - In various examples, any desired face detection and/or recognition methods known by those of ordinary skill in the art may be utilized. Specific examples include (but are not limited to) the following (each of the following documents is incorporated herein by reference in its entirety): (a) http://www.facedetection.com/facedetection/techniques.htm; (b) http://www.stanford.edu/class/ee368/Project—03/Project/reports/ee368group02.pdf (“face Detection” by Kim, Shim and Yang); (c) http://en.wikipedia.org/wiki/Face_detection; (d) “http://www.tlc2.uh.edu/swtc/RnD/RD_Projects/facial_recognition/; and (e) http://en.wikipedia.org/wiki/Facial_recognition_system.
- In another example, the form of the data in the results (that are returned to the mobile device) that enables the mobile device to augment the original image may include (but not be limited to) one or more of the following:
- Based on the search criteria, faces with specified criteria may be identified. And the faces may be highlighted (e.g., with block or other indicium). Further, advertisement or any other information may be displayed (e.g., over the identified face).
- In another example, profile info that is accessible (e.g., based on the security level of the requestor) like telephone numbers, occupation, email/SMS info, address, friend level could be returned to be viewed and/or used to call, SMS and/or email the person. Also the indicia could, based on the friend level, have a different block highlighting, shading or the like.
- In another example, the format of the data could be an XML Tag/Value type of format so that the type of information and value are clearly identified.
- In another example, a mobile device may correlate the results that are returned to the faces in the original image by a mechanism or process that may include (but not be limited to) one or more of the following:
- In one example, the faces may be identified based on the user's profile search. In another example, some identified advertisements may (also) be displayed along with the identified faces.
- For example, once advertisement or other information is identified against any face, then automatically the system knows whose information relates, and then augments the result. This is one example correlation.
- In another example, the image (e.g., the original image) is split into individual faces at the mobile device, and each face given a tag before being sent to the Search Service/Social Networking Service. The Search Service/Social Networking Service then responds with the tag number and the results info. That way the info can be easily correlated back to the original image (e.g., for augmentation at the mobile device).
- In another example, the mobile device may send the original image (or a copy of the original image) to the Search Service (or to any desired other computer) to detect the faces for the mobile device. In this example, the Search Service (or any desired other computer) may send back to the mobile device an indication of where in the original image each face occurs. The mobile device may then use this information to augment the original image as described herein.
- Referring now to
FIG. 6 , this Fig. shows a hardware configuration ofcomputing system 600 according to an embodiment of the present invention. As seen, this hardware configuration has at least one processor or central processing unit (CPU) 611. TheCPUs 611 are interconnected via asystem bus 612 to a random access memory (RAM) 614, read-only memory (ROM) 616, input/output (I/O) adapter 618 (for connecting peripheral devices such asdisk units 621 and tape drives 640 to the bus 612), user interface adapter 622 (for connecting akeyboard 624,mouse 626,speaker 628,microphone 632, and/or other user interface device to the bus 612), acommunications adapter 634 for connecting thesystem 600 to a data processing network, the Internet, an Intranet, a local area network (LAN), etc., and adisplay adapter 636 for connecting thebus 612 to adisplay device 638 and/or printer 639 (e.g., a digital printer or the like). - Reference will now be made to an example use case according to an embodiment of the present invention (of course, this example is intended to be illustrative and not restrictive):
- When a person moves to a new location, he or she will often not know anyone. Every face he or she meets is typically an unknown for the person. It can be very difficult for the person to find a particular community or to establish social networking circles. Various embodiments of the present invention may help the new person to establish social networking contacts (in one example, one or more images may be used to find a specific human being from a crowd based on some search criteria).
- In this specific example, there is a cricket match between Country “A” and Country “B”. A spectator wants to enjoy the cricket match and get a seat in a place where there is a relatively high concentration of Country “A” team fans that speak a specific language. The present invention may provide a way to find this out by linking facial recognition with searches of Social Networking Services that associate a photo of a person with his or her personal data.
- As described herein, various embodiments of the present invention may provide for using a mobile phone camera, a PDA, a camera with internet access, or the like to match human faces in a photo with some search criteria. When users of a Social Networking Service containing a suitable facial image provide profile information, this profile information may be searched to find matches for faces in the photo. In two examples (which examples are intended to be illustrative and not restrictive), profile information may be of the type shown in Tables 1 and 2, below (various information may be made available by a Social Networking Service to everyone (e.g., the entire world) or a restricted group of people):
-
TABLE 1 Language Known Previous and Current Employers Native Place School and College Likes and Dislikes Technical Knowledge Choice of Food Etc. -
TABLE 2 Looking For (e.g., friendship, networking) Current City Hometown Political Views Religious Views Favorite Quotation Language(s) Known Education and Work Employers School (e.g., high school, college, grad school) Etc. - As described herein, various embodiments of the present invention may provide for one or more of the following:
- Enabling a user to use a mobile phone camera to match human faces in a photo with some search criteria.
- Sending specific profile search terms (e.g., a specific job or profession and “a specific language or nationality) along with face information (e.g., image(s)) corresponding to one or more people to use to mine data from a social networking service (this technique may sometimes be referred to herein as “Technique 1”).
- Sending a “friend” level search request (e.g., level 2 to identify “Friends” and “Friends-Of-Friends”) along with face information (e.g., image(s)) corresponding to one or more people to use to mine data from a social networking service (this technique may sometimes be referred to herein as “Technique 2”).
- Sending face information (e.g., image(s)) corresponding a plurality of people in a group photograph along with at least one of: specific profile search terms (see Technique 1 above); and/or a “friend” level search request (see Technique 2 above) and using the search result(s) to augment the original group photo with highlighted matches.
- Sending face information (e.g., image(s)) corresponding to one or more people and augmenting the original photo(s) with advertising information based on information from a social networking service.
- As described herein, various embodiments of the present invention may provide for advertising as follows:
- A social networking service contains user profiles. Associated with at least some of the user profiles are one or more advertisements (in one example, the advertisements may be placed in a dedicated section called “advertisements” or the like). The advertisement(s) may be placed by user(s) desiring to provide information related to their work, the services that they can provide, the products that they can provide or the like. In one specific example (which example is intended to be illustrative and not restrictive), one social networking service user (“User A”) may provide advertisement information to the effect that “I sell real estate”. In another specific example (which example is intended to be illustrative and not restrictive), one social networking service user (“User B”) may provide advertisement information to the effect that “I am a plumber, and I charge $40/hour”.
- Now, if a user (e.g., a mobile device user) carries out a search (e.g., using “Technique 1” described above or “Technique 2” described above), then the advertisement may be returned and shown (along with the other result(s)) to the user (even though the text in the advertisement is not in the search criteria). In one example (which example is intended to be illustrative and not restrictive) the advertisement may be displayed in a different color (e.g., a color different from the surrounding color).
- As described herein, various embodiments of the present invention may provide for one or more of the following:
- The user may utilize the invention to find friends, friends-of-friends, etc. by focusing a mobile device camera on a group of people.
- In one example, if the user wants to find “friends” (e.g., as defined by a given social networking service), the user may type “Friend” in the search box as a search request. In another example, if the user wants to find “friends-of-friends”, the user may type “Friend+1” in the search box as a search request. In another example, if the user wants to find “friends-of-friends-of-friends”), the user may type “Friend+2” in the search box as a search request.
- Of course, the search results from these types of searches may be displayed to the user as described herein (e.g., one or more faces in a group of people may be highlighted or otherwise identified on the mobile device display screen).
- This “friend-of-friend” type searching may make use of the idea of “Six degrees of separation (also referred to as the “Human Web”) that describes the idea that everyone is on average approximately six “steps” away from another person on earth so that a chain of “a friend of a friend” statements can be made, on average, to connect any two people in six steps or fewer. This is thus a very powerful way to navigate the Human Web. It may be particularly powerful and useful when a person is traveling in a foreign country and the chances of finding a “Friend” or even a “Friend+1” would typically be fairly remote.
- As described herein, various embodiments of the present invention may provide for one or more of the following:
- A method and/or system that provides searching of a human being via use of a mobile phone camera to match human faces in a photo with some search criteria.
- Sending specific profile search terms along with one or multiple sets of face data to use to mine data from a social networking service; sending “friend” level search request(s) along with one or multiple sets of face data to data mine from a social networking service; sending multiple sets of face data (from a group photograph) in conjunction with one or more of the above search types and using the result(s) to augment the original group photo with highlighted matches; and sending sets of face data and augmenting the photos (face data) with advertising information based on information from a social networking service.
- Searching with face recognition and social networking profiles; storing the profile information in a social networking channel associated with one or more social networking services; enabling a user to type his or her search requirement(s); enabling a user to focus a mobile phone camera on a group of people; enabling the detection of the identification of one or more human beings based at least in part upon the search requirement(s); enabling users to advertise themselves; enabling a user to find friends by focusing the mobile phone camera toward an individual or a crowd and providing a friend level search requirement; and a six-step procedure for providing a highlighting for the identified faces in the captured image from a mobile phone camera (e.g., (1) user has focused the mobile phone camera on a crowd; (2) with face detection software every human face in the crowd will be identified (or detected), (3) software will gather the search requirement(s) of the user, (4) the search requirement(s) and identified face information will be sent to a social networking channel associated with one or more social networking services, (5) using facial recognition (or detection) software to identify faces which match the search criteria, and (6) highlighting the identified faces in the captured image).
- In other examples, the present invention may provide a mobile device with augmented reality functionality.
- In other examples, any steps described herein may be carried out in any appropriate desired order.
- As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
- Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The containment (or storage) of the program may be non-transitory.
- A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
- Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
- Computer program code for carrying out operations for aspects of the present invention may be written in any programming language or any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like or a procedural programming language, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- Aspects of the present invention may be described herein with reference to flowchart illustrations and/or block diagrams of methods, systems and/or computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
- The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus or other devices provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
- It is noted that the foregoing has outlined some of the objects and embodiments of the present invention. This invention may be used for many applications. Thus, although the description is made for particular arrangements and methods, the intent and concept of the invention is suitable and applicable to other arrangements and applications. It will be clear to those skilled in the art that modifications to the disclosed embodiments can be effected without departing from the spirit and scope of the invention. The described embodiments ought to be construed to be merely illustrative of some of the features and applications of the invention. Other beneficial results can be realized by applying the disclosed invention in a different manner or modifying the invention in ways known to those familiar with the art. In addition, all of the examples disclosed herein are intended to be illustrative, and not restrictive.
Claims (4)
1. A method for interacting with a social networking service using a mobile device, wherein the social networking service has associated therewith a plurality of member profiles corresponding to a respective plurality of members, wherein each of the member profiles includes at least one member descriptor associated with a respective member, wherein each of the member profiles includes at least one member image associated with a respective member, wherein each member image includes a representation of a face of the respective member, and wherein the mobile device includes at least a camera and a screen, the method comprising:
receiving at a search service, from the mobile device, at least one search term and at least one source image, wherein the source image includes a plurality of representations of a plurality of faces;
comparing, using the search service, the search term to at least some of the member descriptors;
comparing, using the search service, at least one of the representations of the faces in the source image to at least some of the representations of the faces in the member images; and
sending back to the mobile device, from the search service, at least one result identifying at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image;
wherein the result that is sent back to the mobile device is used to display on the screen of the mobile device an augmented source image with at least one indicium identifying the at least one member who has: (a) a member descriptor that is a match to the search term; and (b) a member image including a representation of a face that is a match to a representation of a face in the source image.
2. The method of claim 1 , wherein the mobile device produces the augmented source image based upon the source image and the result that is sent back to the mobile device.
3. The method of claim 1 , wherein the result that is sent back to the mobile device includes the augmented source image from the search service.
4. The method of claim 1 , wherein the steps are carried out in the order recited.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/455,658 US20130077835A1 (en) | 2011-09-22 | 2012-04-25 | Searching with face recognition and social networking profiles |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/240,022 US8917913B2 (en) | 2011-09-22 | 2011-09-22 | Searching with face recognition and social networking profiles |
US13/455,658 US20130077835A1 (en) | 2011-09-22 | 2012-04-25 | Searching with face recognition and social networking profiles |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/240,022 Continuation US8917913B2 (en) | 2011-09-22 | 2011-09-22 | Searching with face recognition and social networking profiles |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130077835A1 true US20130077835A1 (en) | 2013-03-28 |
Family
ID=47911345
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/240,022 Active 2032-09-03 US8917913B2 (en) | 2011-09-22 | 2011-09-22 | Searching with face recognition and social networking profiles |
US13/455,658 Abandoned US20130077835A1 (en) | 2011-09-22 | 2012-04-25 | Searching with face recognition and social networking profiles |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/240,022 Active 2032-09-03 US8917913B2 (en) | 2011-09-22 | 2011-09-22 | Searching with face recognition and social networking profiles |
Country Status (1)
Country | Link |
---|---|
US (2) | US8917913B2 (en) |
Cited By (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100306271A1 (en) * | 2008-12-29 | 2010-12-02 | Oded Shmueli | Query Networks Evaluation System and Method |
US20130198176A1 (en) * | 2012-01-26 | 2013-08-01 | Lg Electronics Inc. | Mobile terminal and photo searching method thereof |
US8600102B1 (en) * | 2011-09-19 | 2013-12-03 | Google Inc. | System and method of identifying advertisement in images |
US20140236980A1 (en) * | 2011-10-25 | 2014-08-21 | Huawei Device Co., Ltd | Method and Apparatus for Establishing Association |
US20150078726A1 (en) * | 2013-09-17 | 2015-03-19 | Babak Robert Shakib | Sharing Highlight Reels |
WO2015062462A1 (en) * | 2013-10-28 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Matching and broadcasting people-to-search |
WO2015070320A1 (en) * | 2007-12-31 | 2015-05-21 | Applied Recognition Inc. | Face detection and recognition |
US20150227609A1 (en) * | 2014-02-13 | 2015-08-13 | Yahoo! Inc. | Automatic group formation and group detection through media recognition |
US9147117B1 (en) | 2014-06-11 | 2015-09-29 | Socure Inc. | Analyzing facial recognition data and social network data for user authentication |
US9152849B2 (en) | 2007-12-31 | 2015-10-06 | Applied Recognition Inc. | Method, system, and computer program for identification and sharing of digital images with face signatures |
WO2015167689A1 (en) * | 2014-04-30 | 2015-11-05 | Linkedin Corporation | Content search vertical |
US20150356604A1 (en) * | 2014-06-04 | 2015-12-10 | Empire Technology Development Llc | Media content provision |
US9300676B2 (en) | 2013-03-15 | 2016-03-29 | Socure Inc. | Risk assessment using social networking data |
CN105610948A (en) * | 2015-12-29 | 2016-05-25 | 广东欧珀移动通信有限公司 | Method and device capable of assisting to search people |
CN105956051A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股(北京)有限公司 | Information finding method, device and system |
US9472166B2 (en) * | 2013-10-10 | 2016-10-18 | Pushd, Inc. | Automated personalized picture frame method |
US9721148B2 (en) | 2007-12-31 | 2017-08-01 | Applied Recognition Inc. | Face detection and recognition |
US9934504B2 (en) | 2012-01-13 | 2018-04-03 | Amazon Technologies, Inc. | Image analysis for user authentication |
US10248847B2 (en) | 2017-02-10 | 2019-04-02 | Accenture Global Solutions Limited | Profile information identification |
US20190102625A1 (en) * | 2017-09-29 | 2019-04-04 | Microsoft Technology Licensing, Llc | Entity attribute identification |
US10262126B2 (en) | 2014-08-28 | 2019-04-16 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US20190197789A1 (en) * | 2017-12-23 | 2019-06-27 | Lifeprint Llc | Systems & Methods for Variant Payloads in Augmented Reality Displays |
US10402553B1 (en) * | 2018-07-31 | 2019-09-03 | Capital One Services, Llc | System and method for using images to authenticate a user |
US20190287310A1 (en) * | 2018-01-08 | 2019-09-19 | Jaunt Inc. | Generating three-dimensional content from two-dimensional images |
US10430986B2 (en) | 2013-10-10 | 2019-10-01 | Pushd, Inc. | Clustering photographs for display on a digital picture frame |
US10474407B2 (en) | 2013-10-10 | 2019-11-12 | Pushd, Inc. | Digital picture frame with automated interactions with viewer and viewer devices |
CN110458130A (en) * | 2019-08-16 | 2019-11-15 | 百度在线网络技术(北京)有限公司 | Character recognition method, device, electronic equipment and storage medium |
US10511763B1 (en) * | 2018-06-19 | 2019-12-17 | Microsoft Technology Licensing, Llc | Starting electronic communication based on captured image |
US10565432B2 (en) | 2017-11-29 | 2020-02-18 | International Business Machines Corporation | Establishing personal identity based on multiple sub-optimal images |
US10607143B2 (en) | 2017-08-22 | 2020-03-31 | Internatonal Business Machines Corporation | Profile data camera adjustment |
US10614204B2 (en) | 2014-08-28 | 2020-04-07 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US10698995B2 (en) | 2014-08-28 | 2020-06-30 | Facetec, Inc. | Method to verify identity using a previously collected biometric image/data |
US10776467B2 (en) | 2017-09-27 | 2020-09-15 | International Business Machines Corporation | Establishing personal identity using real time contextual data |
US10795979B2 (en) | 2017-09-27 | 2020-10-06 | International Business Machines Corporation | Establishing personal identity and user behavior based on identity patterns |
US10803160B2 (en) | 2014-08-28 | 2020-10-13 | Facetec, Inc. | Method to verify and identify blockchain with user question data |
US10803297B2 (en) | 2017-09-27 | 2020-10-13 | International Business Machines Corporation | Determining quality of images for user identification |
US10820293B2 (en) | 2013-10-10 | 2020-10-27 | Aura Home, Inc. | Digital picture frame with improved display of community photographs |
US10824666B2 (en) | 2013-10-10 | 2020-11-03 | Aura Home, Inc. | Automated routing and display of community photographs in digital picture frames |
US10839003B2 (en) | 2017-09-27 | 2020-11-17 | International Business Machines Corporation | Passively managed loyalty program using customer images and behaviors |
US10915618B2 (en) | 2014-08-28 | 2021-02-09 | Facetec, Inc. | Method to add remotely collected biometric images / templates to a database record of personal information |
US11019252B2 (en) | 2014-05-21 | 2021-05-25 | Google Technology Holdings LLC | Enhanced image capture |
US11037604B2 (en) * | 2016-04-06 | 2021-06-15 | Idemia Identity & Security Germany Ag | Method for video investigation |
US11061637B2 (en) | 2013-10-10 | 2021-07-13 | Aura Home, Inc. | Digital picture frames and methods of frame setup |
US11256792B2 (en) | 2014-08-28 | 2022-02-22 | Facetec, Inc. | Method and apparatus for creation and use of digital identification |
US20220067192A1 (en) * | 2020-09-02 | 2022-03-03 | Corsight .Ai | Face recognition using the block chain |
USD987653S1 (en) | 2016-04-26 | 2023-05-30 | Facetec, Inc. | Display screen or portion thereof with graphical user interface |
US11669562B2 (en) | 2013-10-10 | 2023-06-06 | Aura Home, Inc. | Method of clustering photos for digital picture frames with split screen display |
US11797599B2 (en) | 2013-10-10 | 2023-10-24 | Aura Home, Inc. | Trend detection in digital photo collections for digital picture frames |
US11861259B1 (en) | 2023-03-06 | 2024-01-02 | Aura Home, Inc. | Conversational digital picture frame |
US11972011B2 (en) * | 2021-09-02 | 2024-04-30 | Corsight.Ai. Ltd. | Face recognition using the block chain |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220237531A1 (en) * | 2010-05-10 | 2022-07-28 | The Institute for Motivational Living | Method of matching employers with job seekers including emotion recognition |
US9087273B2 (en) * | 2011-11-15 | 2015-07-21 | Facebook, Inc. | Facial recognition using social networking information |
US9280708B2 (en) * | 2011-11-30 | 2016-03-08 | Nokia Technologies Oy | Method and apparatus for providing collaborative recognition using media segments |
TWI482108B (en) * | 2011-12-29 | 2015-04-21 | Univ Nat Taiwan | To bring virtual social networks into real-life social systems and methods |
US9185248B2 (en) * | 2012-02-29 | 2015-11-10 | Blackberry Limited | Method and device for sharing a camera feature |
US9137314B2 (en) * | 2012-11-06 | 2015-09-15 | At&T Intellectual Property I, L.P. | Methods, systems, and products for personalized feedback |
CN103970804B (en) * | 2013-02-06 | 2018-10-30 | 腾讯科技(深圳)有限公司 | A kind of information query method and device |
US9122911B2 (en) | 2013-03-28 | 2015-09-01 | Paycasso Verify Ltd. | System, method and computer program for verifying a signatory of a document |
GB2500823B (en) * | 2013-03-28 | 2014-02-26 | Paycasso Verify Ltd | Method, system and computer program for comparing images |
US9147128B1 (en) * | 2013-11-12 | 2015-09-29 | 214 Technologies Inc. | Machine learning enhanced facial recognition |
US9760686B2 (en) * | 2014-04-10 | 2017-09-12 | International Business Machines Corporation | Balanced ultraviolet light exposure recommendations |
TWI559966B (en) * | 2014-11-04 | 2016-12-01 | Mooredoll Inc | Method and device of community interaction with toy as the center |
US9904872B2 (en) | 2015-11-13 | 2018-02-27 | Microsoft Technology Licensing, Llc | Visual representations of photo albums |
CN105530172A (en) * | 2015-12-28 | 2016-04-27 | 小米科技有限责任公司 | User information obtaining method, device, terminal device and server |
CN107958435A (en) * | 2016-10-17 | 2018-04-24 | 同方威视技术股份有限公司 | Safe examination system and the method for configuring rays safety detection apparatus |
US10136049B2 (en) | 2017-01-09 | 2018-11-20 | International Business Machines Corporation | System, method and computer program product for contextual focus/zoom of event celebrities |
US10282598B2 (en) | 2017-03-07 | 2019-05-07 | Bank Of America Corporation | Performing image analysis for dynamic personnel identification based on a combination of biometric features |
US10311308B2 (en) | 2017-03-31 | 2019-06-04 | International Business Machines Corporation | Image processing to identify selected individuals in a field of view |
US10552471B1 (en) | 2017-04-21 | 2020-02-04 | Stripe, Inc. | Determining identities of multiple people in a digital image |
CN107463891A (en) * | 2017-07-26 | 2017-12-12 | 珠海市魅族科技有限公司 | A kind of identity information acquisition methods, device, computer installation and computer-readable recording medium |
US10713489B2 (en) | 2017-10-24 | 2020-07-14 | Microsoft Technology Licensing, Llc | Augmented reality for identification and grouping of entities in social networks |
CN108021669B (en) * | 2017-12-05 | 2021-03-12 | Oppo广东移动通信有限公司 | Image classification method and device, electronic equipment and computer-readable storage medium |
CN110084709A (en) * | 2018-01-23 | 2019-08-02 | 百度在线网络技术(北京)有限公司 | Good friend's processing method, server and computer-readable medium based on facial characteristics |
EP3765994A1 (en) | 2018-03-14 | 2021-01-20 | Sony Corporation | Method, electronic device and social media server for controlling content in a video media stream using face detection |
CN109543625B (en) * | 2018-11-27 | 2023-06-23 | 郑州芯力波通信息技术有限公司 | Mine personnel unique identification system and method |
CN109816543B (en) * | 2018-12-14 | 2023-06-27 | 平安科技(深圳)有限公司 | Image searching method and device |
CN109889654B (en) * | 2018-12-24 | 2020-11-13 | 维沃移动通信有限公司 | Information display method and terminal equipment |
JP2021189211A (en) * | 2020-05-26 | 2021-12-13 | キヤノン株式会社 | Electronic instrument |
US11388116B2 (en) | 2020-07-31 | 2022-07-12 | International Business Machines Corporation | Augmented reality enabled communication response |
US20230245127A1 (en) * | 2022-02-02 | 2023-08-03 | Kyndryl, Inc. | Augmented user authentication |
Citations (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040066966A1 (en) * | 2002-10-07 | 2004-04-08 | Henry Schneiderman | Object finder for two-dimensional images, and system for determining a set of sub-classifiers composing an object finder |
US20050256756A1 (en) * | 2004-05-17 | 2005-11-17 | Lam Chuck P | System and method for utilizing social networks for collaborative filtering |
US20060002607A1 (en) * | 2000-11-06 | 2006-01-05 | Evryx Technologies, Inc. | Use of image-derived information as search criteria for internet and other search engines |
US20070013776A1 (en) * | 2001-11-15 | 2007-01-18 | Objectvideo, Inc. | Video surveillance system employing video primitives |
US20070081090A1 (en) * | 2005-09-27 | 2007-04-12 | Mona Singh | Method and system for associating user comments to a scene captured by a digital imaging device |
US20070122005A1 (en) * | 2005-11-29 | 2007-05-31 | Mitsubishi Electric Corporation | Image authentication apparatus |
US20070172155A1 (en) * | 2006-01-21 | 2007-07-26 | Elizabeth Guckenberger | Photo Automatic Linking System and method for accessing, linking, and visualizing "key-face" and/or multiple similar facial images along with associated electronic data via a facial image recognition search engine |
US20070174304A1 (en) * | 2006-01-20 | 2007-07-26 | Microsoft Corporation | Querying social networks |
US20080052312A1 (en) * | 2006-08-23 | 2008-02-28 | Microsoft Corporation | Image-Based Face Search |
US20080130960A1 (en) * | 2006-12-01 | 2008-06-05 | Google Inc. | Identifying Images Using Face Recognition |
US20080288612A1 (en) * | 2005-03-15 | 2008-11-20 | Nhn Corporation | Online Social Network Management System and Method For Simulating Users to Build Various Faces of Relation |
US20080292299A1 (en) * | 2007-05-21 | 2008-11-27 | Martin Kretz | System and method of photography using desirable feature recognition |
US20090119167A1 (en) * | 2007-11-05 | 2009-05-07 | Kendall Timothy A | Social Advertisements and Other Informational Messages on a Social Networking Website, and Advertising Model for Same |
US20090141993A1 (en) * | 2007-12-03 | 2009-06-04 | Honeywell International Inc. | System for finding archived objects in video data |
US20090169067A1 (en) * | 2007-12-26 | 2009-07-02 | Altek Corporation | Face detection and tracking method |
US7581108B1 (en) * | 2004-04-21 | 2009-08-25 | Hewlett-Packard Development Company, L.P. | Method and system for generating time-based identifiers |
US20090234842A1 (en) * | 2007-09-30 | 2009-09-17 | International Business Machines Corporation | Image search using face detection |
US20090245573A1 (en) * | 2008-03-03 | 2009-10-01 | Videolq, Inc. | Object matching for tracking, indexing, and search |
US20090280859A1 (en) * | 2008-05-12 | 2009-11-12 | Sony Ericsson Mobile Communications Ab | Automatic tagging of photos in mobile devices |
US20090285488A1 (en) * | 2008-05-15 | 2009-11-19 | Arcsoft, Inc. | Face tracking method for electronic camera device |
US20100063993A1 (en) * | 2008-09-08 | 2010-03-11 | Yahoo! Inc. | System and method for socially aware identity manager |
US20100076851A1 (en) * | 2008-08-28 | 2010-03-25 | Jewell Jr Robert S | Targeted network content |
US20100076850A1 (en) * | 2008-09-22 | 2010-03-25 | Rajesh Parekh | Targeting Ads by Effectively Combining Behavioral Targeting and Social Networking |
US20100158371A1 (en) * | 2008-12-22 | 2010-06-24 | Electronics And Telecommunications Research Institute | Apparatus and method for detecting facial image |
US20100162175A1 (en) * | 2008-12-22 | 2010-06-24 | Microsoft Corporation | Augmented list for searching large indexes |
US20100177938A1 (en) * | 2009-01-13 | 2010-07-15 | Yahoo! Inc. | Media object metadata engine configured to determine relationships between persons |
US20100205242A1 (en) * | 2009-02-12 | 2010-08-12 | Garmin Ltd. | Friend-finding system |
US20100241658A1 (en) * | 2005-04-08 | 2010-09-23 | Rathurs Spencer A | System and method for accessing electronic data via an image search engine |
US20100257023A1 (en) * | 2009-04-07 | 2010-10-07 | Facebook, Inc. | Leveraging Information in a Social Network for Inferential Targeting of Advertisements |
US20100272363A1 (en) * | 2007-03-05 | 2010-10-28 | Fotonation Vision Limited | Face searching and detection in a digital image acquisition device |
US20100287053A1 (en) * | 2007-12-31 | 2010-11-11 | Ray Ganong | Method, system, and computer program for identification and sharing of digital images with face signatures |
US20110016476A1 (en) * | 2009-07-20 | 2011-01-20 | Samsung Electronics Co., Ltd. | System and method to allow multiple plug-in applications real-time access to a camera application in a mobile device |
US20110013810A1 (en) * | 2009-07-17 | 2011-01-20 | Engstroem Jimmy | System and method for automatic tagging of a digital image |
US20110085710A1 (en) * | 2006-05-10 | 2011-04-14 | Aol Inc. | Using relevance feedback in face recognition |
US8041082B1 (en) * | 2007-11-02 | 2011-10-18 | Google Inc. | Inferring the gender of a face in an image |
US20110296004A1 (en) * | 2010-05-31 | 2011-12-01 | Gayathri Swahar | Methods, apparatus, and articles of manufacture to rank users in an online social network |
US20120054691A1 (en) * | 2010-08-31 | 2012-03-01 | Nokia Corporation | Methods, apparatuses and computer program products for determining shared friends of individuals |
US20120110071A1 (en) * | 2010-10-29 | 2012-05-03 | Ding Zhou | Inferring user profile attributes from social information |
US20120174203A1 (en) * | 2010-12-29 | 2012-07-05 | Frank Jonathan H | Identifying a user account in a social networking system |
US8311289B2 (en) * | 2005-05-09 | 2012-11-13 | Google Inc. | Computer-implemented method for performing similarity searches |
US20120310674A1 (en) * | 2008-02-22 | 2012-12-06 | Faulkner Judith R | Electronic Health Record System Utilizing Disparate Record Sources |
US20130007149A1 (en) * | 2011-02-22 | 2013-01-03 | Harris Scott C | Social network with secret statuses and Verifications |
US8364708B1 (en) * | 2009-12-08 | 2013-01-29 | Amdocs Software Systems Limited | System, method, and computer program for augmenting user profiles |
US20130141434A1 (en) * | 2011-12-01 | 2013-06-06 | Ben Sugden | Virtual light in augmented reality |
US20130298030A1 (en) * | 2011-11-03 | 2013-11-07 | Aaron Nahumi | System, methods and computer readable medium for Augmented Personalized Social Network |
US20140012585A1 (en) * | 2012-07-03 | 2014-01-09 | Samsung Electonics Co., Ltd. | Display apparatus, interactive system, and response information providing method |
US20140026157A1 (en) * | 2011-04-11 | 2014-01-23 | Tao Wang | Face recognition control and social networking |
US8737688B2 (en) * | 2011-02-10 | 2014-05-27 | William A. Murphy | Targeted content acquisition using image analysis |
US8780162B2 (en) * | 2010-08-04 | 2014-07-15 | Iwatchlife Inc. | Method and system for locating an individual |
US20140270407A1 (en) * | 2013-03-14 | 2014-09-18 | Microsoft Corporation | Associating metadata with images in a personal image collection |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7882139B2 (en) * | 2003-09-29 | 2011-02-01 | Xunlei Networking Technologies, Ltd | Content oriented index and search method and system |
US7599527B2 (en) * | 2005-09-28 | 2009-10-06 | Facedouble, Inc. | Digital image search system and method |
US20090060289A1 (en) * | 2005-09-28 | 2009-03-05 | Alex Shah | Digital Image Search System And Method |
US8005272B2 (en) * | 2008-01-03 | 2011-08-23 | International Business Machines Corporation | Digital life recorder implementing enhanced facial recognition subsystem for acquiring face glossary data |
US7894639B2 (en) * | 2008-01-03 | 2011-02-22 | International Business Machines Corporation | Digital life recorder implementing enhanced facial recognition subsystem for acquiring a face glossary data |
US8014573B2 (en) * | 2008-01-03 | 2011-09-06 | International Business Machines Corporation | Digital life recording and playback |
US20120158720A1 (en) * | 2008-04-29 | 2012-06-21 | Microsoft Corporation | Social network powered search enhancements |
US20100281113A1 (en) * | 2009-04-29 | 2010-11-04 | Nokia Corporation | Method and apparatus for automatically matching contacts |
US8416997B2 (en) * | 2010-01-27 | 2013-04-09 | Apple Inc. | Method of person identification using social connections |
US8341145B2 (en) * | 2010-12-20 | 2012-12-25 | Microsoft Corporation | Face recognition using social data |
US9330080B2 (en) | 2011-06-27 | 2016-05-03 | Sap Se | Methods and systems to facilitate providing spreadsheet and database data to users via a social network |
US20130060868A1 (en) * | 2011-09-07 | 2013-03-07 | Elwha LLC, a limited liability company of the State of Delaware | Computational systems and methods for identifying a communications partner |
US9087273B2 (en) * | 2011-11-15 | 2015-07-21 | Facebook, Inc. | Facial recognition using social networking information |
US9317583B2 (en) * | 2012-10-05 | 2016-04-19 | Microsoft Technology Licensing, Llc | Dynamic captions from social streams |
-
2011
- 2011-09-22 US US13/240,022 patent/US8917913B2/en active Active
-
2012
- 2012-04-25 US US13/455,658 patent/US20130077835A1/en not_active Abandoned
Patent Citations (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060002607A1 (en) * | 2000-11-06 | 2006-01-05 | Evryx Technologies, Inc. | Use of image-derived information as search criteria for internet and other search engines |
US7680324B2 (en) * | 2000-11-06 | 2010-03-16 | Evryx Technologies, Inc. | Use of image-derived information as search criteria for internet and other search engines |
US20070013776A1 (en) * | 2001-11-15 | 2007-01-18 | Objectvideo, Inc. | Video surveillance system employing video primitives |
US20040066966A1 (en) * | 2002-10-07 | 2004-04-08 | Henry Schneiderman | Object finder for two-dimensional images, and system for determining a set of sub-classifiers composing an object finder |
US7581108B1 (en) * | 2004-04-21 | 2009-08-25 | Hewlett-Packard Development Company, L.P. | Method and system for generating time-based identifiers |
US20050256756A1 (en) * | 2004-05-17 | 2005-11-17 | Lam Chuck P | System and method for utilizing social networks for collaborative filtering |
US20080288612A1 (en) * | 2005-03-15 | 2008-11-20 | Nhn Corporation | Online Social Network Management System and Method For Simulating Users to Build Various Faces of Relation |
US20100241658A1 (en) * | 2005-04-08 | 2010-09-23 | Rathurs Spencer A | System and method for accessing electronic data via an image search engine |
US8311289B2 (en) * | 2005-05-09 | 2012-11-13 | Google Inc. | Computer-implemented method for performing similarity searches |
US7529772B2 (en) * | 2005-09-27 | 2009-05-05 | Scenera Technologies, Llc | Method and system for associating user comments to a scene captured by a digital imaging device |
US20070081090A1 (en) * | 2005-09-27 | 2007-04-12 | Mona Singh | Method and system for associating user comments to a scene captured by a digital imaging device |
US20070122005A1 (en) * | 2005-11-29 | 2007-05-31 | Mitsubishi Electric Corporation | Image authentication apparatus |
US20070174304A1 (en) * | 2006-01-20 | 2007-07-26 | Microsoft Corporation | Querying social networks |
US20070172155A1 (en) * | 2006-01-21 | 2007-07-26 | Elizabeth Guckenberger | Photo Automatic Linking System and method for accessing, linking, and visualizing "key-face" and/or multiple similar facial images along with associated electronic data via a facial image recognition search engine |
US20110085710A1 (en) * | 2006-05-10 | 2011-04-14 | Aol Inc. | Using relevance feedback in face recognition |
US20080052312A1 (en) * | 2006-08-23 | 2008-02-28 | Microsoft Corporation | Image-Based Face Search |
US20100135584A1 (en) * | 2006-08-23 | 2010-06-03 | Microsoft Corporation | Image-Based Face Search |
US20080130960A1 (en) * | 2006-12-01 | 2008-06-05 | Google Inc. | Identifying Images Using Face Recognition |
US20100272363A1 (en) * | 2007-03-05 | 2010-10-28 | Fotonation Vision Limited | Face searching and detection in a digital image acquisition device |
US20080292299A1 (en) * | 2007-05-21 | 2008-11-27 | Martin Kretz | System and method of photography using desirable feature recognition |
US7664389B2 (en) * | 2007-05-21 | 2010-02-16 | Sony Ericsson Mobile Communications Ab | System and method of photography using desirable feature recognition |
US20090234842A1 (en) * | 2007-09-30 | 2009-09-17 | International Business Machines Corporation | Image search using face detection |
US8041082B1 (en) * | 2007-11-02 | 2011-10-18 | Google Inc. | Inferring the gender of a face in an image |
US8588482B1 (en) * | 2007-11-02 | 2013-11-19 | Google Inc. | Inferring the gender of a face in an image |
US20090119167A1 (en) * | 2007-11-05 | 2009-05-07 | Kendall Timothy A | Social Advertisements and Other Informational Messages on a Social Networking Website, and Advertising Model for Same |
US20090141993A1 (en) * | 2007-12-03 | 2009-06-04 | Honeywell International Inc. | System for finding archived objects in video data |
US20090169067A1 (en) * | 2007-12-26 | 2009-07-02 | Altek Corporation | Face detection and tracking method |
US20100287053A1 (en) * | 2007-12-31 | 2010-11-11 | Ray Ganong | Method, system, and computer program for identification and sharing of digital images with face signatures |
US20120310674A1 (en) * | 2008-02-22 | 2012-12-06 | Faulkner Judith R | Electronic Health Record System Utilizing Disparate Record Sources |
US20090245573A1 (en) * | 2008-03-03 | 2009-10-01 | Videolq, Inc. | Object matching for tracking, indexing, and search |
US20090280859A1 (en) * | 2008-05-12 | 2009-11-12 | Sony Ericsson Mobile Communications Ab | Automatic tagging of photos in mobile devices |
US20090285488A1 (en) * | 2008-05-15 | 2009-11-19 | Arcsoft, Inc. | Face tracking method for electronic camera device |
US20100076851A1 (en) * | 2008-08-28 | 2010-03-25 | Jewell Jr Robert S | Targeted network content |
US20100063993A1 (en) * | 2008-09-08 | 2010-03-11 | Yahoo! Inc. | System and method for socially aware identity manager |
US20100076850A1 (en) * | 2008-09-22 | 2010-03-25 | Rajesh Parekh | Targeting Ads by Effectively Combining Behavioral Targeting and Social Networking |
US20100158371A1 (en) * | 2008-12-22 | 2010-06-24 | Electronics And Telecommunications Research Institute | Apparatus and method for detecting facial image |
US20100162175A1 (en) * | 2008-12-22 | 2010-06-24 | Microsoft Corporation | Augmented list for searching large indexes |
US20100177938A1 (en) * | 2009-01-13 | 2010-07-15 | Yahoo! Inc. | Media object metadata engine configured to determine relationships between persons |
US20100205242A1 (en) * | 2009-02-12 | 2010-08-12 | Garmin Ltd. | Friend-finding system |
US20100257023A1 (en) * | 2009-04-07 | 2010-10-07 | Facebook, Inc. | Leveraging Information in a Social Network for Inferential Targeting of Advertisements |
US20110013810A1 (en) * | 2009-07-17 | 2011-01-20 | Engstroem Jimmy | System and method for automatic tagging of a digital image |
US20110016476A1 (en) * | 2009-07-20 | 2011-01-20 | Samsung Electronics Co., Ltd. | System and method to allow multiple plug-in applications real-time access to a camera application in a mobile device |
US8364708B1 (en) * | 2009-12-08 | 2013-01-29 | Amdocs Software Systems Limited | System, method, and computer program for augmenting user profiles |
US20110296004A1 (en) * | 2010-05-31 | 2011-12-01 | Gayathri Swahar | Methods, apparatus, and articles of manufacture to rank users in an online social network |
US8780162B2 (en) * | 2010-08-04 | 2014-07-15 | Iwatchlife Inc. | Method and system for locating an individual |
US20120054691A1 (en) * | 2010-08-31 | 2012-03-01 | Nokia Corporation | Methods, apparatuses and computer program products for determining shared friends of individuals |
US20120110071A1 (en) * | 2010-10-29 | 2012-05-03 | Ding Zhou | Inferring user profile attributes from social information |
US20120174203A1 (en) * | 2010-12-29 | 2012-07-05 | Frank Jonathan H | Identifying a user account in a social networking system |
US8737688B2 (en) * | 2011-02-10 | 2014-05-27 | William A. Murphy | Targeted content acquisition using image analysis |
US20130007149A1 (en) * | 2011-02-22 | 2013-01-03 | Harris Scott C | Social network with secret statuses and Verifications |
US20140026157A1 (en) * | 2011-04-11 | 2014-01-23 | Tao Wang | Face recognition control and social networking |
US20130298030A1 (en) * | 2011-11-03 | 2013-11-07 | Aaron Nahumi | System, methods and computer readable medium for Augmented Personalized Social Network |
US20130141434A1 (en) * | 2011-12-01 | 2013-06-06 | Ben Sugden | Virtual light in augmented reality |
US20140012585A1 (en) * | 2012-07-03 | 2014-01-09 | Samsung Electonics Co., Ltd. | Display apparatus, interactive system, and response information providing method |
US20140270407A1 (en) * | 2013-03-14 | 2014-09-18 | Microsoft Corporation | Associating metadata with images in a personal image collection |
Non-Patent Citations (1)
Title |
---|
Saptharishi et al. "An Information Value Driven Architecture for Urban Video Surveillance in Dataand Attention Bandwidth Constrained Environments" (2009) Advanced Video and Signal Based Surveillance-IEEE pages 1-6. * |
Cited By (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9639740B2 (en) | 2007-12-31 | 2017-05-02 | Applied Recognition Inc. | Face detection and recognition |
US9721148B2 (en) | 2007-12-31 | 2017-08-01 | Applied Recognition Inc. | Face detection and recognition |
US9152849B2 (en) | 2007-12-31 | 2015-10-06 | Applied Recognition Inc. | Method, system, and computer program for identification and sharing of digital images with face signatures |
WO2015070320A1 (en) * | 2007-12-31 | 2015-05-21 | Applied Recognition Inc. | Face detection and recognition |
US9928407B2 (en) | 2007-12-31 | 2018-03-27 | Applied Recognition Inc. | Method, system and computer program for identification and sharing of digital images with face signatures |
US9607052B2 (en) * | 2008-12-29 | 2017-03-28 | Technion Research & Development Foundation Limited | Query networks evaluation system and method |
US20100306271A1 (en) * | 2008-12-29 | 2010-12-02 | Oded Shmueli | Query Networks Evaluation System and Method |
US8942415B1 (en) | 2011-09-19 | 2015-01-27 | Google Inc. | System and method of identifying advertisement in images |
US8600102B1 (en) * | 2011-09-19 | 2013-12-03 | Google Inc. | System and method of identifying advertisement in images |
US20140236980A1 (en) * | 2011-10-25 | 2014-08-21 | Huawei Device Co., Ltd | Method and Apparatus for Establishing Association |
US10242364B2 (en) | 2012-01-13 | 2019-03-26 | Amazon Technologies, Inc. | Image analysis for user authentication |
US9934504B2 (en) | 2012-01-13 | 2018-04-03 | Amazon Technologies, Inc. | Image analysis for user authentication |
US10108961B2 (en) | 2012-01-13 | 2018-10-23 | Amazon Technologies, Inc. | Image analysis for user authentication |
US9043318B2 (en) * | 2012-01-26 | 2015-05-26 | Lg Electronics Inc. | Mobile terminal and photo searching method thereof |
US20130198176A1 (en) * | 2012-01-26 | 2013-08-01 | Lg Electronics Inc. | Mobile terminal and photo searching method thereof |
US11570195B2 (en) | 2013-03-15 | 2023-01-31 | Socure, Inc. | Risk assessment using social networking data |
US10313388B2 (en) | 2013-03-15 | 2019-06-04 | Socure Inc. | Risk assessment using social networking data |
US9300676B2 (en) | 2013-03-15 | 2016-03-29 | Socure Inc. | Risk assessment using social networking data |
US9558524B2 (en) | 2013-03-15 | 2017-01-31 | Socure Inc. | Risk assessment using social networking data |
US10542032B2 (en) | 2013-03-15 | 2020-01-21 | Socure Inc. | Risk assessment using social networking data |
US9942259B2 (en) | 2013-03-15 | 2018-04-10 | Socure Inc. | Risk assessment using social networking data |
US9436705B2 (en) | 2013-09-17 | 2016-09-06 | Google Technology Holdings LLC | Grading images and video clips |
US11200916B2 (en) | 2013-09-17 | 2021-12-14 | Google Llc | Highlighting media through weighting of people or contexts |
US9652475B2 (en) | 2013-09-17 | 2017-05-16 | Google Technology Holdings LLC | Highlight reels |
US10811050B2 (en) | 2013-09-17 | 2020-10-20 | Google Technology Holdings LLC | Highlighting media through weighting of people or contexts |
US20150078726A1 (en) * | 2013-09-17 | 2015-03-19 | Babak Robert Shakib | Sharing Highlight Reels |
US11604618B2 (en) | 2013-10-10 | 2023-03-14 | Aura Home, Inc. | Digital picture display system with photo clustering of camera roll and social media photos |
US11061637B2 (en) | 2013-10-10 | 2021-07-13 | Aura Home, Inc. | Digital picture frames and methods of frame setup |
US9472166B2 (en) * | 2013-10-10 | 2016-10-18 | Pushd, Inc. | Automated personalized picture frame method |
US10824666B2 (en) | 2013-10-10 | 2020-11-03 | Aura Home, Inc. | Automated routing and display of community photographs in digital picture frames |
US10820293B2 (en) | 2013-10-10 | 2020-10-27 | Aura Home, Inc. | Digital picture frame with improved display of community photographs |
US11853633B2 (en) | 2013-10-10 | 2023-12-26 | Aura Home, Inc. | Digital picture display system with photo clustering and automated interaction with viewer devices |
US11825035B2 (en) | 2013-10-10 | 2023-11-21 | Aura Home, Inc. | Network setup for digital picture frames |
US11797599B2 (en) | 2013-10-10 | 2023-10-24 | Aura Home, Inc. | Trend detection in digital photo collections for digital picture frames |
US11243999B2 (en) | 2013-10-10 | 2022-02-08 | Aura Home, Inc. | Sub-clustering photographs for a digital picture frame |
US10592186B2 (en) | 2013-10-10 | 2020-03-17 | Pushd, Inc. | Clustering and filtering digital photos by content and quality for automated display |
US11714845B2 (en) | 2013-10-10 | 2023-08-01 | Aura Home, Inc. | Content clustering of new photographs for digital picture frame display |
US11669562B2 (en) | 2013-10-10 | 2023-06-06 | Aura Home, Inc. | Method of clustering photos for digital picture frames with split screen display |
US11665287B2 (en) | 2013-10-10 | 2023-05-30 | Aura Home, Inc. | Frame setup methods for digital picture frames |
US10430986B2 (en) | 2013-10-10 | 2019-10-01 | Pushd, Inc. | Clustering photographs for display on a digital picture frame |
US10467986B2 (en) | 2013-10-10 | 2019-11-05 | Pushd, Inc. | Automated method of displaying personalized photos on a digital picture frame |
US10474407B2 (en) | 2013-10-10 | 2019-11-12 | Pushd, Inc. | Digital picture frame with automated interactions with viewer and viewer devices |
US10853404B2 (en) | 2013-10-10 | 2020-12-01 | Aura Home, Inc. | Digital picture frame photograph clustering |
US11574000B2 (en) | 2013-10-10 | 2023-02-07 | Aura Home, Inc. | Photograph content clustering for digital picture frame display |
US11144269B2 (en) | 2013-10-10 | 2021-10-12 | Aura Home, Inc. | Digital picture display system with photo clustering and filtering |
WO2015062462A1 (en) * | 2013-10-28 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Matching and broadcasting people-to-search |
US20150227609A1 (en) * | 2014-02-13 | 2015-08-13 | Yahoo! Inc. | Automatic group formation and group detection through media recognition |
US10121060B2 (en) * | 2014-02-13 | 2018-11-06 | Oath Inc. | Automatic group formation and group detection through media recognition |
WO2015167689A1 (en) * | 2014-04-30 | 2015-11-05 | Linkedin Corporation | Content search vertical |
US11290639B2 (en) | 2014-05-21 | 2022-03-29 | Google Llc | Enhanced image capture |
US11575829B2 (en) | 2014-05-21 | 2023-02-07 | Google Llc | Enhanced image capture |
US11943532B2 (en) | 2014-05-21 | 2024-03-26 | Google Technology Holdings LLC | Enhanced image capture |
US11019252B2 (en) | 2014-05-21 | 2021-05-25 | Google Technology Holdings LLC | Enhanced image capture |
US9852445B2 (en) * | 2014-06-04 | 2017-12-26 | Empire Technology Development Llc | Media content provision |
US20150356604A1 (en) * | 2014-06-04 | 2015-12-10 | Empire Technology Development Llc | Media content provision |
US9147117B1 (en) | 2014-06-11 | 2015-09-29 | Socure Inc. | Analyzing facial recognition data and social network data for user authentication |
US10868809B2 (en) | 2014-06-11 | 2020-12-15 | Socure, Inc. | Analyzing facial recognition data and social network data for user authentication |
US11799853B2 (en) | 2014-06-11 | 2023-10-24 | Socure, Inc. | Analyzing facial recognition data and social network data for user authentication |
US10154030B2 (en) | 2014-06-11 | 2018-12-11 | Socure Inc. | Analyzing facial recognition data and social network data for user authentication |
US10614204B2 (en) | 2014-08-28 | 2020-04-07 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US11874910B2 (en) | 2014-08-28 | 2024-01-16 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US11727098B2 (en) | 2014-08-28 | 2023-08-15 | Facetec, Inc. | Method and apparatus for user verification with blockchain data storage |
US10915618B2 (en) | 2014-08-28 | 2021-02-09 | Facetec, Inc. | Method to add remotely collected biometric images / templates to a database record of personal information |
US10803160B2 (en) | 2014-08-28 | 2020-10-13 | Facetec, Inc. | Method to verify and identify blockchain with user question data |
US11657132B2 (en) | 2014-08-28 | 2023-05-23 | Facetec, Inc. | Method and apparatus to dynamically control facial illumination |
US11693938B2 (en) | 2014-08-28 | 2023-07-04 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US11562055B2 (en) | 2014-08-28 | 2023-01-24 | Facetec, Inc. | Method to verify identity using a previously collected biometric image/data |
US10262126B2 (en) | 2014-08-28 | 2019-04-16 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US11157606B2 (en) | 2014-08-28 | 2021-10-26 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US10776471B2 (en) | 2014-08-28 | 2020-09-15 | Facetec, Inc. | Facial recognition authentication system including path parameters |
US10698995B2 (en) | 2014-08-28 | 2020-06-30 | Facetec, Inc. | Method to verify identity using a previously collected biometric image/data |
US11256792B2 (en) | 2014-08-28 | 2022-02-22 | Facetec, Inc. | Method and apparatus for creation and use of digital identification |
US11574036B2 (en) | 2014-08-28 | 2023-02-07 | Facetec, Inc. | Method and system to verify identity |
CN105610948A (en) * | 2015-12-29 | 2016-05-25 | 广东欧珀移动通信有限公司 | Method and device capable of assisting to search people |
US11037604B2 (en) * | 2016-04-06 | 2021-06-15 | Idemia Identity & Security Germany Ag | Method for video investigation |
USD987653S1 (en) | 2016-04-26 | 2023-05-30 | Facetec, Inc. | Display screen or portion thereof with graphical user interface |
CN105956051A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股(北京)有限公司 | Information finding method, device and system |
US10248847B2 (en) | 2017-02-10 | 2019-04-02 | Accenture Global Solutions Limited | Profile information identification |
US10607143B2 (en) | 2017-08-22 | 2020-03-31 | Internatonal Business Machines Corporation | Profile data camera adjustment |
US10776467B2 (en) | 2017-09-27 | 2020-09-15 | International Business Machines Corporation | Establishing personal identity using real time contextual data |
US10839003B2 (en) | 2017-09-27 | 2020-11-17 | International Business Machines Corporation | Passively managed loyalty program using customer images and behaviors |
US10795979B2 (en) | 2017-09-27 | 2020-10-06 | International Business Machines Corporation | Establishing personal identity and user behavior based on identity patterns |
US10803297B2 (en) | 2017-09-27 | 2020-10-13 | International Business Machines Corporation | Determining quality of images for user identification |
US20190102625A1 (en) * | 2017-09-29 | 2019-04-04 | Microsoft Technology Licensing, Llc | Entity attribute identification |
US10565432B2 (en) | 2017-11-29 | 2020-02-18 | International Business Machines Corporation | Establishing personal identity based on multiple sub-optimal images |
US20190197789A1 (en) * | 2017-12-23 | 2019-06-27 | Lifeprint Llc | Systems & Methods for Variant Payloads in Augmented Reality Displays |
US20190287310A1 (en) * | 2018-01-08 | 2019-09-19 | Jaunt Inc. | Generating three-dimensional content from two-dimensional images |
US11113887B2 (en) * | 2018-01-08 | 2021-09-07 | Verizon Patent And Licensing Inc | Generating three-dimensional content from two-dimensional images |
US10511763B1 (en) * | 2018-06-19 | 2019-12-17 | Microsoft Technology Licensing, Llc | Starting electronic communication based on captured image |
US11755702B2 (en) * | 2018-07-31 | 2023-09-12 | Capital One Services, Llc | System and method for using images to authenticate a user |
US10402553B1 (en) * | 2018-07-31 | 2019-09-03 | Capital One Services, Llc | System and method for using images to authenticate a user |
US20200042682A1 (en) * | 2018-07-31 | 2020-02-06 | Capital One Services, Llc | System and method for using images to authenticate a user |
CN110458130A (en) * | 2019-08-16 | 2019-11-15 | 百度在线网络技术(北京)有限公司 | Character recognition method, device, electronic equipment and storage medium |
US20220067192A1 (en) * | 2020-09-02 | 2022-03-03 | Corsight .Ai | Face recognition using the block chain |
US11972011B2 (en) * | 2021-09-02 | 2024-04-30 | Corsight.Ai. Ltd. | Face recognition using the block chain |
US11861259B1 (en) | 2023-03-06 | 2024-01-02 | Aura Home, Inc. | Conversational digital picture frame |
Also Published As
Publication number | Publication date |
---|---|
US8917913B2 (en) | 2014-12-23 |
US20130077833A1 (en) | 2013-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8917913B2 (en) | Searching with face recognition and social networking profiles | |
JP7091504B2 (en) | Methods and devices for minimizing false positives in face recognition applications | |
US10423656B2 (en) | Tag suggestions for images on online social networks | |
US20200057590A1 (en) | Gallery of messages from individuals with a shared interest | |
US10713489B2 (en) | Augmented reality for identification and grouping of entities in social networks | |
CN105659286B (en) | Automated image cropping and sharing | |
US11849256B2 (en) | Systems and methods for dynamically concealing sensitive information | |
US11366812B2 (en) | Using live data streams and/or search queries to determine information about developing events | |
US11150724B2 (en) | Avatar-based augmented reality engagement | |
AU2014274171B2 (en) | Tag suggestions for images on online social networks | |
US20180077344A1 (en) | Automated group photograph composition | |
US9715330B2 (en) | Displaying relevant information on wearable computing devices | |
US9361714B2 (en) | Enhanced video description | |
KR20230025917A (en) | Augmented reality-based voice translation related to travel | |
US11562586B2 (en) | Systems and methods for generating search results based on optical character recognition techniques and machine-encoded text | |
US20200242332A1 (en) | Integrating scanned business cards with identification of meeting attendees in a given seating arrangement | |
Agarwal et al. | SmPFT: Social media based profile fusion technique for data enrichment | |
Toubiana et al. | Photo-tape: user privacy preferences in photo tagging | |
Jikadra et al. | Video calling with augmented reality using WebRTC API | |
KR20200009888A (en) | Method for Providing and Recommending Related Tag Using Image Analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |