WO2016133276A1

WO2016133276A1 - Device or system for deciding modality or output of content on basis of posture of user or change in posture, method for deciding modality or output of content provided by user device, and computer-readable recording medium for recording computer program for executing the method

Info

Publication number: WO2016133276A1
Application number: PCT/KR2015/013491
Authority: WO
Inventors: 황성재
Original assignee: 주식회사 퓨처플레이
Priority date: 2015-02-16
Filing date: 2015-12-10
Publication date: 2016-08-25
Also published as: KR20180125637A; KR20170065664A

Abstract

The present invention relates to a device or system for deciding a modality or output of a content on the basis of a posture of a user or a change in posture, a method for deciding a modality or output of a content provided by a user device, and a computer-readable recording medium for recording a computer program for executing the method. According to one aspect of the present invention, provided is a method comprising the steps of: on the basis of movement data of a user device, deriving information on a posture of the user or a change in posture, wherein the movement data is recorded according to the lapsing of time by means of a sensor included in the user device; and, on the basis of the derived information, deciding a modality or output of a content provided by the user device.

Description

A device or system for determining the modality or output of content based on a user's posture or a change in posture, a method for determining the modality or output of content provided by a user device, and a computer program for executing the method Readable recording medium for recording data

The present invention provides an apparatus and system for determining the modality or output of content based on a change in posture or posture of a user, a method for determining the modality or output of content provided by a user device, and executing the method. A computer readable recording medium for recording a computer program therefor.

In recent years, wearable devices that can be worn by a user or attached near the body have been widely used. The wearable device provides content directly to the user or the person around it, or receives and provides the content from another related device.

What makes the wearable device different from the existing first generation smart device is that it can have a physical value that is closely related to the motion or posture of the user. Thus, when the wearable device provides the content, it may be possible to adaptively determine the modality or output of the content according to the above physical values, which may also be useful.

In light of this, the present inventors propose an apparatus or related technology for determining the modality or output of content based on a change in a posture or posture of a user.

The present invention aims to solve all of the above-mentioned problems of the prior art.

Another object of the present invention is to allow the modality or output of content to be adaptively determined based on a change in posture or posture of a user.

It is another object of the present invention to further consider the characteristics of the content in such a determination.

It is yet another object of the present invention to further consider the position at which the user wears the user device in such a determination.

It is another object of the present invention to allow for the determination of the location of the user device or the remaining battery capacity in such a determination.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, deriving information on a posture or posture change of a user based on motion data of a user device, wherein the motion data is recorded over time by a sensor included in the user device. And determining, based on the derived information, the modality or output of the content provided by the user device.

In addition, there is further provided a computer readable recording medium for recording another method for implementing the present invention, another apparatus or system, and a computer program for executing the method.

According to the present invention, the modality or output of the content can be adaptively determined based on the change in the posture or posture of the user.

According to the present invention, the characteristics of the content can be further considered in the above determination.

According to the present invention, the position in which the user wears the user device may be further considered in the above determination.

According to the present invention, the determination of the above may allow the location context of the user device or the battery level to be further considered.

1 is a view showing a schematic configuration of an entire system for determining the modality or output of content based on a change in a posture or posture of a user according to an embodiment of the present invention.

2 is a diagram illustrating in detail the internal configuration of the content providing support system 200 according to an embodiment of the present invention.

3 is a diagram illustrating in detail the internal configuration of the user device 300 according to an embodiment of the present invention.

4 is a view illustrating various postures that a user may take according to an embodiment of the present invention.

FIG. 5 is a diagram illustrating various postures that a user may take while wearing one user device on a wrist according to one embodiment of the present invention.

FIG. 6 is a diagram illustrating other postures that a user may take while wearing one user device on a wrist according to an embodiment of the present invention.

FIG. 7 is a diagram illustrating two postures that a user may take using two user devices according to one embodiment of the present invention.

FIG. 8 is a diagram illustrating different postures that a user may take using two user devices according to an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented with changes from one embodiment to another without departing from the spirit and scope of the invention. In addition, it is to be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be taken as encompassing the scope of the claims of the claims and all equivalents thereof. Like reference numerals in the drawings indicate the same or similar elements throughout the several aspects.

Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

[Preferred Embodiments of the Invention]

In the present specification, content or content is a concept that collectively refers to digital information or individual information elements composed of letters, codes, voices, sounds, images, moving pictures, and the like, accessible through a communication network. Such content may include, for example, data such as text, images, video, audio, links (eg, web links), or a combination of at least two of these data.

Configuration of the entire system

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a communication network 100, a content providing support system 200, and a user device 300.

First, the communication network 100 according to an embodiment of the present invention may be configured regardless of a communication mode such as wired communication or wireless communication, and includes a local area network (LAN) and a metropolitan area network (MAN). ), And various communication networks such as a wide area network (WAN). Preferably, the communication network 100 as used herein may be a known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto. For example, the communication network 100 may be a wireless data communication network, and may implement at least a portion of a conventional communication method such as WiFi communication, LTE communication, Bluetooth communication, infrared communication, and ultrasonic communication.

Next, the content providing support system 200 according to an embodiment of the present invention may support the modality or output of the content provided by the user device 300 to be determined based on a change in the posture or posture of the user. To this end, the content providing support system 200 may collaborate with the user device 300 to derive information regarding a change in posture or posture of the user.

The configuration and function of the content providing support system 200 according to the present invention will be described in more detail below.

Finally, the user device 300 according to an embodiment of the present invention is a digital device having a function of communicating after connecting to the content providing support system 200 as necessary, smart watch, smart band, smart ring The user device 300 according to the present invention can be used as long as it is a digital device that can be worn by the user, such as a smart phone, a mobile phone, a PDA, and the like, and has a memory means and is equipped with a microprocessor. May be adopted as In particular, the user device 300 is a known component for providing content, for example, a display panel for providing a video or an image, a speaker for providing sound, a vibrator for providing vibration, and other tactile stimuli. Protruding elements and actuators to provide such. The user device 300 derives information on a user's posture or a change in posture by itself, or after receiving such information from the content providing support system 200, based on the modality or output of the content provided by the user device 300. This can be adjusted.

The configuration and function of the user device 300 according to the present invention will be described in more detail below.

Configuration of Content Provisioning Support System

Hereinafter, the internal structure of the content providing support system 200 according to the present invention and the function of each component will be described.

The content providing support system 200 according to an exemplary embodiment of the present invention may be a digital device having memory capability and a microprocessor equipped therein. The content providing support system 200 may be a server system. As shown in FIG. 2, the content providing support system 200 may include a posture information deriving unit 210, a determining unit 220, a database 230, a communication unit 240, and a control unit 250. have. According to the exemplary embodiment of the present invention, the posture information deriving unit 210, the determining unit 220, the database 230, the communication unit 240, and the control unit 250 may communicate at least some of them with the user device 300. It may be a program module. The program module may be included in the content providing support system 200 in the form of an operating system, an application module, or other program modules, and may be physically stored in various known storage devices. In addition, the program module may be stored in a remote storage device that can communicate with the content providing support system 200. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

First, the posture information deriving unit 210 according to an embodiment of the present invention receives data about the movement of the user device 300 (which will be described later) from the user device 300, and based on this, A function of deriving information on a posture or a change in posture of a user who uses the user device 300 may be performed. In detail, the posture information deriving unit 210 is based on the movement data of the user device 300 and the information about the trajectory indicated in the situation where the user device 300 is worn by the user (the user device 300). Information about an absolute position over time, information about a relative virtual reference point or relative position over time with respect to a device different from the user device 300, or the speed, acceleration, Information about a three-axis rotation (that is, may include information over time) may be determined to derive information about a user's posture or a change in posture.

To this end, the posture information deriving unit 210 performs information collection and accumulation of collected information with respect to the plurality of user apparatuses 300, thereby performing a predetermined posture or posture in which a motion trajectory having characteristics within a predetermined range is known. A new posture or a change in posture can be specified based on a motion trajectory having a characteristic within a predetermined range or matching with the change of. In addition, the posture information deriving unit 210 may determine the movement as a specific type of movement (that is, a specific posture change) by analyzing the characteristics of the movement trajectory, which is commonly expressed by the plurality of user devices 300. have. In addition, when a movement of a trajectory characteristic corresponding to the trajectory characteristic of the determined type of movement is detected with respect to a separate user device 300, a specific posture or change of posture may be reported from the movement of the user device 300. . In addition, it may be considered which part of the user's body the user device 300 is worn on. For example, it may be estimated which part (location) of the user's finger, wrist, and upper arm is worn.

On the other hand, the posture information derived as described above (including information on the position of the user device 300 is worn on the user's body, if necessary) and the characteristics of the movement trajectory related thereto are related to the database 230 to be described later Can be stored.

However, the attitude information derivation unit 210 as described above is not essential, and all or part of the function may be replaced by the attitude information derivation unit 320 that may be included in the user device 300 as described below. have.

Next, the determination unit 220 according to an embodiment of the present invention, based on the user's request of the user device 300 or a predetermined rule, suitable for the corresponding posture or posture change of the derived posture information The modality or output related to the content provision of the 300 may be determined, and the information regarding the determination may be transmitted to the user device 300. In some cases, a user request or a rule itself regarding the determination of the modality or the output may be transmitted to the user device 300. However, this component is not essential, and as described below, all or part of the function may be replaced by the determining unit 330 that may be included in the user device 300. Various examples of decisions that can be made are described below.

Next, the database 230 according to an embodiment of the present invention, the modal content of the content according to the movement data of the user device 300, the posture information derived from the data and / or the corresponding posture or posture change of the posture information Rules regarding determining the utility or output may be stored. Although the database 230 is illustrated as being included in the content providing support system 200 in FIG. 2, according to the needs of those skilled in the art of implementing the present invention, the database 230 may be connected to the content providing support system 200. It may be configured separately. On the other hand, the database 230 in the present invention is a concept that includes a computer-readable recording medium, and may be a broad database including not only a negotiated database but also a file system based on a file system. If the set can be retrieved to extract data, it can be the database 230 of the present invention.

Next, the communication unit 240 according to an embodiment of the present invention may perform a function to enable data transmission and reception to and from the posture information deriving unit 210, the determining unit 220, and the database 230. .

Lastly, the control unit 250 according to an embodiment of the present invention performs a function of controlling the flow of data between the posture information deriving unit 210, the determining unit 220, the database 230, and the communication unit 240. Can be. That is, the controller 250 according to the present invention controls the data flow from / to the outside of the content providing support system 200 or the data flow between each component of the content providing support system 200, thereby obtaining a posture information deriving unit ( 210, the determination unit 220, the database 230, and the communication unit 240 may control to perform unique functions, respectively.

Configuration of User Devices

Hereinafter, the internal configuration of the user device 300 according to the present invention and the function of each component will be described.

3 is a diagram illustrating in detail the internal configuration of the user device 300 according to an embodiment of the present invention. As shown in FIG. 3, the user device 300 may include a sensor 310, a posture information derivation unit 320, a determination unit 330, a storage unit 335, a communication unit 340, and a control unit 350. It can be configured to include. According to an embodiment of the present invention, the sensor unit 310, the attitude information derivation unit 320, the determination unit 330, the storage unit 335, the communication unit 340 and the control unit 350 are at least some of them. The program module may be in communication with the content providing support system 200. The program module may be included in the user device 300 in the form of an operating system, an application program module, or other program module, and may be physically stored in various known storage devices. In addition, such a program module may be stored in a remote storage device that can communicate with the user device 300. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

First, the sensor unit 310 according to an embodiment of the present invention may include a sensor such as a motion sensor, an acceleration sensor, a gyro sensor, a three-axis rotation sensor, and the like, which operate according to the movement of the user or the body part of the user. . The sensor unit 310 may be configured with at least one of these known sensors. The sensor unit 310 may detect the movement of the user device 300 and output (record) data according to the passage of time. The motion data may be physical values related to the speed, acceleration, three-axis rotation, and the like of the user device 300. The motion data may be stored in the storage 335 as described later.

Next, the posture information deriving unit 320 according to an embodiment of the present invention, based on the output value (that is, the motion data of the user device 300) of the sensor unit 310 over time, the sensor The position of the movement of the user device 300 including the unit 310, and further, the posture estimated by the user wearing the device 300, or the information regarding the change of the position may be derived. If necessary, the posture information as described above may include information regarding the position where the user device 300 is worn on the user's body. However, this component is not essential, and all or part of the function may be replaced by the attitude information deriving unit 210 which may be included in the content providing support system 200.

Next, the determiner 330 according to an embodiment of the present invention may determine the modality or output of the content provided by the user device 300 according to the derived information about the posture of the user or the change of the posture. However, this component is not essential, and all or part of the function may be replaced by the determining unit 220 which may be included in the content providing support system 200.

The configuration principle of the posture information derivation unit 320 or the determination unit 330 may be very similar to that of the posture information derivation unit 210 or the determination unit 220 as described above.

Next, the storage unit 335 according to an embodiment of the present invention, the content of the motion data of the user device 300, the posture information derived from such data and / or the posture information of the posture information according to the corresponding posture or posture change Rules regarding determining modality or output can be stored. The storage unit 335 may be a known storage device such as a flash memory or a hard disk.

Next, the communication unit 340 according to an embodiment of the present invention enables data transmission and reception to / from the sensor unit 310, the attitude information derivation unit 320, the determination unit 330, and the storage unit 335. To perform the function.

Finally, the control unit 350 according to an embodiment of the present invention is the flow of data between the sensor unit 310, attitude information derivation unit 320, the determination unit 330, the storage unit 335 and the communication unit 340 It can control the function. That is, the controller 350 according to the present invention controls the data flow from / to the outside of the user device 300 or the data flow between each component of the user device 300, thereby deriving the sensor unit 310 and the attitude information. The unit 320, the determiner 330, the storage 335, and the communicator 340 may control to perform unique functions, respectively.

Derivation of posture information

Hereinafter, the content providing support system 200 or the user device 300 according to the present invention will be described with respect to deriving information regarding the change of the posture or posture of the user.

As shown in the left view of FIG. 4, the user may be in a position to listen to a sound output from the user device 300 (typically, a smart watch) worn on the left wrist. In this case, the user may pull the left wrist near the ear from another position, which is typical of the shape of the human arm or the trajectory of the movement of the arm. The motion data of the sensor unit 310 of 300 may also be a factor that is generated with a certain pattern (that is, the trajectory characteristic of the motion) within a certain range. For example, this pattern may be that which appears along the trajectory that the left wrist typically draws when the user lifts the left arm from near the waist to near the ear. Conversely, the similar pattern of motion data may reveal a very high probability that the user has moved the user device 300 worn on the left wrist as shown in the left figure of FIG. 4.

As can be seen in the middle of FIG. 4, the user may turn the user device 300 worn on the left wrist to slightly turn his or her face toward the face to view time or messages. Even in such a case, the motion data of the sensor 310 may have a predetermined characteristic pattern.

As can be seen in the likelihood of FIG. 4, the user can stand or walk with the user device 300 on the left wrist. Even in such a case, the motion data of the sensor 310 may have a predetermined characteristic pattern.

In the above-described cases, the motion data of the sensor unit 310 may be analyzed by the posture information deriving unit 320 for a predetermined time. The length of this time may be determined by some experimentation by those skilled in the art. Such length of time may be determined uniformly according to the judgment of those skilled in the art, but may be adaptively determined according to the type of motion data or the trajectory characteristic of the motion that it represents. The posture information deriving unit 320 may determine predetermined posture information by comparing a characteristic pattern of previously stored motion data with a characteristic pattern of newly detected motion data. This may relate to a posture indicated by a user or a portion of a user's user device 300 or a change in such a posture.

Although the posture information deriving unit 320 of the user device 300 has been described with respect to deriving the posture information, the posture information deriving unit 210 of the content providing support system 200 may perform at least some of these functions. Can be. In this case, the motion data of the sensor 310 may be transmitted to the content providing support system 200.

Of content Moderina Decision on output

Hereinafter, various embodiments of the present invention regarding determining the modality of the content or determining the output of the content and performing adjustment or control according to the present invention will be described with reference to the drawings.

1. When there is only one user device 300 that provides content

FIG. 5 is a diagram illustrating various postures that a user may take while wearing one user device on a wrist according to one embodiment of the present invention. As shown, the user may raise and lower the hand while wearing the user device 300 (eg, a smart watch) on the wrist, in which case the user device 300 is based on the trajectory of the movement. For example, when the location of the device 300 is determined to be close to the user's ear, the sound output level of the content including the sound may be lowered, and when it is determined to be far, the sound output level may be increased. This adjustment of the output level can be performed continuously depending on the distance to the ear to be estimated. That is, the output level can be adjusted to have a positive correlation with the estimated distance to the ear. On the other hand, in the above case, it may be desirable to maintain the lowered sound output level if the user stays for a predetermined time while raising the hand wearing the user device 300.

Further, as a similar example, when it is determined that the position of the user device 300 is close to the eyes of the user or when it is determined that the front surface of the display of the user device 300 enters the user's field of view, the user device 300 Can provide content that includes both video and sound. Otherwise, only sound of the content may be provided. In this case, the display of the video of the content may be suppressed.

In addition, the user device 300 may adjust frequency characteristics of the sound rather than the output level of the sound. The Doppler effect may occur when the user device 300 approaches or away from the user's ear, and the user device 300 continuously adjusts the frequency characteristics of the sound of the content provided in this case to the user. You can also listen to sound at one level. That is, the user device 300 may include a known adaptive equalizer to increase or decrease the frequency of sound of the content according to the movement of the user device 300. For example, when the user device 300 is approaching the user's ear, frequency adjustment may be performed to lower the frequency of the sound. Obviously, in the opposite case, frequency adjustment may be performed to increase the frequency of the sound. This frequency adjustment may be made based on the value of the speed at which the user device 300 is moving.

FIG. 6 is a diagram illustrating other postures that a user may take while wearing one user device on a wrist according to an embodiment of the present invention. As shown, the user may move the user device 300 (typically a smart watch) away from or near the body while wearing it on the wrist (eg, the distance between the user device 300 and the body in a city may be Increase from L1 to L3, or vice versa), the user device 300 displays the display output level of the visual content when it is determined that the location of the device 300 is close to the user's body based on the trajectory of the movement. You can lower the brightness and increase the display output level if you think it is far. The adjustment of the output level may be continuously performed according to the estimated distance to the body (here, the distance to the body may also be estimated according to the characteristics of the movement trajectory of the user device 300). That is, the output level can be adjusted to have a positive correlation with the estimated distance to the body. On the other hand, the target of the adjustment may be not the display output level but the display resolution, the size of the displayed text or image, and the like.

According to an embodiment of the present invention, the modality or output of the content provided by the user device 300 may be determined in consideration of security. If the user device 300 is a smart watch and the user makes a movement to turn the back portion of the wrist out of the body while wearing it on the wrist or the user walks while exposing its display panel outside the body, the user device 300 Suppresses the display of the content or decreases or reduces the output level, resolution, size of the object, and the like. According to this, the private message received by the messenger program installed in the user device 300 can be prevented from leaking to external persons. Such leakage prevention may be performed only when the content being provided by the user device 300 is classified as personal content such as a message.

Reference will be made to FIG. 4 again. According to an embodiment of the present invention, a user wears the user device 300 on his left wrist and listens only to the contents provided by the user (in the case of a left view), or views an image while listening to the sound (in the middle case). ), You can only feel the tactile stimulus belonging to the content provided without listening or watching (in the case of likelihood). That is, the modality of the content may be adaptively changed according to a posture that the user takes while wearing the user device 300.

2. When there are a plurality of user devices 300 providing content

When there are a plurality of user devices 300 that provide content, the modality or output of the content provided by one or more of the devices 300 is adaptively determined according to the movement of one or more of the user devices 300. Can be adjusted, controlled and controlled. Here, the reference motion data may be data on relative motion between the two user apparatuses 300 (for example, relative speed, relative acceleration, distance between each other estimated by relative speed or relative acceleration, etc.). .

FIG. 7 is a diagram illustrating two postures that a user may take using two user devices according to one embodiment of the present invention. As illustrated, the user may wear the user device 300b such as a smart pad with the right hand while wearing the user device 300a such as a smart watch on the left wrist. First, in the case of a left view, the user device 300b may provide both the video / image and sound when providing content. However, as shown in the likelihood, when the user moves the user device 300a to the side of his or her ear, the user device 300a detects this and then communicates with the user device 300b as necessary. Only the sound of the content provided by the user device 300b may be taken and provided separately (so-called split-out). Of course, in the opposite case, that is, when the user device 300a moves downward near the waist of the user, the user device 300a is excluded from the provision of the content, and the user device 300b is again a video of the content. It can provide both image and sound (so-called sum-up).

On the other hand, when the acoustic content provided by the user device 300b is composed of the L component sound and the R component sound, the split of the formula such that only the sound of the L component is provided through the user device 300a among the two sounds. Out can also be realized. At this time, the user device 300a may of course be moved to the side of the user's ear. In the opposite case, i.e., when the user device 300a makes a downward movement near the waist of the user, the user device 300a is excluded from providing the content, and the user device 300b again returns the L of the acoustic content. Both component and R component may be provided. This can be seen as a summation.

For the splitout or summation described above, the user device 300a and the user device 300b may be interconnected by a method of Bluetooth communication or WiFi communication. Alternatively, the user device 300a and the user device 300b may be configured such that a device is configured with a video / image (ie, video) and / or sound (ie, audio) by communication with the content providing support system 200. When it is determined how to provide the content, the content may be provided while performing splitout or summation according to the decision.

Examples of useful split outs include:

(1) When a user receives content including video and audio through a smart phone and puts the Bluetooth earphone in his or her ear, the video may still be provided through the smart phone and the audio may be provided through the Bluetooth earphone.

(2) When a user is provided with contents including video, audio, and tactile via a smart phone and wears a VR glove after wearing the HMD device, the video is transmitted through the HMD device. Tactiles can be provided via smartphones and via VR gloves.

(3) When the user receives both the L component and the R component of the audio content of the content through the smart watch worn on one wrist, the user holds the smart phone with the other hand or the same hand to bring it closer to the smart watch, that is, according to the present invention. According to an embodiment, as shown in FIG. 8, which is a diagram illustrating different postures that a user may take using two user devices, as shown in FIG. 8, as shown, the L component of the audio of the content is determined by the smart phone. And the R component may be provided in a smart watch.

Some useful examples of summation include:

(1) When the user takes off the headset while receiving the video of the content through the smart phone and the audio of the content through the headset, the video and the audio of the content may be provided only through the smart phone.

(2) When the user receives the video of the content through the smart glasses and the audio of the content through the smart phone and takes off the smart glass, the video and the audio of the content may be provided through the smart phone.

3. The content is directional

When at least one user device 300 includes a high-directional speaker (not shown) or includes a plurality of display panels having different directions to each other, the at least one user device 300 may be sounded according to the posture information of the present invention. The content may be concentrated and provided only in one direction, or the visual content may be determined to be provided only by some of the plurality of display panels.

4. When the location context of the user device 300 or the battery level is further considered

Notwithstanding various embodiments of the present invention, the modality or output related to content provision may be determined further based on the locational context of the user device 300 providing content or the remaining battery capacity of the user device 300. have. For example, in the above-described embodiment, even when it is determined that the content is provided visually and audibly according to the posture indicated by the user, when the place where the user device 300 is estimated to be located is outdoors or in a public place, Provision of audio content may be restricted. In another example, even when the content is determined to be provided visually and audibly according to the posture indicated by the user, when the remaining battery level of the user device 300 is less than or equal to a predetermined level, the user device 300 provides the content. Some of the modalities employed may be limited.

Embodiments according to the present invention described above can be implemented in the form of program instructions that can be executed by various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified with one or more software modules to perform the processing according to the present invention, and vice versa.

Although the present invention has been described by specific matters such as specific components and limited embodiments and drawings, it is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. Those skilled in the art may make various modifications and changes from this description.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and the scope of the spirit of the present invention is defined not only in the claims below, but also in the ranges equivalent to or equivalent to the claims. Will belong to.

310: sensor unit

320: posture information derivation unit

330: decision

335: storage unit

340: communication unit

350: control unit

Claims

Deriving information on a posture or posture change of the user based on the motion data of the user device, wherein the motion data is recorded over time by a sensor included in the user device;

Determining the modality or output of the content provided by the user device based on the derived information;

How to include.
The method of claim 1,

The information deriving step is performed based on motion trajectory information collected and accumulated with respect to a plurality of different user devices.
The method of claim 1,

And deriving the information is based on a position where the user device is worn by the user.
The method of claim 1,

The determining step may include: an estimated distance the user device represents with respect to a particular portion of the user's body, the speed of the user device, the flipping or rotation of the user device, the distance to the other user device of the user device, the user Determining the modality of the content based on at least one of a relative speed of the device and the other user device and a relative acceleration of the user device and the other user device.
The method of claim 1,

The determining step may include: an estimated distance the user device represents with respect to a particular portion of the user's body, the speed of the user device, the flipping or rotation of the user device, the distance to the other user device of the user device, the user Determining the level of the output of the content based on at least one of a relative speed of the device and the other user device and a relative acceleration of the user device and the other user device.
The method of claim 1,

The determining step may include: an estimated distance the user device represents with respect to a particular portion of the user's body, the speed of the user device, the flipping or rotation of the user device, the distance to the other user device of the user device, the user Determining a frequency of the output of the content based on at least one of a relative speed of the device and the other user device and a relative acceleration of the user device and the other user device.
The method of claim 1,

The content is part of content provided by another user device.
The method of claim 1,

And the content is content corresponding to some modality of content provided by another user device.
A computer readable recording medium for recording a computer program for executing the method according to claim 1.
A posture information deriving unit for deriving information on a posture or posture change of the user based on the motion data of the user device, wherein the motion data is recorded over time by a sensor included in the user device;

Determination unit for determining the modality or output of the content provided by the user device based on the derived information

System comprising.
The method of claim 10,

And the attitude information derivation unit is configured to perform the information derivation based on motion trajectory information collected and accumulated with respect to a plurality of different user devices.
sensor,

A posture information deriving unit for deriving information on a posture or posture change of a user based on motion data recorded by the sensor over time;

Decision unit for determining the modality or output of the provided content based on the derived information

User device comprising a.
The method of claim 12,

The posture information deriving unit, the user device to perform the information derivation based on the position worn by the user device.
The method of claim 12,

The determining unit may include: an estimated distance that the user device represents with respect to a specific part of the user's body, a speed of the user device, a flip or rotation of the user device, a distance to another user device of the user device, and the user device. And determine the modality of the content based on at least one of a relative speed of another user device and a relative acceleration of the user device and another user device.
The method of claim 12,

The determining unit may include: an estimated distance that the user device represents with respect to a specific part of the user's body, a speed of the user device, a flip or rotation of the user device, a distance to another user device of the user device, and the user device. And determine the level of the output of the content based on at least one of a relative speed of another user device and a relative acceleration of the user device and another user device.
The method of claim 12,

The determining unit may include: an estimated distance that the user device represents with respect to a specific part of the user's body, a speed of the user device, a flip or rotation of the user device, a distance to another user device of the user device, and the user device. And determine a frequency of the output of the content based on at least one of a relative speed of another user device and a relative acceleration of the user device and another user device.
The method of claim 12,

And the content is part of content provided by another user device.
The method of claim 12,

And the content is content corresponding to some mode of content provided by another user device.