USO0RE39745E

(19) United States (12) Reissued Patent Setogawa et a]. (54)

(75)

US RE39,745 E

(10) Patent Number:

(45) Date of Reissued Patent:

Jul. 24, 2007

RECORDING MEDIUM RETAINING DATA

5,838,316 A

* 11/1998 ArruZa ..................... .. 715/810

FOR MENU CONTROL, MENU CONTROL METHOD AND APPARATUS

5,880,729 A 5,966,121 A

* 3/1999 Johnston et a1. .. * 10/1999 Hubbell et a1.

5,966,122 A

* 10/1999

Inventors: Toshiaki setogawas Kanagawa (JP); A ato Nakagawa Kanagawa (JP)

5,990,972 A : 11/1999 Bond-Harris et a1. ..... .. 348/563 6,141,004 A 10/2000 Jeong .......... .. 715/723

y

_

’

’

Tsuyoshi Oda, Tokyo (JP)

6,215,952 B1 *

Itoh

4/2001

715/823 715/726

......................... .. 715/838

Yoshio et a1. ............... .. 386/94

FOREIGN PATENT DOCUMENTS

(

73

)

Assi nee: Son Cor oration, To

g

y

P

0 JP

ky ( )

NO.Z -

(22)

Filed:

Oct. 6, 2004

Relssue of: Related US. Patent Documents

(64) Patent No.:

NO': '

* 12/1995

0 737 980 0 738 0'78

* l0/l996 * 10/1996

EP

0 788 094

*

8/1997

EP

0 788 105

*

8/l997

W0

W0 97 02701

1/1997

Oct. 22, 2002

OTHER PUBLICATIONS

0A9l:13;’02717998

Patent Abstracts of Japan, vol. 1998, No. 10, Aug. 31, 1998

g'

’

& JP 10 145722, May 29, 1998*

F oreign ' A pp l'ica t'ion P riority ' ' D at a

Aug. 22, 1997

0 685 845

EP EP

6,469,718

Issued:

( 30 )

EP

* Cited by examiner

(JP) ........................................... .. 9-226253

Primary ExaminerACaO (Kevin) Nguyen (51)

Int- ClG06F 15/00 G06F 13/00

(74) Attorney, Agent, or FirmiFrommer Lawrence & Haug LLP; William S. Frommer

(200601) (2006.01)

(57) (52) (58)

ABSTRACT

US. Cl. ....... ...... ..; .... .. 715/810; 715/797; 715/716 Field of Classi?cation Search ........... 715/810,

Arecording medium retaining data for menu Control’ amenu Control method and an apparatus are provided for Creating a

715/797’ 719’ 723’ 727’ 716’ 725/37’ 38’

menu highly expressive and attractive to the viewer. When

_

_

_

725/40

operation of a menu button is determined on a menu created

See apphcanon ?le for Complete Search hlstory' References Cited

(56)

With a moving picture With sound, the menu button turns into action highlighting and the color of the button changes into a highlight color. In order to emphasize action high lighting of the menu button, a speci?c short moving picture With a sound is automatically replayed. After the replay of

U.S. PATENT DOCUMENTS

4,422,105 A : 12/1983 Rodesch et a1. ............ .. 386/83 i ghngler et a1‘ """""" " 715/723 ,

,

the moving picture’ the display jumps to a Chapter of a title selected With the menu button and a replay is started.

uchner et a1.

5,831,616 A

* ll/l998

Lee .......................... .. 715/861

5,831,617 A

* 11/1998 Bhukhanwala ............ .. 715/839

84 Claims, 18 Drawing Sheets

PG C

6,4

6,5

I

I

r

6,6

70

L

PRE

VOB

V08

CIIID

ID

ID

V08 _____ POST

ID

CMD

67

I

CELL CELL CELL

CELL CELL CELL

(CN#l ) (CNIIZ) (CN#3) (CN#4) (CN#5) (CW5)

6S8 6? CELL CELL ID CMD

U.S. Patent

Jul. 24, 2007

Sheet 2 0f 18

US RE39,745 E

301 a

(

) Scenei : lntroduct ion

Scene4:Romance

SceneZ: Incident 1

Scene5:Chase

Scene3: Incident 2 ,

Scene?zShowdown 1

Root

Previous

Page

Cancel

Next Pa 8

9

H62 RELATED ART

U.S. Patent

Jul. 24, 2007

Sheet 3 0f 18

2v Scene] : Introduction I

SceneZ: Incident 1 _ Next Page I

<— 03% actual replay of moving picture of the chapter

aw FIG.3

US RE39,745 E

U.S. Patent

Jul. 24, 2007

1)

Sheet 4 0f 18

US RE39,745 E

dhWm.a. m.mv.mh (.l\ ) h

t

em m a. .m

I

m w@

13

2S5.:E WM@GwQw? 3E=?%u25=:?.Eu ccchh

FIG.4

m w

)

9,. J. 9..3542

U.S. Patent

Jul. 24, 2007

V08 ID#1

Sheet 6 0f 18

US RE39,745 E

652

VOB

63~

CELL CELL CELL CELL CELL CELL

|D#1

ID#2 |D#3 |D#4 ID#5 ID#6

FIG]

4

PGC

634

:70

ails

6‘? r/

PRE

V08

V08

CMD

ID

ID

V08 _____ POST

ID

CMD

67

€

CELL CELL CELL

CELL CELL

CELL

(CNiH) (CW2) (CW3) (CN#4) (CN#5) (0M6)

SS8 6? CELL ID

CELL CMD

U.S. Patent

Jul. 24, 2007

Sheet 7 0f 18

US RE39,745 E

63

3

CELL

71

72

s

s

.j’s

SUB-

PICTURE

'

HLl

7(6

7;!

I

I

I

PICTURE BTN pixel COLOR

..

74

'

Vl DEO

75 SUB-

, AUD I0

7<8 I

1

Hlghllght BTN COLOR INFO

data

79

80

‘S

S

SELECT ACTION COLOR COLOR

81

82

S ' BTN POSITION

83

3. ADJ BTN

BTN CMD

U.S. Patent

Jul. 24, 2007

618

6,9

CN#2

CN#3

CELL ID CELL CELL :0 CELL =m 0M0 _ =#2 cmo

\

CELL lqCELL =#3 cm)

VOB M62 - - 0 o ~

L

s

SUB

PICTURE

BTN

Highlight

pixel

COLOR

COLOR

data

79 5

80 S

SELECT ACTION

COLOR

COLOR

US RE39,745 E

[70 PGC

6;‘ Licmr?si PRE 0M0

Sheet 8 0f 18

7 BTN -

ADJ

BTN

POSITION

BTN

CND

FIG.] 0

6&6 .... .. POST cmo

U.S. Patent

Jul. 24, 2007

Sheet 9 0f 18

US RE39,745 E

“

9.

m .

26 c5_|1u.

mME68NEEEmN35 .50e.5“. m

5%=5sea:5

MW mmvolto 8

2

L

mm 20 w # N ._

26E

U.S. Patent

Jul. 24, 2007

Sheet 10 0f 18

I

FIG.12

31;,

US RE39,745 E

U.S. Patent

Jul. 24, 2007

201

Sheet 12 0f 18

US RE39,745 E

720pixels

001010 0

202

FIG.14

Qpixels

:11 1

000000101010000000 212

21 1

00 00001011 10000000

0000001011 10000000 1010101011 10101010 -_>

101‘111111111111110

1040101011 10101010 r0000 00 1011 10000000

212

0000|00101110000000

000g001‘01010000oo0

21)3 FIG.15A

FIG.15B

Qp‘i—xe>ls

U.S. Patent

Jul. 24, 2007

r

US RE39,745 E

Sheet 13 0f 18

Instruct menu replay I

J 8100

I

I

Execute root menu PGC I $101 I IShift to chapter menu and start replay] S102

L

Replay _menu of 1st page

I $103 0 .

F

C

Select highlight emu

1 $104

.L

In, kc

S105

pressed‘?

up/down

Y

cursor

N

S108

‘ cell CIID CNHI

left/right _ I 3107 cursor Shlft t0 Start of

key

—-J B'I‘Nttl

cell and execute

which key?

S109 menu Shift select enter

highlight to

S106 Replay to end of

hich

S110

CN#1 and start

highlight? I '

$111 mm

I____I 511

Action highlight ' Action highlight

1mm 1

S113

Action highlight

BTNi'? I S112 Execute

BTIYFZ 1 S116 Execute

BTN#3 I S11 1 Execute

BTN CHM-'1

BTN CIID#2

BTN CIID#3

I

3113

Enter GP1=1 and

.

I

sm

Enter GP1=2 and

‘__________J Replay dynamic S114 highlight picture?)

Q) FIG.16

| .

$120 '

U.S. Patent

Jul. 24, 2007

(1? S121

Execute cell CMD of CN#3 S122

US RE39,745 E

Sheet 14 0f 18

(113) S125

Select highlight BTN#5

Shift to

POST CMD

$126

I

. ny ke .ressed‘?

‘

ugh/19:01:.“

Y

highlight to

adjacent button -—-—-] ems |

Sine“;key

‘

.

I

cell and execute .

cell CMD CN#2 1 S123

8 31182343?“ Shift to start of 1

cm and start

buttoglgglect

rephy

$132 ems highlight‘?s 5 mm 1

$139

Action highlight Action highlight Action highlight BTN#5 BTMB BTN#4 1

$133

Execute BTN CMDtS

I

1

S137

1

Execute BTN CHD#6

$134

Enter GPl=3 and . shift to 011.14

1

$138

Enter GP1=4 and shift to om

1

$141

. _._ Shlft t° CM

S135

picture(2)

S123

Execute POST CMD

S124 Shift to chapter

following GPl

@

S14

Execute BTN CHDM

Replay dynamic highlight

——4

8127

Replay to end of

S129

which ke 9 Y-

S130

Shift select

N

FlG.17

U.S. Patent

Jul. 24, 2007

Sheet 15 0f 18

US RE39,745 E

F

lnstruct me'nu replay

I 8100

E

Execute root menu PGC

1 S101

[Shift to chapter menu and start replay] $102 I

l

Replay menu of 1st page

_| 3103

L

r

I

'Select highlight B'rhm

J 8104

@

S106 Replay to end of

‘Lt/3s‘??? Shift select

“it 3% E???“

which key?

S109 menu

Ce

left/right

enter

highlight to adjacent button

I

key Sursor button select 110

CN#1 and start replay

highlight‘? B'rhm i

$111 mm

s11

Bma |

8118

Action highlight Action highlight Action highlight N BTMIZ BTN#3 I

8112

Execute

' I

Sll?

shift to one

1

S11 9

Execute

BTN CHD#2

$113

Enter GP1=1 and

L

Execute

BTN CMD?l

I

I

BTN CMD#3

S117

Enter GPl=2 and

shift to cm

Replay dynamic S114

highlight

JiCtUI'C?)

d) FIGJB

S107

Shift to start of

c

1 .

8120A .

Sm“ m CW3

U.S. Patent

Jul. 24, 2007

(DP 8121

Execute cell CMD of CR3

US RE39,745 E

Sheet 16 0f 18

(E? S125

Select highlight BTNQS

S122 Shift to

POST CMD

i

.

up/down

1 S127 Replay to end of

curs“ 8130

cell and execute C811 can) cm I 5123

h

“Gigi? t Shift to start of

111811118ht to adjacent button

‘-_-_J BTN?S

.

f

Sh1ft_select

ey button select 5131

CN#2 and start replay

highlight‘? I

S132 BTMG

|____

S13" BTN#4_|

8139

Action highlight Action highlight Action highlight BTN#5 BTNti? BTNM I

$133

l

Execute BTN CMD'=;5

J

8137

.

Execute BTN CMD#6

3134

Enter GP1=3 and

shift to CNM

]

S1 3

S14

1

Enter GP1=4 and

.

shift to cm

E

I

Execute BTN CHD#4

S1 7

Shl? t° m4

L

IL

Replay dynamic 8135 highlight picture(2)

v————-1

8123

Execute

FIG.19

POST CMD

8124A

GP1=1. 2. 3. 4;

8142A Shift to chapter following GPl

8143A 'Shift to CN#2

GP1=20 'l , 8144A

Shift to CN#1

U.S. Patent

Jul. 24, 2007

l

US RE39,745 E

Sheet 18 0f 18

Instruct menu replay

1 S200

Execute root menu PGC

|s201

Ehift to chapter menu and start repla? 8202 L

Replay menu of 1st page

i S203

L

Select highlight mm

18204 $206

up/down

Replay to end of

CUISOI'

cell CllD CN#1 S207 I Shift to start of

cell and execute

left/right

Shift select highlight to

adjacent button

CNiil and start

butm?lgglect S210

__.—_._J

replay

highlight‘?

BTNitl

S211

S215

Action highlight

Action highlight

BTN#1 l

BTN#2 l

S2l2

Execute BTN CMDttl I S213 Enter GP1=1 and shift to P632

J 821 I Enter GPl=2 and shift to PGC#2

ii,

4

Replay dynamic '

highlight picture 8214

I Execute POST Clll) of $218 PGC#2 I

Shift to chapter following CH

(35B

S2

Execute BTN CMD#2

8219

US RE39,745 E 1

2

RECORDING MEDIUM RETAINING DATA FOR MENU CONTROL, MENU CONTROL METHOD AND APPARATUS

menu page selector buttons 303. Three of the six chapter designation buttons 301 are vertically arranged on the left of the screen and the other three on the right. The two menu

selector buttons 302 are arranged side by side below the

chapter designation buttons 301.

Matter enclosed in heavy brackets [ ] appears in the original patent but forms no part of this reissue speci?

For authoring such a menu, it is required to create pixel data corresponding to each operation button in accordance with the subpicture format of the DVD. In addition, it is necessary to perform programming in navigation command

cation; matter printed in italics indicates the additions made by reissue. BACKGROUND OF THE INVENTION

required for each operation button.

1. Field of the Invention The present invention relates to a recording medium retaining data for menu control, a menu control method and

For replaying a DVD using the menu as shown in FIG. 1, the viewer selects the various buttons on the menu and

an apparatus, each provided for controlling operations in

controller includes, for example, an up cursor key, a down cursor key, a left cursor key and a right cursor key for

speci?es operations with the remote controller. The remote

accordance with manipulation of menu buttons on a menu

used for replaying information on the recording medium such as a digital video disk or digital versatile disk (DVD). 2. Description of the Related Art A DVD and a DVD player have been practically utilized. A DVD is an optical disk for recording digitized video and audio data. Of replaying data on a DVD and recording data onto a DVD, a DVD player performs at least replaying data. In the DVD format (standard), the format of still picture called subpicture that may be overlaid on a moving picture

is de?ned besides normal moving pictures coded in Moving Picture Experts Group (MPEG) 2. A DVD implements a

moving a selected operation button vertically and horizon tally and a menu enter key for completing the operation of a selected operation button. In general, a menu displayed on a monitor includes 20

25

several operation buttons. The viewer presses the cursor keys of the remote controller and temporarily selects one of the operation buttons. The viewer further presses the menu

enter key and completes the operation of the selected operation button. According to the DVD format, the color of the selected button is changed or the selected button is framed so as to indicate which button is selected on the

screen. Such indication will be called highlighting in the following description. FIG. 2 shows an example of menu wherein one of the operation buttons is highlighted. As

caption (subtitle) of a movie and a menu with such a

subpicture. In the DVD format, a speci?c programming language called navigation command is provided for controlling a replay method of a DVD player. Programming in navigation command implements, for example, an interactive program (software) and a replay started at a speci?c point called

shown, the upper-left button 301a of the six chapter desig nation buttons 301 is highlighted. Highlighting includes two types. One is select highlight ing for indicating that the operation button in the menu is

chapter such as the start of a highlight scene or a break in a only temporarily selected. The other is action highlighting 35 story in a movie or a track on a compact disk (CD) that for indicating that the menu enter key is. pressed to be

indicates a break between pieces of music.

effective for about one second after the menu enter key is

An interactive program as mentioned above requires a

pressed until immediately before the operation is performed.

user-operable picture for interactive questions and answers. An interactive operation of a DVD player is usually

restricted by the buttons dedicated to the hardware of the

In the example shown in FIG. 2, if the menu enter key is pressed when the upper-left button 301a is in the state of select highlighting, the highlight color turns into the action highlighting state for about one second. The display then directly jumps to the chapter of ‘Scene 1: Introduction’ where a replay is started. However, indication with simple highlighting as described above, that is, a change of button color or framing only, is not effective enough for informing the viewer of

DVD player.

button selection or execution. Such a user interface is not

implemented through indirect manipulation by the viewer

40

selecting operation buttons displayed on a menu with cursor keys and so on of a remote controller, instead of direct

interactive manipulation using operation buttons of the DVD player or the remote controller. As a result, various types of

45

interactive software may be provided without being

user-friendly. Furthermore, of sixteen colors that may be

Among menus for such interactive operations, basic ones

common to any DVD are de?ned as DVD system menus. 50 used for highlighting, up to four colors can be used at the

same time. Such simple highlighting lacks expressivity. In

The DVD system menus are frames called up by a viewer through operation of the menu button of the remote con troller of the DVD player for replaying a DVD in the DVD

terms of product, it is di?icult to create a menu attracting the

viewer with simple highlighting only.

player. The format provides that the menu button is required to be added to the remote controller. The DVD system menus include operation buttons displayed on the screen.

SUMMARY OF THE INVENTION 55

It is an object of the invention to provide a recording

Various replay patterns are achieved by the viewer through

medium retaining data for menu control, a menu control

selecting the operation buttons with a cursor key. The format provides that the cursor key is required to be added to the

method and an apparatus so as to create a menu expressive

remote controller. Various types of DVD system menus are de?ned in the

and attractive to the viewer. 60

DVD format. FIG. 1 shows an example of chapter menu which is one of the DVD system menus. The chapter menu is a menu including operation buttons arranged on the screen

for allowing a direct jump to each chapter. The chapter menu in FIG. 1 includes six chapter desig nation buttons 301, two menu selector buttons 302 and two

A recording medium retaining data for menu control of the invention is provided for implementing input of an instruction in response to an operation on a menu displayed on a screen. The data for menu control has a data structure

including: menu display data for displaying the menu 65

including at least one menu button for instructing to execute

a predetermined function; response picture data for display ing a predetermined response picture in response to deter