USO0RE39652E

(19) United States (12) Reissued Patent

(10) Patent Number: US RE39,652 E (45) Date of Reissued Patent: May 22, 2007

Oashi et a]. (54)

MULTI-MEDIA INFORMATION RECORD DEVICE, AND A MULTI-MEDIA

FOREIGN PATENT DOCUMENTS

INFORMATION PLAYBACK DEVICE

(75) Inventors: Masahiro Oashi, Hirakata (JP); Yuki Kusumi, Sakai (JP); Masahiro KaWai,

Higashi-Osaka (JP); Chihiro KaWahara, Kadoma (JP); Ryoichi Sasaki, Hirakata (JP) (73) Assignee: Matsushita Electric Industrial Co., Ltd., Osaka (JP)

JP JP JP JP JP JP JP JP JP JP JP

3-156573 3-286482 3-289280 3-291696 4-960 528648 5-53544 5314228 670113 6-343146 6348580

7/1991 12/1991 12/1991 12/1991 1/1992 2/1993 3/1993 11/1993 3/1994 12/1994 12/1994

OTHER PUBLICATIONS

(21) Appl. No.: 09/587,107 (22) Filed:

MacroModel, MacroMedia, Chapter 4, pp. 147*161, 178*195, May 1993*

Jun. 2, 2000

Harada, Komei et al., “Scenario Processor: A Conceptual Scenario Writing Environment”, IPSJ SIG Technical Reports, vol. 91, No. 65, pp. 135*140, Jul. 19, 1991.

Related US. Patent Documents

Reissue of:

(64) Patent No.:

(30)

5,767,845

Issued:

Jun. 16, 1998

Appl. No.: Filed:

08/512,302 Aug. 8, 1995

Primary ExaminerACesar Paula

(57)

Foreign Application Priority Data

Aug. 10, 1994 Aug. 4, 1995

A CD-ROM 201 for recording multi-media information of at

(JP) ........................................... .. 6-188424 (JP) ........................................... .. 7-199807

(51) Int. Cl. G06T 01/00

ABSTRACT

least one page stream. Contents of each page stream are

successively recorded in the storage areas in the CD-ROM 201. The following three items are shoWn by the page

stream: a partial image list having at least one pair of partial

(2006.01)

image data Which describes partial images of one screen

image and display state information including X-Y (52)

US. Cl. ................................... .. 715/500.1; 345/475

(58)

Field of Classi?cation Search ............ .. 707/500.1,

shoWing the display state; control information Which

707/501.1; 386/46, 52, 55; 345/7l6i726,

describes command to be executed corresponding to an

345/473i475; 715/500.1, 501.1, 719*726 See application ?le for complete search history.

input signal; time line information Which describes param eters concerning time sequence processing to be executed corresponding to the control information. The display data

(56)

References Cited

creation unit 213 synthesizes partial images shoWn by the partial image list and creates display data from the partial

U.S. PATENT DOCUMENTS 3,510,210 A

*

4,951,229 A 5,208,588 A

5/1970

Haney ....................... .. 382/39

8/1990 DiNicola et a1. *

5/1993

coordinates, X-Y enlargement rates and a rotational angle

395/173

image data and display state information in the page stream read from the CD-ROM 201, and Writes the display data in the display data storage unit 209.

Nishiyama ................ .. 345/123

26 Claims, 19 Drawing Sheets

(Continued)

image dam

image 4m

E1

11111111051111»,

X>Y coordinates of

‘a!

1mg: 1 1001111111“

.100)

11111111 ivnal 13

Start Lhe lime line clu k

11m 1m: infnn-nnion

0:00

‘0001

00m

x~r coordinates 1111111111011 : pm: image 10; 150150 110110 190150 mic rtlurldls la ob'wi anialim 21133

-03

US RE39,652 E Page 2

US. PATENT DOCUMENTS

5,459,830 A

* 10/1995

Ohba et a1. ............... .. 395/173

5,502,570 A

*

Shikakura e161. .......... .. 386/95

Ohbfl eta1~ --------------- -- 348/426

5,566,290 A

* 10/1996

5,353,063 A 5353329 A

* 10/1994 Yag1sawa et a1. ......... .. 348/426 10/1994 Hay/18111

5,592,602 A 5,818,436 A

>1<

5,353,392 A

* 10/1994

5,428,723 A

*

*

5,214,758 A

5/1993

Luquet et a1.

............ .. 395/174

6/1995 Ainscow et a1. .......... .. 395/174

* cited by examiner

3/1996

Silverbrook .............. .. 395/173 V1997 Edmunds et a1‘ 3957174 10/1998 Imai et a1. ............. .. 715/500.1

U.S. Patent

May 22, 2007

\><\N zu<<> oAQQ?NI:

TUE

u m a

Sheet 1 0f 19

P H N

235% 2%Y33

15:0 Y

:BGEQ

52Y%

US RE39,652 E

U.S. Patent

May 22, 2007

Sheet 3 0f 19

US RE39,652 E

FIG. 3 multi-medizt information playback device 200 301

CPU

308

309

disc

i?IEI'fZlCC

313 speaker RAM

sound

D/A converter

/303 system clock 304 timer _

307 305

‘mage

.

D/A

'"Put

converter

device interface 315

317

U.S. Patent

May 22, 2007

Sheet 4 0f 19

US RE39,652 E

FIG. 4 201 402 401

403

U.S. Patent

May 22, 2007

Sheet 5 0f 19

US RE39,652 E

FIG. 5 partial image list partial image lD X-Y coordinates X-Y

enlargement rates

rotational angle

partial image data

kw control information A

B

?M__/q time line information

00:00

00:01

00:02

00:03

animation object I artial image lD

'

rotational value at each angle) time( -Y coordinatesX-Y enlargement rates.

f

time line stream iidentification number‘

d namic picture display object I partial image ID

U.S. Patent

May 22, 2007

Sheet 6 0f 19

US RE39,652 E

FIG. 6

time I 00 I 00.000

still picture data audio data

time I 00 I 00.033 F

audio data

X

I

U.S. Patent

May 22, 2007

Sheet 7 0f 19

US RE39,652 E

FIG- 7

_

@

48701

I load a predetermined page stream I ldtsplax data creation umt illustrates initial image I '

.

.

.

.

.

.

.

.

S702

5 S703N Y

/S706 execute command for an in ut si nal

5707

clock unit

* display data creation I unitillustrates

S708 N

operating ? .

.

read elased time from clock unit

S709

S71 1

Is there a partial image whose animation display is

update position information of . artial ima - e v

5 there a time line stream

which designates dynamic picture display ?

Y read still picture data and audio data

U.S. Patent

May 22, 2007

Sheet 8 0f 19

US RE39,652 E

FIG. 8 partial image list artial image ID

1

X-Y coordinates 100‘ 100 X-Y enlargement rates l‘ l rotational angle 0

partial image data partial image [D X-Y coordinates X-Y enlargement rates rotational angle

@ 2 120‘ l20 1‘ 1 0

partial image data partial image 1D

3

X-Y coordinates 150‘ 150 X-Y enlargement rates 1‘ l rotational agile 0

partial image data control information

input signal A input signal B

X-Y coordinates of partial image 1 should be (170100) Start the time line clock

input signal C

Readpage stream 2

time line information

00:00

‘00:01

00:02

X-Y coordinates animation 1 partial image ID3

150,150

l70ll70

190,150

time line stream I 1

dynamic picture display ogbject I partial image [D3

00:03

U.S. Patent

May 22, 2007

FIG. 9(a)

FIG. 9 (b)

FIG. 9(d)

FIG. 90:)

FIG. 9 (D

Sheet 9 0f 19

US RE39,652 E

U.S. Patent

May 22, 2007

Sheet 10 of 19

US RE39,652 E

FIG. 10 time I 00 I 00.000

still picture data

audio data

Al

time I 00 I 00.033

audio data

time I 00 I 01.000

still picture data audio data

Ai

time I 00 I 01.033 ‘_,_-------*'_-_1

audio data time I 00 I 02.000

still picture data

audio data

Aj

time I 00 I 02.033

audio data

I

U.S. Patent

May 22, 2007

Sheet 11 0f 19

US RE39,652 E

FIG. 11 partial image list partial image ID

1

X-Y coordinates 100‘ 100 X-Y enlargement rates 1‘ l

rotational angle

()

Partial image data

control information

input signal A

X-Y coordinates of partial image 1 should be (200,200)

time line information

@0200

‘00:01

[30:02

I

l

l

.

-

\

90:03

U.S. Patent

May 22, 2007

Sheet 13 or 19

US RE39,652 E

FIG. 13 multi-media information playback device 1200

1301 CPU

1302

interface

E 1303

@

gr I304

timer

1305

1 7 I’ 30 input device

L

video RAM

_ interface

1315

image D/A Converter

U.S. Patent

May 22, 2007

@

US RE39,652 E

Sheet 14 0f 19

FIG. 14

1,31401

initialize the identi?cation numbers ofthe page stream

and the time line stream to "l"

SW02

m 5: 3:35:32? the N 0

/S l 429

input of write order into the CD-ROM

I am ?

l

as“ '8

$1430

Milt! in the CD-ROM

initialize the partial image lD to "1"

81409

image to be described by

is there control mt‘ormat'on to bcdescn'

N

‘h; page Sum-,1

he page stream?

S1413

/8 1405 input name of the

/S 1410 input [he name of

partial image ?le

the input signal

T

. s there animation N display to be described by A

the page stream?

/ 406

input X-Y coordinates,

/S|4“

/Sl4l4

X'Y emaigemcm mes-

mP‘" "1° ‘:Qmmmd

input partial image ID of

and mmlonal mg“

FOTWSQQHdmE ‘0 ‘he’

the partial image to be

mp"! Signal

display by animation

/5 [407 .

.

l

ggrtggtétéiitgz‘page stream S1408

/51412 write in the page _

in?“ “PC typc of {,SM 15 ammauo"

increment the partial ‘mags ID ‘-——'—--J_

pair of time and arameter ?

input the pair of time and parameter write in the page

5 [413/ stream storage unit I

U.S. Patent

May 22, 2007

Sheet 15 or 19

US RE39,652 E

FIG. 15

Q) S1419

Is there

dynamic picture display to be described by the page stream ? Q Y

increment the identification number

X31420

input start/end time of the dynamic

of the a estream

picture display, and partial image ID to be dis la ed b d namic icture

input name of the dynamic picture file

Sl42l

S1422 Is there audio ?les to be played back

vnchronized with dynami picture ? Y

/si423

input the name of the audio file

, /JSl426 write the content of the

dynamic picture ?le in time line stream storage

/S1424 unit write a pair of still picture data and audio data corresponding to the same time in the time line stream stora e unit

write the identi?cation numberv of the time line stream,dynamic

S I425

picture display start/end time, the partial image ID '

.

.

.

.

increment the identi?cation number of the time line stream

S1427

U.S. Patent

May 22, 2007

Sheet 17 0f 19

US RE39,652 E

FIG. 17 multi-media information playback device 1600 170! network

301

interface 303

302

309

disc interface

E

313 speaker sound

D/A COI'IVC’JICI'

303

1 system clock

MPEG decoder

304

[1

Li) ttmer

mp?‘ interface

1'0)’ Pad

image converter

U.S. Patent

May 22, 2007

Sheet 18 0f 19

US RE39,652 E

co: 8%SE3

£:3c8o5z-?wm2E%Q:oz \

SwEQe:

5%523 580E3

8Q2:5@8wE%Qv, 2:32m :@592.8“

28?0E E5ow?oum

081

EQwoubma :“5E2.05 o0E5nm.o:bm :o5wE.oG

.05E EN

:55. E: