US006987862B2

(12) United States Patent

(10) Patent N0.: (45) Date of Patent:

Rhoads (54) VIDEO STEGANOGRAPHY (75) Inventor: Geo?'rey B. Rhoads, West Linn, OR

(Us) 73

Ass1'g nee: D'g' ' B eaverton, OR 1 lmarc C orp oration,

(US) *

N' ot1ce:

Sbj u ect to an yd'l' 1sc a1mer, t h e term 0 fh' t is patent is extended or adjusted under 35

U.S.C. 154(b) by 117 days. This patent is subject to a terminal dis claimer.

(21) Appl. No.: 10/617,571 (22) Filed:

4/1974 4/1974 5/1974 9/1974

3,845,391

A

10/1974

3,885,217 A

5/1975

Feb. 10, 2005

*Jan. 17, 2006

Rothfjell ............ .. 340/146.3 E Kavanagh et al. .......... .. 360/51 Walker et al. ............. .. 178/7.6 Loughlin et al. ...... .. 178/52 R Crosby

. . . . . . . . . . . . .

. . . . . . ..

325/64

Cintron .............. .. 325/26

3,894,190 A

7/1975 Gassmann .

3,900,890

A

8/1975

3,914,877

A

10/1975

Eibner Hines

179/15.55 R

. . . . . . .

. . . . . . . . . ..

. . . . . . . . . . . . . . .

360/73

. . . . . . ..

35/2

3,922,074 A

11/1975 Ikegami et al.

3,969,830 3,971,917 3,977,785 3,982,064 3,984,624 4,025,851 4,048,619 4,079,419

7/1976 7/1976 8/1976 9/1976 10/1976 5/1977 9/1977 3/1978

Grasham ....................... .. 35/2 Maddox et al. ..... .. 235/61.11 E Harris ...................... .. 355/133 Barnaby ................... .. 178/5.6 Waggener .......... .. 178/5.6 Haselwood et al. ........ .. 325/31 Forman, Jr. et al. ...... .. 340/154 Siegle et al. .............. .. 358/193

4/1978

Cook ........................ .. 360/60

A A A A A A A A

4,122,501 A

Prior Publication Data US 2005/0031156 A1

A A A A

4,086,634 A

Jul. 11, 2003

(65)

3,805,238 3,805,286 3,809,806 3,838,444

US 6,987,862 B2

10/1978 Sordello et al. ..

4,184,700

A

1/1980

Greenaway

. ... .. .

4,225,967

A

9/1980

MiWa et al.

......

4,230,990 A

350/320

10/1980 Lert, Jr. etal.

360/51 . . . . ..

283/6

. . . .. 455/68

455/67

(Continued)

Related US. Application Data

FOREIGN PATENT DOCUMENTS

(60) Division of application No. 09/872,199, ?led on May 31, 2001, noW Pat. No. 6,675,146, Which is a con

tinuation of application No. 09/520,406, ?led on Mar. 8, 2000, noW Pat. No. 6,266,430, Which is a division

DE

2943436 A1

5/1981

(Continued)

of application No. 09/338,995, ?led on Jun. 24, 1999, noW Pat. No. 6,404,898, Which is a division of

OTHER PUBLICATIONS

application No. 08/951,858, ?led on Oct. 16, 1997,

Andersen, R., “Stretching the Limits of Steganography,”

noW Pat. No. 6,026,193, Which is a continuation of

Cambridge University, May 30, 1990.

application No. 08/436,134, ?led on May 8, 1995,

(Continued)

noW Pat. No. 5,748,763, Which is a continuation-in

part of application No. 08/327,426, ?led on Oct. 21, 1994, noW Pat. No. 5,768,426, Which is a continua

tion-in-part of application No. 08/215,289, ?led on Mar. 17, 1994, noW abandoned, Which is a continu

ation-in-part of application No. 08/154,866, ?led on

Primary Examiner—AndreW W. Johns

(74) Attorney, Agent, or Firm—Digimarc Corporation (57)

ABSTRACT

Nov. 18, 1993, noW abandoned.

An input content signal, e.g., representing video, is encoded to hide plural-bit auxiliary data therein. The process gener

(51) Int. Cl. H04K 1/00 (52) (58)

(2006.01)

ates an intermediate signal that is a function of (a) the

US. Cl. ..................... .. 382/100; 348/463; 348/473 Field of Classi?cation Search .............. .. 382/100,

plural-bit auxiliary data, and (b) data related to human

382/232; 380/201, 203, 210, 287; 348/460, 348/461, 463, 473 See application ?le for complete search history.

perception attributes of the content signal. This intermediate signal is then summed With the content signal to effect encoding. The plural-bit auxiliary data can include copy control data, i.e., data that can be sensed by a consumer electronic device and used to disable a copying operation.

References Cited

The intermediate signal may include a pseudo-random key signal so as to obscure the encoding and require knoWledge

U.S. PATENT DOCUMENTS

of a corresponding key at the decoder to extract the auxiliary data from the encoded content. In some embodiments, calibration data is encoded in the content signal With the

(56)

2,630,525 A 2,881,244 A

3/1953 Tomberlin et al. ........... .. 250/6 4/1959 Pawley et al. ............. .. 178/5.1

3,004,104 A

10/1961

3,406,344 A

10/1968 Hopper ...... ..

Hembrooke ................. .. 179/2

325/50

3,493,674 A

2/1970 Houghton

.. 178/5.6

3,562,420 A

2/1971 Thompson

178/6

3,569,619 A

3/1971 Simjian .................... .. 178/6.8

3,576,369 A

4/1971 Wick ......................... .. 355/77

3,583,237 A

6/1971 Bayha

3,585,290 A

6/1971

3,638,188 A 3,665,162 A

1/1972 Pincoffs et al. 5/1972 Yamamoto et al.

3,703,628 A

73/432

Sanford .................... .. 178/5.6

340/146.3 AC 235/61.7 B

11/1972 Philipson, Jr. ....... .. 235/61.9 R

auxiliary data. This calibration data desirably has knoWn

properties (e.g., spectral attributes, data content, etc.) facili tating its identi?cation in the encoded content signal. The encoding is desirably robust against various forms of content

degradation, e.g., lossy compression/decompression, scal ing, resampling, conversion from digital to analog and back again, etc., so that the auxiliary data can be detected from the

content notwithstanding such corruption. 32 Claims, 21 Drawing Sheets

US 6,987,862 B2 Page 2 US. PATENT DOCUMENTS

4,876,617 A

10/1989 Best et al. .................. .. 360/60

11/1989 Leighton et al. 11/1989 Pommier

.. 380/23 ~358/142

12/1989 12/1989 2/1990 3/1990

" 358/84 __ 375/96 __ 381/30 375/1

4,231,113 A

10/1980 Blasbalg .................... .. 455/29

4,879,747 A 4,884,139 A

4,237,484 4,238,849 4,245,346 4,252,995

A A A A

12/1980 12/1980 1/1981 2/1981

Brown et al. .. . 358/142 Gassmann .. 370/11 Grady et al. ................ .. 455/28 Schmidt et al. ........ .. 179/1 GD

4,885,632 4,885,757 4,903,301 4,908,836

4,262,329 A 4,307,899 A

4/1981 12/1981

364/200 283/7

4,908,873 A 4,914,700 A

3/1990 Philibert et al. 4/1990 Alasia

4,310,180 A

1/1982

. 283/8 B

4,918,484 A

4/1990

.. 355/41

4,313,197 A

1/1982 MaXemchuk

370/111

4,920,503 A

4/1990

. 364/521

4,323,921 A

4/1982 Guillou .... ..

358/114

4,921,278 A

5/1990

.. 283/87

4,333,113 A 4,337,483 A

6/1982 Kalinowski . 6/1982 Guillou .... ..

360/27 358/114

4,939,515 A 4,941,150 A

7/1990 7/1990 IWasaki

.. 341/51 375/1

.

A A A A

Mabey et aL Provence Kondo et a1_ Rushforth et a1, _

4,351,547 A

9/1982 Brooks, 11 ...... ..

283/8 R

4,943,973 A

7/1990 Werner .

4,367,488 A

1/1983 LeVenter et al.

358/147

4,943,976 A

7/1990 Ishigaki

4,379,947 A

4/1983 Warner ........... ..

. 179/1 GD

4,944,036 A

7/1990 Hyatt

4,380,027 A

4/1983 Leventer et al. ..

4,945,412 A

7/1990 Kramer

4,389,671

6/1983

4,949,381

8/1990

A

4,395,600 A

Posner et al.

.....

7/1983 Lundy et al. ..

4,416,001 A

11/1983 Ackerman ..

4,423,415 A

12/1983 Goldman

358/147 . . . . . .. 358/124

A

Pastor

10/1990 Maufe ..

380/51

4,963,998 A

.. 369/44

4,965,680 A

10/1990

340/825.34

4,965,827 A

10/1990 McDonald

.. 380/25 . 358/142

Endoh ..

1/1984 Moses et al. ..

.... .. 370/76

4,967,273 A

10/1990

........ .. 375/1

4,969,041 A

11/1990 O’Grady et al.

340/825.034

4,972,471 A

11/1990 Gross et al.

4,972,475

11/1990

.........

..

179/1.5 M

1/1984 Moses et al. .. Jauch

375/1 . 358/142

..

4,425,642 A

10/1984 Goldman

. 375/1 .. 367/43

4,425,661 A

4,476,468 A

.. 382/34 .. 380/54

. . . ..

283/94

A

Greenberg ..

4,504,084 A

3/1985

Sant’Anselmo

4,512,013 A

4/1985 Nash et al.

370/69.1

4,972,476 A

11/1990 Nathans

4,523,311 A

6/1985 Lee et al.

370/69.1

4,979,210 A

12/1990 Nagata et al. 12/1990 Ginkel ........ .. 2/1991 Piosenka et al. 2/1991 Hilton ......... ..

.. 360/60 .. 360/60

358/142

380/3 ..

380/54

.. 380/23

380/3

4,528,588 A 4,532,508 A 4,547,804 A

7/1985 Lofberg 7/1985 Ruell ....... .. 10/1985 Greenberg

358/122 340/825.34 358/142

4,980,782 A 4,993,068 A 4,996,530 A

4,553,261 A

11/1985 Froessl ..... ..

.. 382/57

5,003,590 A

3/1991

Lechner et al. .

380/5

235/494 . 370/110.1

5,010,405 A 5,018,767 A

4/1991 Schreiber et al. 5/1991 Wicker

358/141 .. 283/67

4,590,366 A 4,593,389 A

5/1986 Rothfjell ...... .. 6/1986 WurZburg et al.

4,595,950 4,637,051 4,639,779 4,644,422 4,644,582 4,647,974 4,654,867 4,660,221 4,663,518 4,665,431 4,672,605

6/1986 1/1987 1/1987 2/1987 2/1987 3/1987 3/1987 4/1987 5/1987 5/1987 6/1987

A A A A A A A A A A A

Lofberg .................... .. 358/122 Clark .......................... .. 382/1 Greenberg .. . 358/142 Bedini ....................... .. 360/60 Morishita et al. ............ .. 382/6 Butler et al. .... .. . 358/185 LabedZ et al. .............. .. 379/59 Dlugos ...................... .. 380/23 Borror et al. . 235/487 Cooper ..................... .. 358/145 Hustig et al. ............... .. 370/76

5,027,401 5,034,982 5,036,513 5,040,059 5,063,446 5,073,899 5,073,925 5,075,773 5,077,608 5,077,795 5,079,648

A A A A A A A A A A A

6/1991 7/1991 7/1991 8/1991 11/1991 12/1991 12/1991 12/1991 12/1991 12/1991 1/1992

.. 360/60 .. 380/23 . 341/120

SoltesZ ...................... .. 380/54 Heninger et al. ........... .. 380/54 Greenblatt .. . 370/125 Leberl ...................... .. 358/107 Gibson ..................... .. 358/142 Collier et al. 375/1 Nagata et al. ............... .. 380/3 Pullen et al. ............. .. 358/141 Dubner ..... .. . 358/183 Rourke et al. .............. .. 380/55 Maufe ....................... .. 360/31

4,675,746 A

6/1987 Tetrick et al. ............ .. 358/296

5,083,224 A

1/1992 Hoogendoorn et al.

4,677,435 A

6/1987 Causse D’Agraives

5,083,310 A

1/1992 Drory ........................ .. 381/30

5,087,507 A

2/1992

4,677,466 A

6/1987 Lert, Jr. et al.

....... .. 358/84

5,091,966 A

2/1992 Bloomberg et al.

4,678,322 A 4,682,794 A

7/1987 Finkel et al. ............. .. 358/133 7/1987 Margolin ................... .. 283/82

5,093,867 A 5,095,196 A

3/1992 Hori et al. ................... .. 362/8 3/1992 Miyata ..................... .. 235/382

9/1987 Kiewit et al.

358/84

5,103,459 A

4/1992 Gilhousen et a1

10/1987 Howard ..................... .. 370/76 12/1987 Gotanda .............. .. 340/825.31

5,113,437 A 5,128,525 A

5/1992 Best et al. ................... .. 380/3 7/1992 Stearns et al. ............ .. 235/454

et al. ................... .. 340/825.31

4,697,209 A 4,703,476 A 4,712,103 A

.. 360/60

HeinZer .................... .. 428/195

.. 382/21

375/1

4,718,106 A

1/1988 Weinblatt

..... .. 455/2

5,134,496 A

7/1992 SchWab et al. .

4,723,149 A 4,739,377 A

2/1988 Harada ................... .. 355/14 R 4/1988 Allen ....................... .. 358/133

5,136,436 A 5,144,658 A

8/1992 Kahlman ................... .. 360/40 9/1992 Takahashi .................... .. 380/3

4,750,173 A

6/1988 Bluthgen

5,144,660 A

9/1992 Rose ........ ..

4,765,656 4,776,013 4,777,529 4,791,449 4,805,020

A A A A A

8/1988 10/1988 10/1988 12/1988 2/1989

. 370/111

Becker et al. .............. .. 283/70 Kafri et al. ................. .. 380/54 SchultZ et al. . 358/143 Foley et al. .............. .. 355/3 R Greenberg ................ .. 358/147

5,146,457 5,148,498 5,150,409 5,157,726 5,161,210

A A A A A

9/1992 9/1992 9/1992 10/1992 11/1992

358/335

380/4

Veldhuis et al. .......... .. 370/111 Resnikoff et al. ........... .. 382/54 Elsner ......... .. .. 380/23 Merkle et al. .............. .. 380/23 Druyvesteyn et al. ....... .. 395/2

4,807,031 A

2/1989 Broughton et al.

. 358/142

5,166,676 A

11/1992 Milheiser ..... ..

4,811,357 A 4,811,408 A

3/1989 Betts et al. .................. .. 375/1 3/1989 Goldman ..................... .. 382/2

5,168,147 A 5,181,786 A

12/1992 Bloomberg ............... .. 235/456 1/1993 Hujink ...................... .. 400/61

340/825.54

4,820,912 A 4,835,517 A

4/1989 Samyn ..................... .. 235/449 5/1989 van der Gracht

5,185,736 A 5,193,853 A

2/1993 Tyrrell et al. .. 370/55 3/1993 Wicker ...................... .. 283/85

et al. .................... .. 340/310 A

5,199,081 A

3/1993

4,855,827 A 4,864,618 A

8/1989 Best ......... .. 358/143 9/1989 Wright et al. ............... .. 380/51

5,200,822 A 5,208,630 A

4/1993 Bron?n et al. .. 358/142 5/1993 Goodbrand et al. ...... .. 355/201

4,866,771 A 4,874,936 A

9/1989 Bain ......................... .. 380/23 10/1989 Chandler et al. ......... .. 235/494

5,212,551 A 5,213,337 A

5/1993 5/1993

Saito et al. .................. .. 382/2

Conanan ................... .. 358/143 Sherman ................... .. 273/439

US 6,987,862 B2 Page 3 5,216,724 A

6/1993 Suzuki et al. ................ .. 382/7

5,432,870 A

7/1995

5,221,833 A

6/1993 Hecht ....... ..

. 235/494

5,434,649 A

7/1995 Hasuo et al.

5,228,056 A

7/1993 Schilling

. 375/1

5,436,653 A

7/1995 Ellis etal.

5,231,663 A

7/1993 Earl et al. .... ..

380/18

5,437,897 A

8/1995 Tanaka et al.

5,243,411 A

9/1993 Shirochietal. ..

5,243,423 A

9/1993 DeJean et al.

5,245,165 A

9/1993 Zhang ...... ..

5,245,329 A

9/1993 Gokcebay

Schwartz .................. .. 382/232

358/12

5,444,779 A

8/1995 Daniele

358/142

5,446,273 A

8/1995 Leslie ..

355/201

348/2 428/29

380/3 . 235/487

235/454

5,446,488 A

8/1995 Vogel

340/825.31

5,449,895 A

9/1995 Hecht et al.

235/494

348/3

.. . 358/191.1 358/426

5,449,896 A 5,450,122 A

9/1995 Hecht et al. . 9/1995 Keene ...... ..

235/494 348/1

5,247,364 A 5,253,078 A

9/1993 Banker et al. 10/1993 Balkanski et al.

5,254,196 A 5,257,119 A

10/1993 Abowitz et al. 10/1993 Funada et al.

156/235 358/438

5,450,489 A 5,450,490 A

9/1995 Ostrover et al. 9/1995 Jensen et al.

5,258,998 A 5,259,025 A

11/1993 Koide ......... .. 11/1993 Monroe et al.

375/7 380/23

5,453,968 A 5,459,583 A

9/1995 Veldhuis et al. 10/1995 Nakata ........ ..

358/142

5,461,426 A

10/1995 Limberg et al.

382/56 . 235/494

5,469,222 A 5,469,506 A

11/1995 Sprague ....... .. 11/1995 Berson et al.

. 348/580 .. 380/23

. 375/202

5,262,860 A

11/1993 Fitzpatrick et al. ..

5,267,334 A 5,278,400 A

11/1993 Normille et al. .. 1/1994 Appel ............ ..

380/3 380/6 .. 369/84 . 358/335

348/475

5,280,537 A

1/1994 Sugiyama et al.

375/1

5,473,631 A

12/1995 Moses

5,285,498 A 5,287,407 A

2/1994 Johnston ...... .. 2/1994 Holmes ....... ..

. 381/2 380/4

5,479,168 A 5,481,294 A

12/1995 Johnson et al 1/1996 Thomas et al. .

341/110 348/1

5,291,243 A 5,293,399 A 5,295,203 A

3/1994 Heckman et al. . 3/1994 Hefti ........... .. 3/1994 Krause et al. .

. 355/201 375/7 382/56

5,481,334 A 5,481,377 A 5,483,276 A

1/1996 Arimoto et al. 1/1996 UdagaWa et al. 1/1996 Brooks et al. ..

355/201 358/501 348/2

5,299,019 A 5,301,257 A

3/1994 Pack et al. .. 4/1994 Tani ......... ..

. 358/261.3 .. 395/11

5,488,664 A 5,495,282 A

1/1996 Shamir 2/1996 Mostafa etal

5,305,400 A

4/1994

.. 382/56

5,495,581 A

2/1996

Tsai ...... ..

. 395/154

5,315,448 A

5/1994 Ryan ........... ..

.. 360/60

5,499,294 A

3/1996

Friedman

.. 380/10

5,319,453 A

6/1994 Copriviza et al.

348/6

5,500,856 A

3/1996 Nagase et al.

5,319,475 A 5,319,724 A

6/1994 Kay et al. .......... .. 6/1994 Blonstein et al. .

359/2 .... .. 382/56

5,504,518 A 5,510,900 A

4/1996 Ellis etal. .... .. 4/1996 Shirochi et al.

348/2 358/335

5,319,735 A

6/1994 Preuss et al.

395/2.14

5,513,011 A

4/1996 Matsumoto et al.

358/341

5,321,470 A 5,321,773 A 5,325,167 A

6/1994 Hasuo et al. 6/1994 Kopec et al. .. 6/1994 Melen ......... ..

355/201 382/30 .. 356/71

5,513,260 A 5,515,081 A 5,515,451 A

4/1996 Ryan ........ .. 5/1996 Vasilik 5/1996 Tsuji et al.

5,327,237 A 5,335,277 A

7/1994 Gerdes et al. ............ .. 348/476 8/1994 Harvey et al. .............. .. 380/20

5,521,372 A 5,523,853 A

5/1996 Hecht et al. .............. .. 235/494 6/1996 Yamashita et al. ........ .. 358/335

5,335,312 A

8/1994 Meketa et al.

395/2.11

5,524,933 A

6/1996 Kunt et al.

5,337,361 A 5,337,362 A

8/1994 Wang et al. ................ .. 380/51 8/1994 Gormish et al. ............ .. 380/54

5,526,427 A 5,530,655 A

6/1996 Thomas et al. ............. .. 380/20 6/1996 Lokhoff et al. ....... .. 364/514 A

5,349,655 A 5,351,302 A

9/1994 Mann ............. .. .395/575 9/1994 Leighton et al. ............ .. 380/30

5,530,751 A 5,530,759 A

6/1996 Morris 380/4 6/1996 Braudaway et al. ........ .. 380/54

5,532,920 5,537,216 5,537,223 5,539,471 5,539,735 5,541,662 5,541,741

7/1996 7/1996 7/1996 7/1996 7/1996 7/1996 7/1996

5,365,586 5,369,261 5,371,792 5,374,976 5,375,886 5,379,093 5,379,345

A A A A A A A

11/1994 11/1994 12/1994 12/1994 12/1994 1/1995 1/1995

Butera ..

.. 380/54 348/5

Indeck et al. ................ .. 380/3 Shamir ........ .. . 235/469 Asaietal. ................... .. 380/3 Spannenburg ............ .. 355/201 Tsuchiya ........ .. .. 283/93 Hashimoto et al. ....... .. 355/201 Greenberg ................. .. 380/23

A A A A A A A

.. 370/18

380/3 . 345/189 382/135

.. 283/67

Hartrick et al. ........ .. 364/419.1 Yamashita et al 358/335 Curry ....................... .. 358/460 Myhrvold et al. ........ .. 348/473 MoskoWitz .. 370/60 Adams et al. ............ .. 348/460 Suzuki ..................... .. 358/450

5,387,941 A

2/1995 Montgomery et al.

348/473

5,544,255 A

8/1996 Smithies et al.

5,390,003 A 5,390,185 A

2/1995 Yamaguchi et al. ...... .. 355/201 2/1995 Hooijmans et al. ......... .. 370/98

5,548,646 A 5,557,333 A

8/1996 Aziz et al. .................. .. 380/23 9/1996 Jungo et al. .............. .. 348/473

5,390,259 A

2/1995 Withgott et al. ..

5,394,274 5,396,559 5,398,283 5,404,160 5,404,377

2/1995 3/1995 3/1995 4/1995 4/1995

A A A A A

382/9

Kahn ........................ .. 360/27 McGreW .................... .. 380/54 Virga ....... .. .. 380/18 SChOber et al. .............. .. 348/1 Moses ...................... .. 375/200

A A A A A

9/1996 Jungo et al. . 10/1996 10/1996 10/1996 11/1996 11/1996

348/432

Diehletal. .................. .. 348/6 Tsuji et al. ............... .. 358/296 Rabbani .. . 382/238 Petrie ....................... .. 235/494 Ellis et al. ................... .. 348/2

5,408,258 A

4/1995 Kolessar

5,572,247 A

11/1996 Montgomery et al.

5,408,505 5,408,542 5,410,598 5,412,718 5,412,731 5,418,853 5,422,963 5,422,995

A A A A A A A A

4/1995 4/1995 4/1995 5/1995 5/1995 5/1995 6/1995 6/1995

Indeck et al. ................ .. 380/4 Callahan .................... .. 382/56 Shear ............. .. 380/4 Narasimhalu et al. ....... .. 380/4 Desper ........................ .. 381/1 Kanota et al. . 380/5 Chen et al. ............... .. 382/232 Aoki et al. ............... .. 395/162

5,574,787 5,576,532 5,579,124 5,581,658 5,581,800 5,582,103 5,583,614 5,587,743

A A A A A A A A

11/1996 11/1996 11/1996 12/1996 12/1996 12/1996 12/1996 12/1996

Ryan ........................... .. 380/5 Hecht ....................... .. 235/494 Aijala et al. . .. 386/96 O’Hagan et al. ........... .. 395/22 Fardeau et al. .............. .. 455/2 Tanaka et al. .. .. 101/32 Hasuo et al. ............. .. 355/201 Montgomery et al. .... .. 348/473

5,424,807 A

6/1995

Ohmura ....... ..

5,590,197 A

12/1996

Chen et al. ...... ..

5,425,100 5,426,710 5,428,598 5,428,606 5,428,607 5,432,542

6/1995 6/1995 6/1995 6/1995 6/1995 7/1995

Thomas et al. ............. .. 380/20 Suzuki et al. ............. .. 382/135 Veldhuis et al. . 369/275.3 MoskoWitz ................ .. 370/60 Hiller et al. ................ .. 370/60 Thibadeau et al. .......... .. 348/6

A A A A A A

. 348/5.5

5,559,559 A 5,568,179 5,568,268 5,568,570 5,572,010 5,572,246

382/119

. 355/201

5,602,920 5,606,609 5,611,575 5,612,943 5,613,004 5,613,012

A A A A A A

2/1997 2/1997 3/1997 3/1997 3/1997 3/1997

348/10

.. 380/24

Bestler et al. .............. .. 380/49 Houser et al. ............... .. 380/4 Petrie ....... .. .. 283/67 Moses et al. ............. .. 369/124 Cooperman et al. ........ .. 380/28 Hoffman et al. .......... .. 382/115

US 6,987,862 B2 Page 4 5,614,940 A 5,617,119 A 5,617,148 A

3/ 1997 Cobbley et al. ............. .. 348/7 4/1997 Briggs et al. . 345/611

5,627,655 A

5/1997 Okamoto et al. .

5,629,770 5,629,980 5,636,292 5,638,443

5/1997 5/1997 6/1997 6/1997

A A A A

4/1997 Montgomery ..

FOREIGN PATENT DOCUMENTS

. 348/473

DE

3806411 A1

9/1989

.... .. 386/94

EP

0058482 A1

8/1982

Brassil et al. .......... .. 358/261.1 Ste?k et al. ................. .. 380/4 Rhoads ..................... .. 382/232 Ste?k et al. ................. .. 380/4

EP EP EP EP

0366381 0411232 0418964 0441702

5/1990 2/1991 3/1991 8/1991

A2 A2 A1 A1

5,638,446 A

6/1997 Rubin

.. 380/25

EP

0551016 A1

7/1993

5,646,997 A 5,649,054 A 5,652,626 A

7/1997 Barton ...................... .. 380/23 7/1997 oornen et al. ........... .. 395/238 7/1997 Kawakami et al. ....... .. 348/463

EP EP EP

0565947 A1 0605208 A2 0618723 A1

10/1993 7/1994 10/1994

15133;‘

5,659,726 A

8/1997 Sandford, 11 et al. ..... .. 395/612

511;

82423323 g

5,661,574 A

8/1997 Kawana .......... ..

358/501

EP

0649074 A1

4/1995

5,663,766 A

9/1997 S1Z~er,II

348/473

EP

0650146 A1

4/1995

5,664,018 A

9/1997

5,666,487 A

9/1997 Goodman et al.

5,671,277 A 5,689,623 A

Leighton

.......

. . . ..

380/54

EP

0651554 A1

5/1995

395/200.76

EP

0705025 A2

4/1996

9/1997 Ikenoue et al. .............. .. 380/7 11/1997 Pinard ......... .. .395/106

EP GB

0690595 B1 2063018 A

2/1999 5/1981

5,709,932 A

1/1998 Glez et al. ..

428/220

GB

2067871 A

7/1981

5,710,834 A

1/1998 Rhoads ..... ..

. 382/232

GB

2104701 A

3/1983

5,712,920 5,719,984 5,721,788 5,727,092 5,731,880 5,737,025 5,739,864 5,745,604 5,748,763

1/1998 2/1998 2/1998 3/1998 3/1998 4/1998 4/1998 4/1998 5/1998

A A A A A A A A A

Spille ....................... .. 381/104 Yamagata et al. .......... .. 386/95 Powell et al. ...... .. 382/100 Sandford, 11 et al. ..... .. 382/251 Takaragi et al. .......... .. 358/296 Dougherty et al. ....... .. 348/473 Copeland .................. .. 348/473 Rhoads ..................... .. 382/232 Rhoads ..................... .. 382/115

GB GB JP JP W0 W0 W0 W0 W0

WO W0 WO WO WO

2196167 2204984 4-248771 5242217 89/08915 92/19073 93/25038 95/10835 95/14289

A A A A A1 A1 A1 A1 A2

4/1988 11/1988 9/1992 9/1993 9/1989 10/1992 12/1993 4/1995 5/1995

5,748,783 A

5/1998 Rhoads ..... ..

. 382/232

W0

WO 95/20291 A1

7/1995

5,764,763 A

6/1998 Jensen etal. ..

380/6

5 765 152 A

6/1998 Erickson

707/9

W0 W0

WO 96/26494 A1 WO 96/27259 A1

8/1996 9/1996

7 7 5,768,426 A

W0

W0 97/02522 A1

1/1997

6/1998 Rhoads ..................... .. 382/232

5,774,452 A

6/1998 Wolosewicz .............. .. 370/212

5,778,102 A

7/1998

5,790,932 A

8/1998 Komaki et aL

399/366

9/1998 Powell et al. ..

382/100

5,809,160 A

5,832,119 5,841,886 5,841,978 5,845,008 5,845,281 5,850,481 5,857,038

A A A A A A A

11/1998 11/1998 11/1998 12/1998 12/1998 12/1998 1/1999

Sandford, II et al.

OTHER PUBLICATIONS

382/251

Rhoads ..................... .. 382/232 Rhoads ..................... .. 382/115 Rhoads ................ .. 395/200.47 Katoh et al. .............. .. 382/217 Benson et al. . 707/9 Rhoads ..................... .. 382/232 Owada et al. ............ .. 382/284

_

“

_

_

1,

Arachellan, White Noise Storm, Apr. 11, 1994, Internet Mani/n99 13 P218915;

_

_

AIaZl, et 91» “Intllltlon, Percep?on, and Secure Commllnlca IiOH,” IEEE Transactions on Systems, Man, and Cybernet ies, vol 19, NO- 5, Sen/Oct. 1989, PP- 1016-1020 Arthur, “Digital Fingerprints Protect Artwork,” NeW Scientist, Nov. 12, 1994, p. 24. Aura, “Invisible Communication,” Helskinki University of Technology, Digital Systems Laboratory, NOV_ 5, 1995, 13

5,862,260 A

1/1999 Rhoads ..................... .. 382/232

pages

5,872,589 A

2/1999 Morales ..................... .. 348/13

Bender et a1” “Techniques for Data Hiding,” Massachusetts

2 a

a

gfilogh ct a1~ -

-

Institute of Technology, Media Laboratory, Draft Preprint,

{ma ~~~~~~ ~~

~~

Apr. 13, 1995, 10 pages.

5910987 A

6/1999 G1nter_et a1‘ "

5,943,422 A

8/1999 Van Wle et al. .............. .. 380/9

2 5:982:977 A

gighits?' """""""" " 11/1999 Naruse ?ail“; 386/64

5,991,500 A

11/1999

Kanota et al.

380/24

.

386/94

Bender, Techniques for Data Hiding, Proc. SPIE, V0. 2420, Feb' 9, 1995, pp‘ 164473

Blankenhorn, D., “NAB—Cyphertech Starts Anti-Piracy Broadcast Tests,” Newsbytes, NEW03230023, Mar. 23, 1994'

“

.

.

.

.

6,026,193 A

2/2000 Rhoads ..................... .. 382/232

Boland,“ a1’ Wmmarkmg Dlgltal Images for Copynght

6,086,706 A

7/2000 Brassil et al. ............. .. 156/277

Mote/C9093 Fl?h lntefnallonal Conference on Image

67111954 A 6,112,008 A

53/2000 Rhoads ________ __ __ 380/54 8/2000 Sugita et al. ............... .. 386/94

Processing and its Applications, Conference Date Jul. 4-6, 1995, Conf. Publ. No. 410, p. 326-330.

6,341,195 B1 6,430,302 B2 6,433,946 B2

1/2002 MankovitZ et al. ......... .. 386/83 8/2002 Rheads -------- --382/100 8/2002 Ogino ....................... .. 360/60

Boneh, “Collusion-Secure Fingerprinting for Digital Data,” Department of Computer Science, Princeton University, 1995, 31 pages

illllglyciima et a1‘ """""

2001/0042043 A1

11/2001 slrsaar

..........

Boney et al., Digital Watermarks for Audio Signals,

705/51

Proceedmgs of Mulnmedla 196’ 1996

pp‘ 473'480'

2002/0034032 A1 2002/0054356 A1

3/2002 Sugiyama et al. .......... .. 360/69 5/2002 Kurita et al. 358/3.28

Bouc‘lueau et a1; Equltable Condmonal Access aPd copynght Protectlon for Image Based on Trusted Thlrd

2002/0090114 A1 2004/0240846 A1

7/2002 Rhoads et al. ............ .. 382/100 12/2004 Cookson et al. ............ .. 386/94

Parties, Teleservices & Multimedia Communications, 2nd Int. Cost 237 Workshop, Second International Cost 237

2005/0024536 A1

2/2005 Cookson et al. .......... .. 348/473

Workshop, Nov., 1995; published 1996, pp. 229-243.

US 6,987,862 B2 Page 5 Brassil et a1., “Hiding Information in Document Images,” Nov., 1995, 7 pages. Brassil et a1., “Electronic Marking and Identi?cation Techniques to Discourage Document Copying,” Proceed ings ofINFOCOM ’94 Conference on Computers, pp. 1278 1287, Jun. 12-16, 1994 (presented at IEEE Communications

Fitzgerald, “Invisible Digital Copyright ID,” Editor & Publisher, Jun. 25, 1994, p. 62. FranZ et a1., “Computer Based Steganography: HoW It Works and Why Therefore Any Restrictions on Cryptography are Nonsense, at Best,” Information Hiding,

First Int. Workshop Proc, May 30-Jun. 1, 1996, pp. 7-21, (a

Society Conference).

counterpart Was published in German by Steffen Moller et al

BroWn, “S-Tools for WindoWs, Version 1.00; What is Steganography,” Internet reference, Mar. 6, 1994, 6 pages.

in 1994). Frequently Asked Questions About Digimarc Signature Technology, Aug. 1, 1995, http://WWW.digimarc.com, 9

Bruckstein, A.M.; Richardson, T.J., A holographic transform domain image Watermarking method, Circuits, Systems, and

pages.

Signal Processing vol. 17, No. 3 p. 361-89, 1998. This paper

Friedman, “The TrustWorthy Digital Camera: Restoring

includes an appendix containing an internal memo of Bell Labs, Which according to the authors of the paper, Was dated

Sep. 1994. BruyndonckX et a1., “Spatial Method for Copyright Labeling of Digital Images,” preprint dated 1994; published in IEEE Workshop on Nonlinear Images/Signal Processing, Thes saloniki, Greece, Jun. 1995, Proceedings, pp. 456-459. BruyndonckX et a1., “Neural Network Post-Processing of

Coded Images Using Perceptual Masking,” Proceedings of

Credibility to the Photographic Image,” IEEE Transactions on Consumer Electronics, vol. 39 No. 4 pp. 905-910, Nov. 1993.

Gabor, et a1., “Theory of Communication,” J. Inst. Elect. Eng. 93, 1946, pp. 429-441. GerZon, M.A., et al, “A High-Rate Buried-Data Channel for Audio CD,” Journal of the Audio Engineering Society, vol. 43, No. 1-2, p. 3-22, Jan-Feb, 1995. Hartung et a1., Digital Watermarking of RaW and

IEEE Workshop on Nonlinear Images/Signal Processing (Thessaloniki, Greece), pp. 456-459, Jun. 1995 (preprint c.

Compressed Video, Proc. SPIE 2952, Digital Compression Technologies and Systems for Video Communications, Oct.,

1994).

Hecht, “Embedded Data Glyph Technology for Hardcopy

Burgett et al., “A Novel Method for Copyright Labeling

DigitiZed Image Data,” requested by e-mail from author (unavailable/passWord protected on IGD WWW site); received Sep. 18, 1995, 12 pages.

Caronni, “Assuring OWnership Rights for Digital Images,” Published in the Proceedings of ‘Reliable IT Systems,’ VIS

’95, HH. Briiggemann and W. Gerhardt-Hackl (Ed.), VieWeg Publishing Company, Germany, 1995, Jun. 14, 1994, 10

1996, pp. 205-213.

Digital Documents,” SPIE vol. 2171, Feb. 1994, pp. 341 352.

HighWater FBI Ltd., “Copyright Protection for Digital Im

ages, Digital Fingerprinting from FBI,” brochure (4 pages), 1995.

Hollywood Reporter, “Cyphertech Systems: Introduces Digital Encoding Device to Prevent TV Piracy,” p. 23, Oct. 20, 1993.

pages. (Originally published as an ETH (Zurich) Technical

“Holographic signatures for digital images,” The Seybold

Report,

Report on Desktop Publishing, Aug. 1995, one page.

“Ermitteln

Unauthorisierter

Verteiler

von

Maschinenlesbaren Daten,” Aug. 1993. Caruso, “Digital Commerce, 2 plans for Watermarks, Which

Humphrey, “Stamping Out Crime,” Hollywood Reporter, p.

can bind proof of authorship to electronic Works.” NeW York

Jain, “Image Coding Via a Nearest Neighbors Image Model,

Times, Aug. 7, 1995, one page. Castro et a1., “Registration of Translated and Rotated Images

” IEEE Transactions on Communications, vol. COM-23,

Using Finite Fourier Transforms,” IEEE Transactions on

Johhnson, “Steganography,” Dec. 10, 1995, 32 pages.

Pattern Analysis and Machine Intelligence, vol. PAMI-9, No. 5, Sep. 1987, pp. 700-703. Choudhury et al., “Copyright Protection for Electronic Publishing over Computer NetWorks,” IEEE Network

Magazine (18 pages), Jun. 1994.

S48, Jan. 26, 1994. No. 3, Mar. 1975, pp. 318-331.

JPEG Group’s JPEG SoftWare (release 4), ftp.csua.

berekeley.edu/pub/cypherpunks/applications/jsteg/jpeg.an nouncement.gZ, Jun. 7, 1993, 2 pages.

Kassam, “Elements of Statistical Hypothesis Testing/Signal Detection in Non-Gaussian Noise,” Dowden & Culver, pp. 1-96, 1988.

Clarke, “Invisible Code Tags Electronic Images,” Electronic Engineering Times, Jun. 12, 1995, n. 852, p. 42. CoX et a1., “Secure Spread Spectrum Watermarking for Multimedia,” NEC Research Institute Technical Report, Dec. 5, 1995, 33 pages. CoX et al., “A Secure, Imperceptable Yet Perceptually

Electronic Publishing, Dec. 6-8, 1994, Leeds, UK, 15

Salient, Spread Spectrum Watermark for Multimedia,”

pages.

IEEE, Southcon/96, Conference Record, pp. 192-197, 1996.

Koch et a1., “ToWards Robust and Hidden Image Copyright Labeling,” Proc. of 22995 IEEE Workshop on Nonlinear

Cyphertech Systems, Inc., “Broadcast Monitoring Technol ogy,” Promotional Brochure, Nov. 1992 (4 pages). DautZenberg, “Watermarking Images,” Department of Microelectronics and Electrical Engineering, Trinity Col lege Dublin, 47 pages, Oct. 1994. Delaigle et al., “A Psychovisual Approach for Digital Picture Watermarking,” preprint dated 1995, 20 pages, published in Journal of Electronic Imaging, vol. 7, No. 3, Jul. 1998, pp. 628-640.

Digimarc presentation at RSA Conference, approximately Jan. 17, 1996, 4 pages.

Kassam, Signal Detection in Non-Gaussian Noise, DoWden & Culver, 1988, pp. 1-96. Koch et al., “Copyright Protection for Multimedia Data,” Proc. of the International Conference on Digital Media and

Signal and Image Processing, Jun. 20-22, 1995, 4 pages. Koch et a1., “Digital Copyright Labeling: Providing Evidence of Misuse and Tracking UnauthoriZed Distribution

of Copyrighted Materials,” Oasis MagaZine, Dec. 1995, 3 pages.

Komatsu et a1., “Authentication System Using Concealed Image in Telematics,” Memoirs of the School of Science & Engineering, Waseda Univ., No. 52, 1988, pp. 45-60. Komatsu et al., “A Proposal on Digital Watermark in Docu ment Image Communication and Its Application to Real

US 6,987,862 B2 Page 6 iZing a Signature,” Electronics and Communications in Japan, Part I, vol. 73, No. 5, 1990, pp. 22-23. Kurak et al., “A Cautionary Note On Image Downgrading,” Nov. 30, 1992 IEEE, pp. 153-159.

Luc, “Analysis of Spread Spectrum System Parameters for Design of Hidden Transmission,” Radioengineering, vol. 4, No. 2, Jun. 1995, pp. 26-29.

Machado,

“Announcing

Stego

1.0a2,

The

First

Steganography Tool for the Macintosh,” Internet reference, Nov. 28, 1993, 3 pages.

Macq, “Cryptology for Digital TV Broadcasting,” Proceed ings of the IEEE, vol. 83, No. 6, Jun. 1995, pp. 944-957. MattheWs, “When Seeing is Not Believing,” New Scientist, pp. 13-15, Oct. 16, 1993. Moller, et al., “RechnergestutZte Steganographie: Wie sie Funktioniert und Warum folglich jede Reglementierung von

Verschlusselung unsinnig ist,” (With English abstract),

New Technologies, R. Oldenbourg Verlag (Wien, Miinchen), Aug. 21, 1995. Roberts, “Picture Coding Using Pseudorandom Noise,” IRE Trans. on Information Theory, vol. 8, No. 2, Feb., 1962, pp. 145-154.

Sandford II, et al., “The Data Embedding Method,” SPIE vol. 2615 pp. 226-259, Oct. 23, 1995.

SapWater et al., “Electronic Copyright Protection,” PHOTO>Electronic Imaging, vol. 37, No. 6, 1994, pp. 16-21.

Schneier, “Digital Signatures, Cryptographic Algorithms Can Create Nonforgeable Signatures for Electronic Docu

ments, Making Them Valid Legal Instruments,” BYTE, pp. 309-312, Nov. 1993.

Schreiber et al., “A Compatible High-De?nition Television

System Using the Noise-Margin Method of Hiding Enhancement Information,” SMPTE Journal, Dec. 1989, pp.

DatenschutZ und Datensicherung, 18/6 (1994) 318-326.

873-879.

Nakamura et al., “A Uni?ed Coding Method of Image and

[email protected], “Hide and Seek v. 4.0,” Internet

TeXt Data Using Discrete Orthogonal Transform,” Systems

reference, Apr. 10, 1994, 3 pages. Sheng et al., “Experiments on Pattern Recognition Using Invariant Fourier-Mellin Descriptors,” Journal of Optical Society of America, vol. 3, No. 6, Jun., 1986, pp. 771-776. Short, “Steps ToWard Unmasking Secure Communications,”

and Computers in Japan, vol. 21, No. 3, 1990, pp. 87-92. Nakamura et al., “A Uni?ed Coding Method of Dithered Image and TeXt Data Using Micropatterns,” Electronics and Communications in Japan, Part 1, vol. 72, No. 4, 1989, pp. 50-56.

NeW Product Information, “FBI at AppleEXpo” (Olympia, London), Nov., 1995, 2 pages. Oomen, A. et al, “A Variable-Bit Rate Buried-Data Channel

for Compact Disc,” Journal of the Audio Engineering Society vol. 43, No. 1-2, pp. 23-28, Jan-Feb, 1995. Oruanaidh et al., “Watermarking Digital Images for

Copyright

Protection,”

http://WWW.kalman.mee.tcd.ie/

people/jjr/evasub.—pap.html, Feb. 2, 1996, 8 pages. (Also published Aug., 1996, IEE Proceedings-Vision, Image and Signal Processing, vol. 143, No. 4, pp. 250-256). Pennebaker et al., JPEG Still Image Data Compression

Standard, Chapter 3, “Aspects of the Human Visual System, ” pp. 23-27, 1993, Van Nostrand Reinhold, NeW York.

PickholtZ

et

al.,

“Theory

of

Spread-Spectrum

Communications—A Tutorial,” Transactions on Com

munications, vol. COM-30, No. 5, May, 1982, pp. 855-884. Pitas et al., “Applying Signatures on Digital Images,” IEEE Workshop on Nonlinear Image and Signal Processing, Neos Marmaras, Greece, pp. 460-463, Jun., 1995. Port, “Halting HighWay Robbery on the Internet,” Business Week, p. 212, Oct. 17, 1994. Proudler, Graeme J ., “Authentication and Display of Signatures on Electronic Documents,” 2244 Research

Disclosure, Feb., 1994, No. 358, EmsWorth, GB, 1 page. Quisquater, J., “Access Control and COpyright Protection for Images, Conditional Access and Copyright Protection Based on the Use of Trusted Third Parties,” 1995, 43 pages. Quisquater, J ., et al., “Access Control and Copyright Protec

International Journal of Bifurcation and Chaos, vol. 4, No. 4, 1994, pp. 959-977.

Simmons, “Subliminal Channels; Past and Present,” ETT, vol. 5, No. 4, Jul.-Aug. 1994, pp. 45-59. Sklar, “A Structured OvervieW of Digital Communications—a Tutorial RevieW—Part I,” IEEE Com munications MagaZine, Aug., 1983, pp. 1-17. Sklar, “A Structured OvervieW of Digital Communications—a Tutorial RevieW—Part II,” IEEE Com

munications MagaZine, Oct., 1983, pp. 6-21. “Steganography,” Intellectual Property and the National Information Infrastructure The Report of the Working Group on Intellectual Property Rights, Sep. 1995, pp. 212-213. SZepanski, “Binary Data Transmission Over Video Channels With Very LoW Amplitude Data Signals,” Fernseh- und Kino-Technik, vol. 32, No. 7, Jul., 1978, pp. 251-256. (German teXt With full English translation). SZepanski, Additive Binary Data Transmission for Video Signals, Conference of the Communications Engineering Society, 1980, NTG Technical Reports, vol. 74, pp. 343-351. (German teXt With full English translation.). SZepanski, “Compatibility Problems in Add-On Data Transmission for TV-Channels,” 2d Symp. and Tech. EXh. On Electromagnetic Compatibility, Jun. 28, 1977, pp. 263 268.

SZepanski, “Optimization of Add-On Signals by Means of a Modi?ed Training Algorithm for Linear Classi?ers,” IEEE Int’l Symp. On Info. Theory, Oct. 10, 1977, pp. 27-28.

Systems” (68 pages), Apr. 19, 1995.

Tanaka et al., “A Visual Retrieval System With Private Information for Image Database,” International Conference on DSP Applications and Technology, Oct. 1991, pp. 415

Quisquater, J ., et al., “Access Control and Copyright Protec

421.

tion for Images, WorkPackage 3: Evaluation of EXisting

tion for Images, WorkPackage 8: Watermarking” (46 pages),

Tanaka, “Embedding the Attribute Information Into a

Jun. 30, 1995.

Dithered Image,” Systems and Computers in Japan, vol. 21,

Quisquater, J ., et al., “Access Control and Copyright Protec

No. 7, 1990, pp. 43-50.

tion for Images, WorkPackage 1: Access Control and

Tanaka et al., “Embedding Secret Information Into a

Copyright Protection for Images Need Evaluation,” Jun.,

Dithered Multi-Level Image,” Proc. IEEE Military Comm.

1995, 21 pages. Rindfrey, “ToWards an Equitable System for Access Control

Conf., Sep. 1990, pp. 216-220. Tanaka et al., “NeW Integrated Coding Schemes for Computer-Aided Facsimile,” Proc. IEEE Int’l Conf. on Sys.

and Copyright Protection in Broadcast Image Services,” Proc. of the Conference on Intellectual Property Rights and

Integration, Apr. 1990, pp. 275-281.

US 6,987,862 B2 Page 7 Ten Kate, W.R., et al., “A NeW Surround-Stereo-Surround

Coding Technique”, Philips Research Laboratories, The Netherlands, May, 1992. Tirkel et al., “A TWo-Dimensional Digital Watermark”

DICIH ’95, Univ. of Queensland (Brisbane), pp. 378-383, Dec. 6-8, 1995.

Toga et al., “Registration Revisited,” Journal of Neuroscience Methods, 48 (1993), pp. 1-13. van Schyndel et al., “A Digital Watermark,” Proc. IEEE Int. Conf. on Image Processing, Nov., 1994, pp. 86-90. Wagner, “Fingerprinting,” 1983 IEEE, pp. 18-22. Wall Street Journal, “Foiling Card Forgers With Magnetic ‘Noise’,” Feb. 8, 1994. Walton, “Image Authentication for a Slippery NeW Age,” Dr Dobb’s Journal, Apr. 1995, pp. 18-26, 82-87.

Weber et al., “Correlative Image Registration,” Seminars in Nuclear Medicine, vol. XXIV, No. 4 (Oct.), 1994, pp. 311-323.

Wise, “The History of Copyright, Photographers’ Rights Span Three Centuries,” PHOTO: Electronic Imaging, vol. 37 No. 6, 1994. Matsui et al, Video-Steganography: HoW to Secretly Embed a Signature in a Picture, Proc. Technological Strategies for

Protecting Intellectual Property in the NetWorked Multimedia Environment, vol. 1, issue 1, Jan., 1994, pp. 187-205.

Sep. 20, 2004, Amendment and postcard receipt in as signee’s U.S. Appl. No. 10/ 017,678, (published as US

2002-0090114 A1).

Wasserman, Broadcast Monitoring Technology by Cyphertech Systems Inc. (untitled speech transcript),

Jul. 27, 2005, Of?ce Action in assignee’s U.S. Appl. No. 10/017,678, and Jul. 29, 2005, Amendment in response

Worldwide Symp. on the Impact of Digital Tech. On

thereto.

Copyright & Neighboring Rights (Cambridge, MA), Apr. 2, 1993 (5 pages).

Assignee’s U.S. Appl. No. 10/017,678.

Sep. 7, 2005, Notice of AlloWance and Issue Fee Due in

U.S. Patent

Jan. 17, 2006

Sheet 1 6f 21

US 6,987,862 B2

12

DIGITAL NUMBER

'4-BITS'

8

(SIGNAL LEvEL)

4 01234

567891011121314

SAMPLE NUMBER (INDEX)

FIG. 1

COMPUTER

102

)

Qg

\106

104

100 f

W////////////////////////////////////////////////////A EXPOSE AND STEP

FIG. 4

U.S. Patent

Jan. 17, 2006

FIG 2 -

Sheet 2 6f 21

US 6,987,862 B2

OBTAIN OR CREATE ORIGINAL DIGITAL SIGNAL OR IMAGE

I

ESTIMATE ROUGH OFFSET AND RMS NOISE CHOOSE N OR N-BIT

IDENTIFICATION WORD, E6. 32

GEN ERATE N-BIT IDENTIFICATION WORD GENERATE OR SYNTHESIZE N "RANDOM" INDEPENDENT SIGNALS WITH ROUGHLY GAUSSIAN DISTRIBUTION ABOUT SOME MEAN VALUE, WHERE SIGNALS HAVE EQUAL EXTENT AND DIGITAL SPACING OF ORIGINAL DIGITAL SIGNAL OR IMAGE

i APPLY DIGITAL FILTER WHICH ATTENUATES BOTH LOW AND HIGH FREQUENCIES, LEAVING

MIDDLE-RANGE FREQUENCIES LARGELY INTACT CONDENSE N RANDOM SIGNALS, TO A LOWEST ACCEPTABLE BIT VALUE IF MEMORY OR STORAGE SPACE IS AT A PREMIUM

h

ADD ALL RANDOM IMAGES TOGETHER WHICH HAVE A CORRESPONDING "1 "P IN THEIR ASSOCIATED BIT-PLACE-VALUE OF THE N-BIT IDENTIFICATION WORD, CALL THIS THE BASE COMPOSITE SIGNAL OR IMAGE

EXPERIMENT VISUALLY WITH GAIN AN Dv GAMMA APPLIED TO BASE w COMPOSITE SIGNAL OR IMAGE, ADDING THIS TO ORIGINAL DIGITAL SIGNAL

OR IMAGE, AND. DETERMINING. THE ACCEPTABLE PERCEIVED NOISE LEVEL J

I APPLY FOUND GAIN AND CAMMA TO BASE COMPOSITE, ADD TO ORIGINAL, w THEN CALL THIS THE DISTRIBUTABLE SIGNAL OR IMAGE

I STORE AWAY AND SECURE ORIGINAL SIGNAL OR IMAGE, ALONG WITH N-BIT] IDENTIFICATION WORD AND THEN RANDOM SIGNALS

T (SELL OR DISTRIBUTE THE DISTRIBUTABLE SIGNAL OR IMAGE I

U.S. Patent

Jan. 17, 2006

Sheet 3 6f 21

US 6,987,862 B2

OBTAIN DIGITAL OR NON-DIGITAL COPY OF SUSPECT SIGNAL OR IMAGE

FIG . 3

I QDIGITIZE IF NOT ALREADY DIGITAL) CUT, AND MASK PORTION OF SIGNAL OR IMAGE BELIEVED TO BE SUSPECT (ONLY IF ENTIRE SIGNAL OR IMAGE IS NOT SUSPECT)

T PROCURE ORIGINAL DIGITAL SIGNAL OR IMAGE AND CUT AND MASK TO ROUGHLY THE SAME LOCATION OR SEQUENCE

I VISUALLY RESCALE AND REGISTER THE CUT-OUT SUSPECT SIGNAL TO THE CUT-OUT ORIGINAL SIGNAL

T RUN THROUGH SEARCH PROGRAM WITH MEAN SQUARED ERROR AS CRITERIA AND X OFFSET, Y OFFSET, AND SCALE AS THE THREE VARIABLES

APPLY X OFFSET, Y OFFSET, AND SCALE TO CUT-OUT SUSPECT, THEN RESAMPLE ONTO EXACT GRID AND CUT-OUT OF ORIGINAL SIGNAL

RUN THROUGH SEARCH PROGRAM WITH MEAN SQUARED E RROR AS CRITERIA ANDv DC OFFSET, GAIN, AND GAMMA AS THE THREE VARIABLES; APPLY TO. SUSPECT

SUBTRACT ORIGINAL FROM SUSPECT, GIVING DIFFERENCE SIGNAL OR IMAGE

STEP THROUGH ALL N RANDOM INDEPENDENT SIGNALS, MASKED AS ORIGINAL AND CROSS-CORRELATED WITH DIFFERENCE SIGNAL IN IMMEDIATE NEIGHBORHOOD OF REGISTRATION POINTS

@0 0 AND 1 LEVEL BY AVERAGING FIRST FOUR 0101 CODE VALUES) [ASSIGN EITHER A 0 OR A I TO EACH CROSS-CORRELATION RESULT DEPENDING ON PROXIMITY TO THE AVERAGES OF PREVIOUS STEP

I ( CHECK RESULT AGAINST SECURED IDENTIFICATION NUMBER J PROSECUTE IF IT MATCHES’? OR AT LEAST SEND A NASTY LETTER DEMANDING RECOMPENSE

U.S. Patent

Jan. 17, 2006

Sheet 4 6f 21

US 6,987,862 B2

CODE WORD

IDENTIFICATION-CODED

(8,9. 01101001

REA|__T|ME

OUTPUT SIGNAL

ENCODER

KEY DATA

INPUT SIGNAL

(OPTIONAL)

I

: 202 I‘ I I I | I I I I I I

ADDER SUBTRACTER

INPUT

I _

__

33E

_

230 ~,

01011000

_

214

OUTPUT

218 _

//

_

_

_

_

_/

234

U.S. Patent

Jan. 17, 2006

NOISE

Sheet 5 6f 21

_ _ __

NOISE

SOURCE

206 /

STORE

CODE 1

CODE 2-N

REAL TIME ENCODER

INPUT

US 6,987,862 B2

\ 242

OUTPUT 234

00100000

;

00100001

-

00100010

.

001 00100

.

001001 01

,

\

THROUGH NTHCODE

001001 10 J

WORDS

00100111

_%j

H6 7

01011000

202 >'<

J

[24s OUTPUT

SYNC DETECTOR

_ _ _ _l

INCREMENT

250

FIG. 8

00100000 00100001 00100010 00100011 001 0 01 00

U.S. Patent

TIME

Jan. 17, 2006

US 6,987,862 B2

Sheet 6 0f 21

(10 SECONDS

6' 9

1.0 SECONDS

NORIvIALIzED— 402

FRE

UENCY

~20d

B

——

-40dB 4

' I 50KHZ

OHZ

'

BORDER GONTINUITY

1.0

0.0

—>

—»

M

\

\\/\/V

REPEATED

/\

l'\

V \_

DETAIL OF ‘MATCH AT BORDER; CONTINUOUS TO mth DERIvITIvE

ROM; 504 STANDARD NOISE SIGNATURES COPYRIGHT DETECTION FLAG

AUDIO IN

T’ 500

502 FLAG VALID

K 506

7

508

U.S. Patent

Jan. 17, 2006

Sheet 7 6f 21

STANDARD NOIsE

US 6,987,862 B2

504

SIGNATURE READ OUT AT125%

599 \‘

NORMAL RATE

600

PITCH CHANGED NOISE sIGNAL

604

606

SIGNAL-PITCH CANCELLED

INPUT AUDIO SIGNAL

608

NOISE SIGNAL

I TIME AvERAGED POWER

TIME AVERAGED POWER SIGNAL

610

SIGNAL P C. NOISE SIGNAL PSPCN

PSIG

612

_ _ __

POWER DIFFERENCE sIGNAL

602

61 3

PS-PCN ' PSIG ' POIIT

F

WWW

I——CASE1:|—-—1——1————|~— 1614/ 03 53 10s 15S I——CASE2:

616/

0s

5s

1oS

16S

~ 4 SECOND BEATS

\—’618 624

F|G_ 12

ANNIE

600\

E/

2

SIGNAL ONE

622

A

5 9

BEAT

'\

—

DETECTION

.05S DIGITAL DELAY

620

FLAG VALID 50s

'

25E

.05S DIGITAL DELAY m .05S DIGITAL DELAY

2L

.05S DIGITAL DELAY I

1’

Ii

DETECTION "

\ 502

U.S. Patent

Jan. 17, 2006

Sheet 8 6f 21

US 6,987,862 B2

MOVIE: BUD'S ADVENTURES

Alien Productions

)0

FRAME#: 12183 DISTRIBUTION LOT: REGION 14

ENCRYPTION/SCRAMBLING ROUTINE #28, 702

PSEUDO-RANDOM MASTER SNOWY IMAGE

(SCALED DOWN AND ADDED TO FRAME 12183)

FIG. 13

U.S. Patent

Jan. 17, 2006

Sheet 9 0f 21

US 6,987,862 B2

‘EMBEDDED

720 x

4/

DIFFERENCE \‘ j\ MEAN-REMOVED HISTOGRAMS OF DIFFERENCE SIGNAL AND KNOWN EMBEDDED CODE SIGNAL

EMBEDDED

DIFFERENCE

w

%

THRESHOLDING

MEAN-REMOVED HISTOGRAMS OF FIRST DERIVATIVES (OR SCALER GRADIENTS IN CASE OF AN

IMAGE)

FIG. 14

U.S. Patent

Jan. 17, 2006

Sheet 10 0f 21

US 6,987,862 B2

750

STEP Z FRAMES 700

RENDER LOGO FRAME / 702

ENCRYPT/SCRAMBLE

/

OUTPUT MASTER

/

704 SNOWY IMAGE FRAME

HIGH BRIGHTNESS

/

MASTER SNOWY MOVIE 754

\

@

760

758

756

DIFFERENCE COMPRESSED MASTER

SNOWY MOVIE"

/

SNOWY MOVIE 764

"CHEAP MASTER 762

ORIGINAL MOVIE SCALE DOWN

770 DISTRIBUTABLE MOVIE

768 SIDE-BY-SIDE VIEWING

762

ORIGINAL MovIE

'

U.S. Patent

Now00@

.wzomrFO_0,

Jan. 17, 2006

Sheet 11 6f 21

US 6,987,862 B2

U.S. Patent

Jan. 17, 2006

Sheet 12 0f 21

96 BIT LEADER STRING, 820 64 BIT LENGTH

32 BIT DATA WORD SIZE

822

US 6,987,862 B2

V/"SHADOW CHANNEL". 828 DATA...

824

UNIVERSAL EMPIRICAL DATA FORMAT

FIG. 17

f 850

f 852

/ 864

&/

854

(Q a FIG. 18

U.S. Patent

Jan. 17, 2006

Sheet 13 0f 21

US 6,987,862 B2

\<

QUEST FOR MOSAI ARE COEXTEN I KNOT PATTER AN AS A SIGNATURE, OR STEGANOGAPHICV SE

KNOT PATTERNS WHICH "COVER" AND H ORIGINAL IMAGE; ELEMENTAL CONVEY THE SAME RM N, S A H CAN CONVEY A NEW M AGE

FIG. 19