!"# $&% ' ()+* , -%. /0 $1%32 $4657 8:9<;=?>>A@CBDE=?FG@H@HBJI =?B9
à ÄZÅƨÇJÈAÉ+ÊËwƨÄ?ÈAÅ Ì d?_[]a`RZY'bcd?_dZ^7vTa`_yv¶RqVYvTNQP?bcd?_ Sc_vTa`d?bcd?i¬am_l`_vTamNQPbcl l`\?[<_a`kHbl_yzNSvTlml`bn
α Frames Channels
β
0
1
2
3
4
5
6
7
8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
time
Ð bxiZ\?am_ Õ · P?_®am_$Sv^`bcRTd
01
2" 3 4 5674 85:9<;==>
· P?_ vqa`^`bxcYX:KnHbQO_HYl\ILKbRBMORTX6cjukJX>kmILNLNQ[\Nxw Z:QU[WKGIPyWX6c KGIL[\gNPXbZ:NPMOKGKNPMVTX6NPK:s
_$ScS ØDz ÚURTa»V\]d?d?_$S ØD{ Ú
MOvTY'[]Sx_ylvqam_iT_d?_$aQv^m_z1vTlUVRZSxScRsl Cq}Ø | Ú ~ Ø S ÚJO
3 ^ } Ø}| Ú Ø}| Ú z}Ø | Ú ~ Ø S JÚ O
3 ^ } }Ø | ÚJ Ø}| Ú6 ØDz Ú Ø| Ú {.}Ø | Ú ~ Ø S JÚ O
3 ^ } }Ø | JÚ DØ z| Ú Ø z Ú }Ø | Ú ~ | Õ |$z
m U ~ ~ |z #s P?_a`_ vTd]z }Ø | Ú¦vqam_7zOaQvs#d¶Va`RZY vl^mvTd]z?vTamz¶d?RZa`YvTS zOblp^ma`bc?\O^mbxRZd Ø ~ ÕyÚ{ bclfvTd¤bcdC^`_iT_$afz?amvs#dw\?d?bxVRTamY Sxo VamRTY3ÓnÕ ¡¢ |×hvTd]z z£ bclvqd¶bcdZ^m_$iZ_$a¦zOaQvs#d¶\?d?bxVRTamY Sxo VamRTY Ó ¢ | Ö ×¡
MH_$_']iZ\?am_ | Ø ambciTPC^P]vqd]zwl`bczO_ÚVRTafl`RTY _ bcd]lp^Qvqd]N$_lRqV_yvTNQPAN$ScvZl`l
· P?_"¤¥W¦ §P¨r©Wª@«NSvTlmlbcl'NQP]vqaQvTN ^`_a`bl`_z®Ho®v¦[?Scvq^`_yvq\®VamRTY^mbxY _ ^`R z {C^`P]_ ¬@ª¦x¦ZNSvTlmlhHo viZamvZzO\]vTSbxd
°£;=1 °±²³´"µe£ ±´"=O ¶
· P?_iZRZvqSVRZa0^`P?blSc_vqamd?bcd?i^mvZlbl1^`RN$ScvZl`l`bxVo¨v l\?k8MOKÁq\KGX:y¶HYQZ:QNLNPX6Z6H.HYl\XSyWMOHhMs FDH7ILK7l\ILgl\Nxw KGX:[WKGILHYIL]^X±HYQ»[\QUILKGXUjÁKGqW¡X6cYK NLQkÃHYX:aRTQchMON
Cylinder examples 10 8 6
Value
Rule 7: local max at time 31 local min at time 116 -> class cyl
4 2 0 -2 -4 20
40
60 Time Bell examples
80
100
120
0
20
40
60 Time Funnel examples
80
100
120
0
20
40
80
100
120
10 8 6
Value
Rule 1: increases from time 28 to 52 local max at time 48 local max at time 67 -> class bell
0
4 2 0 -2 -4
10 8 6
Value
Rule 12: decreases from time 34 to 48 flat from 2 to 26 local max at time 61 -> class funnel
4 2 0 -2 -4 60 Time
ÐbciT\?am_f|TMH_Sx_yN-^`_yza`\?Sc_l§[]a`ROzO\]N$_zHo · WXSvTlml§bxd&^`P?_W / Ð ^mvTl`7vTd]z lRZY'_0bcd]l^mvqd
Rule 6: z: global maximum is 0.070312 [hand goes far away from body] z: increases from time 10 to 30 [hand moving to far position shown] fore: flat from 0 to 5 with value 0.72 [initially finger is fully bent] -> class come
Rule 7: y: local maximum at time 38 [i.e. touching chin as shown] z: decreases from time 11 to 31 [hand is pulled towards body] fore: flat from time 3 to 41 with value 0.02 [forefinger kept straight for most of sign] -> class thank
ÐbxiZ\?am_ ¢ wMO_$Sc_N-^m_zJam\?Sc_l[?amROzO\]N$_zHo · WXSvTlmlvqd]z^mP?_¨N$RTama`_yl[RTd]z?bxd?i¬zO_$]d?bx^`bcRTd]l®Va`RZY ^mP?_¨\
· vT?Sc_'ÕW · P?_1^`aQvqbcd?bcd?il_$^#VRTa§^`P]_
/
^QvTl`
· vq?Sc_1|¡0/«®Uª21É®W¨ ( g ( Tv [?[?Scbx_yz ^`R¦^`P?_ 34
X y NLq\X NLq\X Xy Xy NLq\X
[RTbcdZ^ Ø vNScRZl`_z'
ÇJ#Ë "ÄZ(Æ ¨Ë¶Æ¤Ê Ç ÅÉ Ä # %' # ÅÆ Æ¤ÄOÈAÅ uw_®[?amRT[RZl`_®v iT_$d]_$aQvqSvqaQNQP?bx^`_yN-^`\]a`_ VRZa^`_Y'[RTaQvqSXNSvTl l`bn
*+ QcX6dWMaR\NLXUj\IL[£HYl\XbNPMOcYgUX4½qWKGNPM[ yWQaMIL[Äj , RTX6cZ:X:[rH M Z6Z:qWchMOZ6wZMO[VTX3QUVHhMIL[\X:yqWKGIL[\gbQU[WNLw4HYl\X3aMOdILaM.M[\yeaIL[Wf ILaM4QO_ HYl\XÁd¡jw7MO[By.-
/'
^`aQvqbcd?bcd?i¦l`_^
75 6 98:;)< =>8@? A BC DEFEG A BC DFHDBC DFHDBCI D FEG A B)JDFHDB)JDFHDBK DEFEG A B D FEG A BC DEFEG A B)JDHFHDBC DFHDBCI DEFEG ( g ( blzO_$]d?_yz&Ho`
zORZY vTbxd?¹l`[<_yNbxfaek)pJi { s#P?bcNQP ^QvqZ_lv7lp^ma`_yvqr Y q¦vTd]z L h am_^m\?a`d
Parametrised Event Primitives
Raw Training Data
Event
Synthetic Events Database
Parametrised Event Data
Extraction
Event Clustering (parameter space)
Synthetic Events
Event Attribution Training Data (Synthetic Event Attributes)
Training Data (Global Features)
Global Feature Calculation
Combination Training Data (Complete)
Classifier
Conventional Learning
ÐbciT\?am_4?Ä 1$ _$d?_amvTSvqaQNQP?bx^`_N^`\?am_VRTa§^`aQvqbcd?bcd?i]
Parameter Space for TrueRun on BR task 5
TrueRun events
4 Cluster C
Duration (d)
Cluster B
3
2
Cluster A
1
0 0
ÐbxiZ\?am_¡ /' ^mvTl`U
· vq?Sc_
¢
4
6 Start time (t)
8
10
12
/«®Uª21³®\¨f[]vTamvTY'_$^`_a§l`[]vZN_fvqd
%$1SxRZ]vqSvTd]z&_$kT_dC^#vq^^ma`bc?\O^m_lVRTa§^mP?_ ' /
:9
2
S<@ 4=@` 2 <
, s , s , s , s 9 , s , , s ,
576 98d>=@9 ¾ÁQ
X:K X:K ¾ÁQ ¾ Q Á ¾ Q Á
X:K ¾ÁQ ¾ Q Á X:K X:K ¾ÁQ
¾ÁQ
X:K X:K
¾ÁQ ¾ Q Á X:K
^QvTl`U
vqam_wa`_yNRTY?bcd?_z»{bxdv³VRTamYv^ l\?bx^mvT?Sc_¨VRZa [?a`RON$_lmlbcd?i Hovqd¶v^`^`ambx?\?^`_¹kvqSc\?_'Sx_yvqamd?_$ay
· P?_ am_l`\?Sn^0RqV§vq[?[]SxoHbcd?i Ó \?bcd?ScvTd{»ÕÖZÖ ¢ ×RTd^`P?_ / z]v^mv bcd ^mvT?Sc_ ¢ vq am_l`P?Rs#d& bxd7]iT\?am_ 7Ø Sc_V´^l`bcz?_yÚ-
Ð]\?a`^`P?_a`Y RTam_T{HbxV^`P]_$am_ bll`RTY _svo®^`R®[?amROzO\]N$_fv [?a`RT^`RT^poC[_0VamRTY(^`P?_¦N$Sx\=°e dwbcd]lp^Qvqd]N$_RTV^`P]_ vT_ÅQcZ:NPMKGKGIxÇBZMHYILQU[ÄjWIxHJILKQ[\Nxw>_ÅQc yWX6KGZ6cYILRWHYILQU[us
! # +/ - . 89#' #:;
ÐbxiZ\?a`_
01 ,324) 56
"# $%" &'#(*)+#$"', - . # 7/% 89#%'# :;
\?Sx_yl#[?amROzO\]N_yz7Ho7vT[?[?ScoHbxd?i
[RZl`bn^mbxkZ_¬iTaQvTzObc_$dC^-Ú vqd]z= ¦ #@ Ø d]R'[_$aQN_[O^`bc?Sc_fNQP]vqd]iT_1bxdiTaQvTzObc_$dC^-Ú-
· P?bl§a`_$ ^m\?a`dqWa B MSRTXMOi>cYX:NPMOHYIL]^XHYQ HYl\XÁRTQUIL[rHYK3KGqcGcYQUqW[ByWIL[WgeIxH F s [ N OÁQUaIL[\gQUK3M[\y£¿ M --:M[\I j IIPQ M[\y LHM MRWN MOZ:XZ:QOcGcYX:Z6HYILQU XprqBMON _ÅcYXprq\X6[\Z6w yWILKGZ6cYXHYIPKYMHYILQU[ IL[rHYQ VWIL[\K N O.QUqWgUlWX6cGHwX6HMN sLj IIQ _ÅQcZ:QU[rHYIL[@q\Qq\K8]MNLq\X:K8kX6cYXHYl\ILK³Z:QU[rHYX6d@Hj^MOHGHGcYILV\qHYIPQ[QrZ:Z:qcYKVrwbÇB[ByIL[\g.HYl\X8X6]^X:[rH _ÅcYQaoHYl\X
&
^`R'^mvT?Sx_ ¢
^`P]_¤NSvTlml¡bcd]zO_[<_d]zO_$dC^®iZSxRZ]vqS#V_yv^m\?a`_yl${N$a`_yv^mbxd?ivAl_$^ RqVV_vq^`\?am_l^`P
%
ÇÄ # ÅÆ $' Ç + Ê ' Æ
>±
+
°>
· WXSvTlml.svZlvq[?[?Scbc_z¦^`RRq^`P'^mP?_\ ¦ #@'sX_a`_vq[?[]Sxbc_zA^`R¤^`P?_ am_$Yvqbcd?bcd?i¨amRq^Qv^mbxRZd³vqd
Parametrised
Global Training Data
Event Training Data (All) Class 1 Parametrised Event Training Data (Class 1)
Event Clustering
Synthetic
Event
(parameter space)
Events
Attribution
Training Data (Event Att)
Combination
Training Data (Complete)
Conventional Learning
Classifier 1
Combination
Training Data (Complete)
Conventional Learning
ClassifierN
Class N Parametrised Event Training Data (Class N)
Event Clustering
Synthetic
Event
(parameter space)
Events
Attribution
Training Data (Event Att)
ÐbxiZ\?am _ ATf[?[]a`RCvTNQPw\]l_yzwbxd¶bcY'[]Sx_Y'_dC^`bcd?i ^`Rl`bxY [?ScbxVo¤NSc\]l^`_a`bcd?i^mvZlU
&WXSvTlmlbx]_$aÕ'^mP?a`RZ\?iTPw^mRWXSvTlml`bn]_afrÛvqam_ kTRT^`_yz®^mR'YvTT_v]d]vqS¼NSvTlmlbx
YvqdHo¶v^^ma`bc?\O^m_l{d]vy½¾xkZ_ / voZ_lRZ\O^`[_$a`VRTamYl'W ?<
?
wÌd ^`P]_¬Rq^`P]_$a P]vTd]z»{0bxdvJzORTYvTbxds#bn^mPY vTdHoz?v^Qv Ø |r?C~ ^`aQvqbcd?bcd?ibcd]lp^Qvqd]N$_l [_$awNSvTlmlmÚ{0V_$s NQP]vqd]d?_$Slvqd
· vq?Sc_e?ugamamRTa§amvq^`_ylX_$«O[?a`_yl`l`_zvTl§[_$aQN_dC^mvqiZ_l Ø Y _yvqdtl^mz_$amamRTaRqV^`P?_Y _vTd<ÚXRTd^`P]_Sx_yvqamd?bxd]i¦^QvTl`Hl
= K¼Á@CL @H=OÁ ¼@CÁ >=?F F ° KLF = =OÁ@ ° KLF = 9 @H 79 | N q ~ A~ N AÖ |@? N ~T~ Õ N ~ZÖ ¢:N A ~ N Õ · WXScvZl`l ¹rv½¾ckT_ / voZ_l MH_$iZY'_dC^ml ¹rvy½¾ckT_ / voZ_l ¢:N ~T ~ +Õ N ? |TÖ N @¯ Õ N Õy~ :N |q~ ~ N A OÕ ? N ~T ~ ³| N ~ ¢ ?C~ N ¢ A ~ N ¯ ¢ Õ N ÖT ~ ~ N \ A · WXSvTlm:l ¹ZW ?]
MO_$iTY _dZ^ ¹TW ?<
Õ ¯ N ~T ~ ³| N A ¢:N ¢ A Õ N UÕ ¯ | N ?] Õ ~ N ?\¯ bcd]lp^Qvqd]N$_T{ vV´^m_$a³N$RTY?bxd]bxd?i:^`P?_RT\O^m[?\O^ml³RqV¨l`oHdC^`P?_$^`bN ^`P]_fvq\O^mP?RTayÒ l§Hd?Rs#Sc_z?iT_T
_$kZ_$dC^mlXVamRTYÛ^mP?_NSc\]l^`_$am_$a#vTd]z {qsX_Nvqd7[]a`RT zO\]N$_0a`\?Sc_lX^mP]v^Yvo_1\]k)pJ]k´
· P?_'lp^ma`\MkmIL[\lBKMOHeq\tKGKnX:#$HhyMO#HYX:IL[ K RHz?o1_VRZa`_^`P?_NQP?bxdbl^`RT\VTX6c4Q_ÁIL[\KnHhM[WZ:X:KRTX6ceZ:NPMKGKIL[ HYlWX l`bx?bcScbn^po RqVzO_lmNambx[?^`bcRTd]lhRTd®Rq^mP®^mvZlOlhbclh^`R¦^`P?_0vq\O^mP?RTayÒ l Hd?Rs#Sc_zOiZ_T{d?RkT_S
¨ l¦vTd]z¶Rq^mP?_$a¦^`_NQP]d?bc¯C\?_ylfP]vkZ_ IL½["qWaKGNPMMO[£[@w yQUZ:aMKGMOX:IPK4[[email protected]_vQR\q\NLX [\y fDILKn[7HhMRHYcYX X:NLB)IP a IL[\R\MOMOcGchwMOaX6dX6RTHYX6X6c cYF ILatX:#$[rHY# KHYl\yMOIPy H d?RT^_$_d\]l`_z¦^`R0Nam_vq^`_§NRZY'[]a`_P?_$d]l`bc?Sx_§zO_yl`N$a`bc[O^`bcRTd
d]Rq^`P]_$a ^m_NQP?d?b¯C\?_¬^mP]v^¨P
+ Ê+ÆwÊÇ ËÈAÅtË ' Ê + ?Ä ÈAÅ
ÏÈÇ
-
³
£ ;ȳ
³v0
9<;";"±
· P?_iZ_$d?_amvTSqvqaQNQP?bx^`_N^`\?am_.[?amRT[RZl`_z1bxY [?amRkT_ylU
9HÀFG@HB @H>@ L °
· ]P vTd?Ol'^`R · P?_¤WXam_vq^`RTa'VRZaiTbckCbcd?i¶Y _ ^`P?_¤vq?bcSxbx^po¬^mR zOR¶^mP?bcl7sXRZa`U
MH_yNRZd]z?vqambcSxoZ{XYo³l`bxd]N$_$am_ ^`P]vTd?OliTRw^mR bNQP]vq_S vqama`bc_lVRZavTlml`bcl^mvTd]N_bcd YvqdHo7VRZa`Yl¥UWXSvq\]z?_ MOvTY'Y\O^fVRZal`[]vqambxd]i Y'_®^`bcY'_&s#P?_$dAbn^¦s§vTlfkT_$amo¨kvTSx\O vq]Sx_ ^mRP]bxY ¥ RCl`l \?bcd?Svqd¤VRTafYvTdCo¤l\?iZiT_ylp^mbxRZd]l$¥¼Y¦o sRTd]zO_aV\]SVGvqY bcSxoU¥vqd]z^mR RZbMHP]vTd¤WXP?RTd]iVRTaP]_$Sc[?bxd]i Y _flp^Qvo®N$vTSxY vqd]zlp^Qvq?Sc_T
Ç Ó / _d?iTbcR]{»ÕyÖTÖ × / _d?iTbcR]{
Ø ÕyÖTÖ Ú-
._4o ]H\ ._4a p ]c npJ]9 Z:__f \ i@j>_4o_i>f3_ _fp3m i kla k)p i]
§¢£dC^`_$amd]vq^`bcRTd]vTS · P?RTYl`RTd ( \??Scbcl`P?bcd?i¢£d]NT
Ó ·vTdCoHSc\?U{»ÕÖZÖ ¯× ·1vqdHoHSx\?U{§f
Ø ÕÖZÖ¯ZÚ
( a`_yzObN-^`bcd?iw^`P]_ V\O^`\?am_ ¢vq[?[?amRZvZNQP?_l^`R ^`bcY _£l_a`bc_l[?amRT?Sc_$Yl
· _yNQP?d?bN$vqS _$[RTa`^§uMH¹WÖ ¯£\~ AH{O¢ ( am_lml
Ó ·vZl§_^vqS¡
c{ÕÖZÖ ¯e× ·vZl${ $'
c{®Îbcd{®Ô
¡¢-
c{ vqd]d?bxSv?{ ¦
x{ _$d?iCvqd]vq^`P]vTd{ $'
x{vTd]z¨MHYoZ^mP{ (
Ø ÕÖZÖ ¯CÚ-
\?Sc_zOblp NRkT_a`oVa`RZY^`bcY'_§l`_$ambx_yl$
C¢£d ]3p f__jJkli2m cRpEna _ pJo ]a iab_4]i@\Jaek)pJi>\! p i n_4]H_4i@f_ pJi#." i>p$X _j4m2_&.% k cfp ' _4])( \Ji@j!S % \ aK\+* klikli2m-,".%/%10325476
<¢ ( a`_yl`l
Ó ·RZY'bcd?iZRZl#vqd ]3p f__jJkli2m c pEn a: _;?9@ a iab_]i>\0 a k)p i@\A%pJin_]H_4i@f_wp i* \ f9 kli@_ : _\J]i kli2mT{Z[]vTiT_yl#ÕÖ ? |q~Z|?
RTamiZvTdO¹ÔvT\OVYvqd?d
Ó Ð?ambx_yzOYvqd_^vqS¡
c{ÕÖZÖ ¯×0Ð?ambx_yzOYvqd{+r¦
x{ \?am[?PHoT{Ô
x{ vqd]z \]lml_SxS¡{#MU
Ø ÕyÖTWÖ ¯ZÚ-
Î_vqamd?bcd?iw^`P?_l^`am\]N^`\?am_ RqV zOoHd]vqY bNf[?amRT]vT?bcSxblp^mbcNfd?_^psRTamOl$
¢£dB ]Hpf__3j kli2mD0C iE0 f3_4]ab\JkliaFQ ( kliHG ]aek g7f4k)\ iab_7 k m2_4i@f_&%pJin_]3_i>f3_I? 2J254 ,KCG 03254)6
?¢ ( a`_yl`l
Ó RZP?d&_$^vqS¡
x{»ÕyÖTÖ ?q× RZP?d{ $'
¦
x{Ô0RTP]vkHb¡{
c{vTd]z ( ±]_iT_$ay{?Ô
Ø ÕÖZ@Ö ?CÚ
¢£ama`_Sx_kvTdC^#V_v^m\?am_lvTd]z&^`P?_¦l`\?O l_$^l`_$Sc_N^`bcRTd[?a`RZ?Sc_$Y
?¢£dL ]Hpf3__jJklimJc p n a _ iab_]i>\0 a k)p i@\ p i n_4]H_4i@f_`pJiM* \ f9 kX _ : _\ ]ikli2mI? 2J2ON]{<[]vTiT_yl Õy|OÕ Õ|qÖ?
Ó RZP?d]l^`RTd{»ÕÖ ¯ZÖ× RZP?d]l^`RZd{ ·
Ø ÕÖ ¯ZÖZÚ
PG oc)X \JiQw% k)f4a k)p 0 i@\J])(5< \Rw % k)f4aek)pJi@\ ])S( pEn'a: _S k m9i : \Ji2m9o\4m2_[pEn'a: _8G oc)0 a ]H\ k)\Ji-% _\EnT%pJ^ ^So i kla(
·_vqVd?_lml _l`RT\?aQN_yl\]lp ^`aQvqScbcv'λ^Qz»
Ó ÔvTzORZ\]l${UÕyÖTÖZ×0ÔvZzORT\
Ó qv d?iCvqd]vTa`bl{ÕyÖTÖBAy× vqd?iCvqd]vTa`bl${»MU
Ø ·_yN_$Y<_aÕÖZÖ\AqÚ
oZ_])'k c4_3jMUX\cck g7f\Jaek)pJiH klaWV _^ Z:p ]H\X%S\ aK\q
( Pu· ^`P?_ylbl${qWXRTY [?\?^`_$a.MONbc_$d\%pJin_]H_4i@f_ p i]. " i>p$X _j4m2_M.% k c4f3p ' _4])( \Ji@j % \ aK\^* kli kli2m_,"%%1032J`6{O[]vTiT_yl|OÕ~ |?ÕyO
S Ó Ì1v^`_yl§_^vTS
c{»ÕÖZÖ ¯×¦Ì1v^m_l{ ·
c{ _d]l_dB{ ·¦
c{Ovqd]z7WXRZP?_$d{ (
Ø ÕÖZÖ ¯ZÚ
·bl`N$RkT_a`bcd?iam\?Sc_l¦VRTaNSc\]l^`_$ambcd?i¤vTd]z [?a`_yzObN-^`bcd?ivTl`oHd]NQP?amRTd?RZ\]l¼_$kT_dC^ml
]¢£d Ó ·1vqdHoHSx\]{ÕÖTWÖ ¯yס{ []vqiZ_bl A ¢ AÖ]
Ó ( vqScbxRZ\?amvZl${ÕÖZ\Ö A× ( vTSxbcRT\?aQvTl{ $'
Ø ÕÖZ\Ö ATÚ-
R _ g%i>_^ _i a'p n V _4^RZpJ]3\a%pJica ]H\ klia c kli#\JiQbP' _4iac _fp3m i kla k)p i&d( c)0 aK_4^ ocklim- ^ \cS % \ aK\Jc_4a cQ
( uP · ^`P?_ylbl{ j d?bckT_aml`bn^po RqV vqd]NQP?_ylp^m_$ay
Ó\?bxd]ScvTd{»ÕÖZÖ ¢ × \?bcd?Svqd{
Ø ÕÖZÖ ¢ Ú
efNdg`5\%pJin_]3_i>f3_[pJiG ]a k0 g7f4k)\ i aK_O k m2_i>f3_^,pG/G G El 25476{H[]vTiT_yl^Õ A ¢ Õ ¯T~]
¢ ( am_lml$