Đang tải... (xem toàn văn)
Luận văn thạc sỹ công nghệ thông tin - Chuyên ngành Khoa học máy tính Đề tài : Tìm hiểu phương pháp SVM và ứng dụng trong nhận dạng chữ viết tay trực tuyến (SVM - Support Vector Machine - phương pháp học máy)
! ! ! " #$$% ! &'() ! ! !*+, ! ! / +0 - 34$343$ 9: ! " #$$% ; < " ) +) +, /+>? @ / != ! ! J+, >!* * >K '> L ! / E (2 # A+! B (C ) =+C ! D / E+0 ! =F = ) !* M =AF = G (C =+, ! J+O =A &+> ! ! E( / N&+C !4 ) +)= +, /+>? @ /+>/ = +' / ) / ! ! ! : AG, @* ! + .: / !* =A&'(! E+ =/ G>!* H+I @ ! + B / P G () = +' / !D + ) !* : * (C ) !* ! +, : (2 / ) !* ?D &Q /+>/ = +' / ) +>/D E+0 ! =F * +Q H+ ' J+, L =+C ! !* ' J+, / &>!* = ) (& L ! = G M R& =A !* M =AF ! (2 >/ &'> +> &+> ! K4 / =+C ) +) +, /+>? @ /+>/ R! R = ) = +? L+Q C / != ! ! + (, E+0 ! H&!* E( =+, D = G!* (C / G!* =AF J+, > ! G* '> L ! E >!* * >K * &>K E( =+, @ Q ? @ ! / ! (2 EG / +, (C @ ! = ! !4 ) /&0 / +) = +, /+>? @ = S/ G !* ! ! ! >/ T +, +! U E+0 /&!* /+2 C @* N@ / G (2 =AG K ? = NG >! ! = =+' J / =&'(2J+, / = ! /+> =! D ) = ! L+>/ J( RC G!+, * &>K = ) > /@ Q L ? =A+ !* / 'D / 1@E(S (S (C &+Q + E( =+, & M /&Q 4 ! D !*+, = +>!* V !+O#$$% ' 3# ? A+! ! +O ! " 44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444 W G!* @ X 4444444444444444444444444444444444444444444444444444444444444444444444 J 444444444444444444444444444444444444444444444444444444444444444444444444444444444 343 G!* K +>K ! +C !* &KK A= (/= A @ ! H+ 34# &.= ()!* ()/G/ & ! >& 7H& K !* +/ !( 4444444444444444444444444444444444444443 J+,! +CH+ / GJ (2 =AG ! !* = =+' / =&'(2 ! 4444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444# G!* # Y @ Y : " 6 Z Z 444444444444444 [ #43 +\ ! E( ! +C !* HG> * >/ ! F/&Q / 1&+2 L 4444444444444444444444[ = J+2 ! H+ @ ! + ]+> = = !* () #4# *&'() =+^ /G = (S 1+ ! / & / G !* (C = / ? ; T ?K(A /+N ; 1L ! ? _ !U 44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444` += #4a !=A K' J+, ()M /&Q !=A K' E(2J+2E( 1GN ! &+! + ! ! C /&Q!*&'()=+^ =& + ! / ; 44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444b #4% C C /&Q /E =& + !*&'() / ; 44444444444444444444444444444444444444444444444444444444444433 ! =+^ #4[ : +> ! (C ? H ?(!1 ! /&Q K +,! +C !* 4444444444444444444444444444444444443% + =+C ? ! H+ #4V B NG 1G C /&Q ! @* =& + !*&'() / ; ! ! =+^ #4` 4444444444444444444444444444444444444444444444443[ G!* K +>K =A&/=&A+N ; 1L ! ? _ ! c ; @ += 4444444444444444444444444444444444443` #4b :(2 ! J( N'> = &'(2 L 4444444444444444444444444444444444444444444444444444444444443b = N&+C = / = !* () G!* a Y @ a43 Y Y 444444444444444444444444444444444444444444 3d (& L ! :+A&1 c:& !c &/L T:: U 444444444444444444444444444444444444444444444444444443d (C (A a4# '> = &'(2 & T8&+N ='U4444444444444444444444444444444444444444444444444444444444444444444444## = E !*+I a4a +Q+, +>! E & R!* K G!* K +>K * +QE+ +, 444444444444444444444444#% R = !*+I +e @ ? ?4 G!* % @ c ; ; 4444444444444444444444444444444444444444444444444444444444444444444444444444444444444 #V %43 =A !* =AG, @ =+C & K +) + =&'(2 ! EG @* K ?+I ! ! K / != @ 44444444444444444444#V / %4# =&'(2= ! =A !* =AG, @ =+C?+IL ) K +) + =&'(2= ! ! @* K ! K & !* ! / ! EG @ 444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444a3 / %4a %4% K =&'(2 !44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444aa C H& +,L =1 J J( ? (A!(N 44444444444444444444444444444444444444444444444444444444444444444444444a` %4[ / J+2 ! +C !* E+ N@ 444444444444444444444444444444444444444444444444444444444444ab ! E( ! H+ >K G!* [ :Y @ X 444444444444444444444444444444444444444444444444 %3 [43 C ! E( / &!*4 444444444444444444444444444444444444444444444444444444444444444444444444444444444%3 = J+2 [4# ? /&.T ? [4a +) T8(/ ?K = !U4444444444444444444444444444444444444444444444444444444444444444444444444444%% ! A+0 &!L 444444444444444444444444444444444444444444444444444444444444444444444444444444444%a !*U [4% G = (S & =&+! =G (M / &(!= +N T G!* V @ Y V43 V4# : 78 X U 444444444444444444444%[ Y ;5 4444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444 [$ S M J( / G (2 =AG =&'(2 !* &+! = =+' J / !444444444444444444444444444444444444444444444444444444444[$ +Q /+>/ !* V4a :(2@ = K G!* ` : @ `43 ! ?+N K= ? _ ! c += 8'!+? / ?( f+AK !* c f444444444444444444444444444444444444444444[a J+, C f / E E Z / G (2 =AG =&'(2 = =+' J / ! 4444444444444444444444444[b 444444444444444444444444444444444444444444444444444444 V$ & / J+, G!* K +>K = G (C + / G!* =AF 4444444444444444444444444444444V$ /E K @ ! /&Q @ / ! `4# :(2&+Q +C !* E+ @ /&Q G!* =AF 4444444444444444444444444444444444444444444V3 = M ! ! H+ = EG + / @ / ! G!* b : @ 444444444444444444444444444444444444444444444444444444444444444444444444444444444 V` b43 :(2&+Q = EG = M E+ @ 444444444444444444444444444444444444444444444444444444444444444444444444444444444444444V` / b4# G>!* K +>= =A (S @ ! 44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444Vb : P- Z444444444444444444444444444444444444444444444444444444444444444444444444444 Vd ;W : Z Z 4444444444444444444444444444444444444 `# 44444444444444444444444444444444444 `b J F 3c3 ! F 3c# ! () +g K +) + =+C & =A !* L ) * +! & K !* ! / K ?+I !* 44444444444444444444444444443 G!* K +>K K +) !* E(S / E+\ !* h%i 44444444444444444444444444444444444444a @ ! J&, =A / =AG F #c3 ! +,K +) / 1&+2 ? ! R ]+> = J+, J L !* ', F #c# ! +Q !* E(S ! 2?+I +e EG, = +g =A !* L !+O E+> # & R!* @* ! !* F #ca ! +Q !* E(S ! 2?+I ) = +g +, TJ+,+g +, R!* L !+O E+> a & L !* !* ! * = !* !*U +e /+>/ EG, = +g =A !* L ) * +! @* ! !* !* 44444444444444444444444444444444444444V 444444444444444443$ 444444444444444444444444444444444444444444444444444444444443$ F #c% ! C K +,jM ?+.k / > = (S+Q / ? ! & 4444444444444444433 = =+C ? &+> ! * = =F !* F #c[ ! = B + /&Q F #cV ! ?(1 ! /&Q K EG, = +g =A !* + =+C @* ! !* 4444444444444444444444444444444444444444444444444444444444444444444444444444444444444443a F #c` + 2@ + > /+>/ ! * > ! J@ F ac3 +C =A !* L ) * +! ! K !* 444444444444444444444444444444444444444443% L+>/ ! +&444444444444444444444444444444444444444444444444444443` J+,+> =AB Q +2 + * ! ! = /&Q =A !* 44444444444443d F ac# ! ! !* lE (& L ! :+A&1 c & !c &/L 4444444444444444444444444444444#$ + '> + (C (A F aca ! ! !* lR = +>! E & 44444444444444444444444444444444444444444444444444444#% + '> + +, !*+I F ac% ! &+C +>! * +QE+ +,=A !* L ) * +! +,θT]D'U 4444444444444444444444#[ == ? ? !* ? F %c3 ! () +g K +) + + =+C & 44444444444444444444444444444444444444444444444444444444#` & K !* !/ K ?+I F %c# : ! +Q /+>/ K +) + H /+, N@ = F !* ! / !* > ! ?(!1 ! /+, ! !* Q 4444444#b F %ca : ! ) = (S +) + =+C & =A() +e ? C () +g 444444444444444444a3 !* K ! / K ?+I ! R!* = & K !* F %c% ! C = K +)/ + K = ?+\ ! =&'(2/ > = (S Q +, ? C ()K +g =A !* ! =A@= ! =1 & !* L ) * +! N@ @ 444444444444444444444444444444444444444444444444444444444444444444444444444444444444444a% !* >! ! F %c[ ! +\ +g hc3D3i]h3Dc3i =A !* = K !* = +, ?+\ !* =A !* ! =/ 4444444444444444444a[ F %cV G, / !* K +) + =+C & J+, / N I ! @* ! !/ K ?+I /+> 4444444444444444444444444444444444444444444aV F %c` ;Pm ! +&11 +! :(A!(N / > = (S &'(S? C = R= L = +, ? C () / ! = ?+\ +2 ', ! =1 & K +g 444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444ab !* J F %cb ! +, ! +CH+ /&Q ? ! !* + / > * +> =AB (> ! +2!()?+I/+! R =D ! & ! +C !* N+,>K = G 4444444444444444444444444444444444444444444444444444444444444444444444444444444444ad ! H+ N@ ># F %cd ! N + , =AG 44444444444444444444444444444444444444444444444444444444444444444444444444444444444444444%$ F %c3$ @ N + , !* /+>/ =F & 44444444444444444444444444444444444444444444444444444%$ ! E =AG =A ! !* F [c3 ! ! + = &+C ? /&.4444444444444444444444444444444444444444444444444444444444444444%% L '0 = * ? F [c# G!* M * G /+\ ! @ &+! KT + ! U J+, ! T " " U4444444444444444444444444444444444444444%` F [ca +>/ =F & /&Q +,R/ + N 01 J@/+\ $U4444444444444444444444444%b ! ! !* + ? +C ? > K T# F Vc3 +>/ F = G J (2 G (2 =AG =&'(2 ! ! >/ = / = =+' J / ! 44444444444444444444444444444444444444444444[$ F Vc# 8+0 + C ' ?+I + ? C G (2 =AG =&'(2 ! ' = E N+2 & /&Q = / = =+' J / !4444444444444444444444444444[3 F Vca +>/ /+>/ J (2 +>/ ! +& /&Q G 4444444444444444444444444444444444444444444444444444444[# ! =L +/ R F Vc% + /+>/ J (2 + R!* !(>= J+,!(>= 444444444444444444444444444444444444444444[# ! = /&Q [D +e # F Vc[ + H+0 ! ' J(/= A ? J+,! 444444444444444444444444444444444444444444444444444444444444444444444444[a F VcV ! C = ( K G!* K +>K L +Q /+>/ E @ !* &/N H444444444444444444444444444444444444444[% F Vc` ! C = ( K G!* K +>K f 4444444444444444444444444444444444444444444444444444444444444[% E @ F Vcb G, f+AK !* += 44444444444444444444444444444444444444444444444444444444444444444444444444444[[ ! @* ! F Vcd 8+Q +L(c ! R T=A+> U J+, =+L 44444444444444444444444444444444444444444444444444[` + H+Q &A+ F Vc3$ P S = ()* +> =AB >/ 444444444444444444444444444444444444444444444444444444444444444444444[` ! 1&!* ? * F `c3 ! C H& / G (2 =AG =&'(2 / G G (2 G, / G =1 J J( = =+' J / !0 D / = = @*D J ! J (2 + 444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444444Va = F `c# ! C & / G (2 /&Q 2 / G / G / G = ?+I = =+' + %D dD J (D !D P4444444444444444V% F `ca ! C G (2 / > H+2 (2 = / = =+' J & !* (C = 4444444444444444444444444444444444444444444444444V[ $& ) % '( )* $ & + , '$ / 0( + , $'5 ) % '( $ - , , + ' ' + 62 67 A !* ! G* !+O *+! E+) K G!* K +>K ! +C H+ ! ? ' @ ! !* +/ !( T &KK A= (/= A U E+0 & &>= EG = @ 1G &+! =+) !* () >& /&Q / ! +, + / M ? ! /G + /+> L / J+, E+ G* L= M ! +CH+ = !* ! (& R = +>! ! +CH+ A !* E+0 = ! (2 &+Q ! !* = =A ! +, ! !*4 ! (& =AG, @D / +g + G +C !* / G (2&+!* @* ! K !* ! ! ! ! H+ =M J E+ G* L= M !*+!* R!* /+>/ K G!* K +>K =A&'(! = = ! (2&+Q ! +e @ G!* K +>K @ Y =GQ / ! /&Q @* ! + L T =+= 1= /+N (+A! !* !* () +)N+, C ' ? = ( A'U !() ! +\ (0 R E+Q A+e L= M E+ @ N+, &4 / / = / E(S +Q ? !* (2 &+Q = EG = G / N+, &'(S=+C?+I=GL ) * +! R & H (I / ! K & , !* (S ! / &>!* 1+!* ? C ) * +! = L !* % E+0 ! G?+ (&A+N4 !* !* EG +K! LE( ]&+2 @ / = J+,!+O 3dd[ h3`i4 ? K G!* K +>K HG =A()N'> = &'(2 @ ! + = /= / > ? C =+Q = +>! = !(! !* nnN !(D / / > (& N@ @ A !* L ) * +! / >! !4 !* /&Q + =F ? C ? = &' )* + E(S +) + =+C & !+, ! K +) >K /&Q &>!*D /&0 ( K ! / K ?+I ' HG =A() ! N@ + / + !* / > !* lN+,? A+ ? (! K +) + =G* N@ =A !* L ) * +! R & H (I D E(S + =F ! R /&Q , >K ! !* (S ! =G > ]+>/ EB EG +) >K /&Q C & /+! ! +C !*4 , E ! @ K ! N@ + ? = ?+I / ! H+ ;! ;H ?+I ! +C !* & /+! ! H+ &- , & () +g & K !* ?+\ +) + = K ! / )9) 7: + , (+ , $ , $4 ((, '$ $; $: 20 , ' ' + = '( $ : 7' ' # &0 ! G?+ !* !* (&A+ND K G!* K +>K @ = S M = /+ D / > = (S @ +>K H& / !* &+> EG / !* N+, C G!* K +>K / > = ! ? = K @ ! (& N + +, +>! ! +CH+ L+>/ R = ! !* ! +&4 )* ? 45 '( 7: - + / 0( 7: $5 %1 ' @ ' A B '$ / 0( % A5 E , , , ' ' $ C 7D , 4 %64 E D 30 15 ' P+,= +>! ! +C H+ / G J (2=+' =AG =&'(2 T !N !( ! !* = / ! +!Ho = !* A ;(/ *! = !U N+, C +, +>! / > '> !* l=A !* = G =(2 +' JF +Q Q !* R! ? =R = + / K 1G H& +, K ? E(S +C 0(C ! K HGN & J+, ' = ! D !*G, / > = (S Q !* ? C (2 B ?+> @ =+ 1G H& = = = R * N+, R= E (C=GE(S N()? C +,J(0 ! G / J (2 +e R= = &> ! Q * ! = R! * !* /+> = R!* &> C + E+& R= EG + E /&Q &> @* / H+0 G* = ! '! ! ) = G, !* @*4 ! ! +C = ) M K +! ?(? ! +C !* 1(0 &'(S ! J+, !* &+ ! H+ / ! (C C ' = +, /+>/ / G HG> H+ ?+0 & = + E !+, ! /+> @ !* T ! / H(U ?+, ' / > = (S (SEG ! G ! +C=GR! K ?4 ?+> & @ * !* / N+, K ,+, !+, > = (S !* = &+> =AF ! +C 0(C @ N+, +C , ! K ?D '/ =+O / M ! K HG & ! ! K =G +, N R EG !* =A !* /+>/ = (2 B E C / > L = G>/ ! @ H&, / = RH !* / @ Q8 D T +\ / ?+0 +>/ N+, ? +\ &>!* // R K N( !(UD H&, R! K ? R= = (C !* +, +2 !4 > ! (& K G!* K +>K E+0 @ E( ]&+2 * +Q &'(2 +, +>! !+, A !* @ EG / = E(S M = R = '4 N&+CJ+O ! ! + l !+O 3dd` h%iD =+>/ * +Q *&'(I / ? ! K G!* K +>K / + J&, J (2 = +, /+>/ J&, ! @ !* = A+ ! !* +! G!* E+0 Q !* @ 1GH& Q ! T F 3c#U J+, E > = (2 @ ! 1+& ! +, A&>= =A / E+\ !* /&Q G (2 ! /+>/ J&, !+, +, !* =+>/ * +Q Q ! / =AG + / = =A() J !* '4 /& /&, 1G H& ? C &+C +>! ) &!* == == )/ 0)1 E(S 1+>! E+\ !* /&Q C G ( / =AG +? =/ /+! ! +CH+ J@ /+>/ / G?+IE(S , > =F A+ EG.K +)N@ Tp$pDq ! !* > & =GE ? @ / ! >K DpdpD p pDq pU /&Q G @ J (2 G!* K +>K !(+A(1= !( * RA J@ E C N+, +> =AB Dpr + / = TK @ EG/ > E * = &+C +>! 1+>! / & I ! E C == N !*U4 `% X* , $ '$P < F B ' 2F i A B7-3 $ B > U ,(,4 d , '5 < `[ K* , $ '$ P < -Q1 + A f -A U=6 B(6 -$ D B , + 43 , 43 ' 6 ' , Q2 A 6 O6 -6 I $ , UE 43 , , D , + ' ' `V \* , $ '$ ( > : , C$ , %6 E4 ' ) : ;