๐Ÿฌ ML & Data/โ” Q & etc.

    [MPC] 4. Optimal Control(2) - Taylor Series ์ ์šฉ, Algebraic Riccati Equation(ARE) ๊ตฌํ•˜๊ธฐ

    LQR์— ์ ์šฉ $$V^{*}(x(t), t) = \underset{u[t, t+\Delta t]}{min} \{ \Delta t \cdot l[x(t + \alpha \Delta t), u(t + \alpha \Delta t), t + \alpha \Delta t] + V^{*}(x(t + \Delta t), t+\Delta t) \}$$ ์ด ์‹์—์„œ $V^{*}(x(t + \Delta t), t+\Delta t)$ ๋ถ€๋ถ„์„ ์œ„ Taylor Series๋กœ x์™€ t์— ๋Œ€ํ•ด์„œ ์ •๋ฆฌํ•ด๋ณด์ž. $x = (x(t), t), v = \Delta t$ ๋ผ๊ณ  ์ƒ๊ฐํ•˜์ž. ์ •๋ฆฌํ•˜๋ฉด ์•„๋ž˜์™€ ๊ฐ™๋‹ค. $$V^{*}(x + v) = V^{*}(x) + f'(x)v + f(x)v' + \frac 12 f''(x)v^{2}+ \frac1..

    [MPC] 4. Optimal Control(1) - LQR๊ณผ Taylor Series(ํ…Œ์ผ๋Ÿฌ ๊ธ‰์ˆ˜)

    optimal control ๊ธฐ์ดˆ - LQR(Linear Quadratic Regulator) LQR์ด ๊ธฐ์ดˆ๋ผ์„œ ์š”๊ฑธ๋กœ system : $\dot x = f(x, u, t), x(t_{0}) = x_{0}$ cost function : $$V(x(t_{0}), u, t_{0}) = \int_{t_{0}}^{T} l[x(\tau), u(\tau), \tau]d\tau + m(x(T))$$ ์œ„ cost function์„ ์ตœ์†Œํ™”ํ•˜๋Š” ์ž…๋ ฅ $u^{*}(t), t_{0}\le t \le T$ ์ฐพ๊ธฐ -> optimal control์˜ ๋ชฉ์  principle of optimality ์— ๋”ฐ๋ผ ํ•œ ํ•ด๊ฐ€ ์ตœ์ ์ด๋ฉด sub problem์˜ ํ•ด๋„ ์ตœ์ ์ด ๋œ๋‹ค. $t_{0} < t < t_{1} < T$ ๋กœ $t_{1}$ ์ถ”๊ฐ€..

    [MPC] 3. ์ƒํƒœ(state)์™€ ์ถœ๋ ฅ(output) ์˜ˆ์ธกํ•ด๋ณด๊ธฐ

    Input / Output ์ •๋ฆฌ $N_p$ : ์˜ˆ์ธกํ•˜๋ ค๋Š” ๋ฏธ๋ž˜ ์ถœ๋ ฅ ์ˆ˜ $N_c$ : ์˜ˆ์ธกํ•˜๋ ค๋Š” ๋ฏธ๋ž˜ ์ œ์–ด์ž…๋ ฅ ์ˆ˜ ๊ฒฝ๋กœ ์ถ”์ ์˜ ๊ฒฝ์šฐ, $N_p$๊ฐœ ์ ์„ tracking ํ•˜๊ธฐ ์œ„ํ•œ $N_c$๊ฐœ ์ œ์–ด ๋ช…๋ น... Control Input $\Delta u(k), \Delta u(k+1), \Delta u(k+2), \cdots, \Delta u(k + N_{c} - 1)$ Output $y(k), y(k+1), \cdots, y(k+N_{p})$ $y(k) = Cx(k)$ ์ด๋ฏ€๋กœ $y(k+1) = Cx(k+1), y(k+2) = Cx(k+2), \cdots$ ๋กœ ํ‘œํ˜„ ๊ฐ€๋Šฅ ๋”ฐ๋ผ์„œ ์˜ˆ์ธก state $x(k+1), x(k+2), \cdots, x(k+N_{p})$๋ฅผ ๊ตฌํ•˜๋ฉด ๋จ State variable ๊ตฌํ•˜๊ธฐ $..

    [MPC] 2. ์ƒํƒœ ๊ณต๊ฐ„ ๋ฐฉ์ •์‹ ์œ ๋„

    MPC ์ƒํƒœ ๊ณต๊ฐ„ ๋ฐฉ์ •์‹ ์œ ๋„ ์ƒํƒœ๊ณต๊ฐ• ๋ฐฉ์ •์‹ + LTI(Linear TimeINvariant, ์„ ํ˜• ์‹œ๊ฐ„ ๋ถˆ๋ณ€ ์‹œ์Šคํ…œ)์˜ ๊ฒฝ์šฐ => Continuous-time state-space model ์ƒํƒœ ๋ฐฉ์ •์‹ : $$\bar{x} = Ax + Bu$$ ์ถœ๋ ฅ ๋ฐฉ์ •์‹ : $$y = Cx$$ MPC๋Š” discrete ํ•œ ํ™˜๊ฒฝ => Discrete-time state-space model ์ƒํƒœ ๋ฐฉ์ •์‹ : $$x(k+1) = A_{d}x(k) + B_{d}u(k)$$ ์ถœ๋ ฅ ๋ฐฉ์ •์‹ : $$y(k) = C_{d}x(k)$$ MPC ๊ธฐ๋ณธ ๋ชจ๋ธ์€ Discrete-time aumented state-space model ์ƒํƒœ ๋ณ€์ˆ˜ ๋Œ€์‹  ์ƒํƒœ ๋ณ€์ˆ˜์˜ ๋ณ€ํ™”๋Ÿ‰ $\Delta x$ ์‚ฌ์šฉ ์ƒํƒœ ๋ฐฉ์ •์‹ $${x(k+1) - x(k) ..

    [MPC] 1. Model Predictive Control Intro

    ์œ ํŠœ๋ธŒ https://www.youtube.com/watch?v=zU9DxmNZ1ng&list=PLSAJDR2d_AUtkWiO_U-p-4VpnXGIorrO-&index=1 ๋ธ”๋กœ๊ทธ https://sunggoo.tistory.com/65 ์œ„ ์ž๋ฃŒ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ๊ณต๋ถ€ํ•œ ๋‚ด์šฉ์„ ๊ฐ€๋ณ๊ฒŒ ์ •๋ฆฌํ•˜๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ์ˆ˜์‹ ์ฆ๋ช…์ด ๋งŽ๊ฒ ๊ณ , ๊ทธ ๋’ค๋กœ๋Š” ๋ชฉ์ ์— ๋”ฐ๋ผ ๋…ผ๋ฌธ์ด๋‚˜ ์ฝ”๋“œ ๊ตฌํ˜„์„ ๋ณด๋ฉด์„œ ์ถ”๊ฐ€ํ•ด๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. MPC(Model Predictive Control)์˜ ์ปจ์…‰ ๊ธฐ๊ธฐ ์ƒํƒœ ๋ณ€ํ™”(dynamics) + ์ฃผ๋ณ€ ํ™˜๊ฒฝ ์š”์†Œ => cost function ์ œ์–ด๊ณตํ•™ ๋น„์„ ํ˜• / ๋น„๋ณผ๋ก(Non-linear, Non-convex) ๋Œ€์ƒ ๊ณต๋ถ€ํ•˜๋ฉด์„œ ๋Š๋ผ๊ธฐ์—๋Š” ๊ฐ•ํ™”ํ•™์Šต์˜ ํ–ฅ๊ธฐ๊ฐ€ ์ข€ ์žˆ์Œ Flow k-1 ์ผ ๋•Œ์˜ ์ƒํƒœ ๋ณ€์ˆ˜๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ k+1 ~ ..

    [Math] Mathematics for Machine Learning 2. Linear Algebra

    ๊ทผ๋ž˜์— ์ •๋ง์ด์ง€ ์ˆ˜ํ•™ ๊ณต๋ถ€์˜ ํ•„์š”์„ฑ์„ ๋Š๊ปด์„œ MML ์ด๋ผ๋Š” ๋จธ์‹ ๋Ÿฌ๋‹ ์ˆ˜ํ•™์˜ ๋ฐ”์ด๋ธ” ๊ฐ™์€ ์ฑ…์œผ๋กœ ๊ณต๋ถ€๋ฅผ ์‹œ์ž‘ํ–ˆ๋Š”๋ฐ... ์ผ๋‹จ ์˜์–ด๊ณ (!), ์šฉ์–ด๊ฐ€ ๋„ˆ๋ฌด ๋งŽ๊ณ (!), ๋‚ด์šฉ๋„ ์–ด๋ ค์›Œ์„œ ์•„์ฃผ ์• ๋ฅผ ๋จน๊ณ  ์žˆ๋‹ค. ์–ด์ฐŒ์ €์ฐŒ ์ดํ•ดํ–ˆ๋‹ค๊ณ  ์ƒ๊ฐํ–ˆ๋Š”๋ฐ ์—ฐ์Šต๋ฌธ์ œ๋ฅผ ๋ณด๋‹ˆ๊นŒ ๋˜ ์ด์•ผ~ ๋ชจ๋ฅด๊ฒ ๊ณ  ๋‚œ๋ฆฌ๋‹ค... ๋‹ต์•ˆ์ง€๋ฅผ ๋ด๋„ ์ดํ•ด๊ฐ€ ์–ด๋ ค์šด ๋ถ€๋ถ„์ด ๋งŽ์•„์„œ ๊ผผ๊ผผํ•˜๊ฒŒ ๊ฐ€์ด๋“œ ๋”ฐ๋ผ ๋‘์„ธ๋ฒˆ ํ’€์–ด๋ด์•ผ ์ดํ•ด๊ฐ€ ๋˜์ง€ ์‹ถ๋‹ค. ๊ทผ๋ฐ ๋„ˆ๋ฌด ์–ด๋ ต๋‹ค ใ…Žใ…‹... ์„ ํ˜•๋Œ€์ˆ˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ•ํ–ˆ์—ˆ๋Š”๋ฐ๋„ ๋‚ด๊ฐ€ ๋“ค์—ˆ๋˜ ์„ ํ˜•๋Œ€์ˆ˜ ๊ฐ•์˜์˜ ๋ฒ”์œ„๋ณด๋‹ค ๋” ๋„“์€ ๋“ฏ ํ•˜๋‹ค. ์•„๋ฌดํŠผ ์•„๋ž˜ ๋งํฌ๋Š” ์ฐธ๊ณ ํ•œ ์‚ฌ์ดํŠธ ๋“ฑ. ํ•œ๊ตญ์–ด ๋ฒˆ์—ญ ํ•ด์ฃผ์‹  ์ค€๋ณ„๋‹˜ ์ •๋ง ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค... ๋น„๊ตํ•˜๋ฉฐ ๋ณด๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค... ๊ต์žฌ - pdf ๋ฌด๋ฃŒ ๊ณต๊ฐœ(https://mml-book.github.io/book/mml-boo..

    [Data] ์ „๋™ ๋ชจํ„ฐ ์ด์ƒํƒ์ง€ ๋ฐ ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•œ ์ฃผํŒŒ์ˆ˜ ๋ถ„์„

    1. ๋ฐ์ดํ„ฐ ์ทจ๋“ Sampling rate 25.6kHz DC Motor, ์ž์ฒด ์ œ์ž‘ ์‹คํ—˜ํ™˜๊ฒฝ ๋ฐ์ดํ„ฐ ํŒŒ์ผ ๋‹น 102,400๊ฐœ ํฌ์ธํŠธ 2. FFT ๋ชจํ„ฐ ์ฃผํŒŒ์ˆ˜ ๋ถ„์„ 1. Normal ์ •์ƒ์ƒํƒœ ๋ชจํ„ฐ์˜ ์ฃผํŒŒ์ˆ˜๋Š” ์ง„๋™ ์ฐจ์ˆ˜(Harmonic)๊ฐ€ ๋ฐ˜๋น„๋ก€ํ•œ๋‹ค. ํ˜„์žฌ ์‹คํ—˜ ์„ธํŠธ์˜ ๋ชจํ„ฐ๋Š” ์•ฝ 3600rpm์„ ๊ฐ€์ง€๊ณ  ์žˆ์œผ๋ฏ€๋กœ ์ง„๋™์ฐจ์ˆ˜๋Š” 1์ฐจ 60Hz, 2์ฐจ 120Hz, 3์ฐจ 180Hz๋กœ ์ด๋ฃจ์–ด์ ธ ์žˆ๋‹ค. ์œ„ FFT ์ฃผํŒŒ์ˆ˜ ๋ถ„์„ ๊ฒฐ๊ณผ 1์ฐจ, 2์ฐจ, 3์ฐจ ์ง„๋™ ์ฐจ์ˆ˜ ์ˆœ์œผ๋กœ amplitude๊ฐ€ ๊ฐ์†Œํ•˜๋Š” ๊ฒƒ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค. 2. Misalignment ์˜ค์ •๋ ฌ(Misalignment) ์ƒํƒœ๋Š” Parallel Misalignment(์ง€๋ฉด๊ณผ ๋ชจํ„ฐ์˜ ์ถ•์€ ํ‰ํ–‰ํ•˜๋‚˜ ๋ฒ ์–ด๋ง์„ ๊ธฐ์ค€์œผ๋กœ ๋‹จ์ฐจ๊ฐ€ ์กด์žฌํ•  ๋–„)์™€ Angular Misalign..

    [PyTorch] pretrained model load/save, pretrained model ํŽธ์ง‘

    Load Pretrained model in pytorch Pretrained model pth๋กœ ์ €์žฅ๋œ torch pretrained model(weight)๋ฅผ ๋ถˆ๋Ÿฌ์™€์„œ ์‚ฌ์šฉ weight์˜ ์ผ๋ถ€๋งŒ ๋ถˆ๋Ÿฌ์™€์„œ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋‹ค. pth = dictionary ๋กœ ๊ตฌ์„ฑ๋œ๋‹ค. Get format pth ํŒŒ์ผ์€ Dictionary ํ˜•ํƒœ๋กœ ์ €์žฅ๋˜์–ด ์žˆ๋‹ค. pytorch์˜ load๋ฅผ ํ†ตํ•ด์„œ ๋ถˆ๋Ÿฌ์˜ฌ ์ˆ˜ ์žˆ๋‹ค. import torch model = torch.load('model.pth') print(model.keys()) model.keys() ๋ฅผ ์‚ฌ์šฉํ•ด์„œ key ๊ฐ’๋“ค์„ ๋ถˆ๋Ÿฌ์˜ฌ ์ˆ˜ ์žˆ๋Š”๋ฐ, ์ด๊ฒƒ์œผ๋กœ ๋ชจ๋ธ ๊ตฌ์กฐ๋ฅผ ํŒŒ์•…ํ•  ์ˆ˜ ์žˆ๋‹ค. ํ˜„์žฌ ์˜ˆ์ œ๋กœ ์‚ฌ์šฉํ•˜๊ณ  ์žˆ๋Š” pth ํŒŒ์ผ์€ mobilenet-ssd-v1 ๋ชจ๋ธ์˜ mAP 0..