728x90

๊ฐœ๋ฐœ์ž 29

[Python] ํŒ๋‹ค์Šค ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„(pandas dataframe) SettingWithCopyWarning ํ•ด๊ฒฐ

๊ธฐ์กด ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„ ์ผ๋ถ€๋ฅผ ๋ณต์‚ฌํ•˜๊ฑฐ๋‚˜ ์ธ๋ฑ์‹ฑ ํ›„ ๊ฐ’์„ ์ˆ˜์ •ํ•  ๋•Œ ์ข…์ข… ๋ฐœ์ƒํ•œ๋‹ค. ๊ธฐ์กด ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„์„ ๊ฐ€์ ธ์™€(๋ณต์‚ฌ) ๋‹ค๋ฅธ ๋ฐ์ดํ„ฐํ”„๋ ˆ์ž„์„ ๋งŒ๋“ค ๋•Œ ์›๋ณธ์„ ์ˆ˜์ •ํ•  ์ง€ ๋ณต์‚ฌ๋ณธ์„ ์ˆ˜์ •ํ•  ์ง€ ๋ชฐ๋ผ์„œ ๋ฐœ์ƒํ•˜๋Š” ์˜ค๋ฅ˜๋ผ๊ณ  ํ•œ๋‹ค. ๋‘ ๊ฐ€์ง€ ํ•ด๊ฒฐ ๋ฐฉ๋ฒ•์ด ์žˆ๋Š”๋ฐ, ํ•˜๋‚˜๋Š” ๊ฒฝ๊ณ ๋ฅผ ๋ฌด์‹œํ•˜๋Š” ๊ฒƒ์ด๊ณ  ํ•˜๋‚˜๋Š” copy๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ! 1. ๊ฒฝ๊ณ  ๋ฌด์‹œ pd.set_option์„ ์‚ฌ์šฉํ•œ ๊ฒฝ๊ณ ๋ฌธ ์ œ๊ฑฐ # SettingWithCopyError --> ์˜ค๋ฅ˜ raise ๋กœ ์ฝ”๋“œ ์‹คํ–‰ X pd.set_option('mode.chained_assignment', 'raise') # SettingWithCopyWarning --> ์‹คํ–‰์€ ๋˜์ง€๋งŒ ๊ฒฝ๊ณ ๋ฌธ ๋œธ pd.set_option('mode.chained_assignment', 'warn') # err..

[Python] ํŒ๋‹ค์Šค concat, append, join, merge ์ฐจ์ด

Pandas concat vs append vs join vs merge Concat gives the flexibility to join based on the axis( all rows or all columns) Append is the specific case(axis=0, join='outer') of concat Join is based on the indexes (set by set_index) on how variable =['left','right','inner','couter'] Merge is based on any particular column each of the two dataframes, this columns are variables on like 'left_on', 'ri..

[GitHub] ์›๊ฒฉ ์ €์žฅ์†Œ, ๋กœ์ปฌ ์ €์žฅ์†Œ, remote, push, clone, pull

1 . git clone ๋ช…๋ น์–ด๋กœ ๋กœ์ปฌ ์ €์žฅ์†Œ ์ƒ์„ฑํ•˜๊ธฐ git clone [๋‚ด ์›๊ฒฉ ์ €์žฅ์†Œ url] master ๋ธŒ๋žœ์น˜ ํด๋ก  git clone -b [๋ธŒ๋žœ์น˜๋ช…] [์›๊ฒฉ ์ €์žฅ์†Œ url] ํŠน์ • ๋ธŒ๋žœ์น˜ ํด๋ก  2. git remote ๋ช…๋ น์–ด๋กœ ์›๊ฒฉ ์ €์žฅ์†Œ, ๋กœ์ปฌ ์ €์žฅ์†Œ ์—ฐ๊ฒฐํ•˜๊ธฐ git remote ์—ฐ๊ฒฐ๋œ ์›๊ฒฉ(remote) ์ €์žฅ์†Œ ์—†์œผ๋ฉด ์•„๋ฌด๊ฒƒ๋„ ์ถœ๋ ฅ X git remote add origin [์›๊ฒฉ ์ €์žฅ์†Œ url] ์›๊ฒฉ ์ €์žฅ์†Œ ์—ฐ๊ฒฐ git remote show [์›๊ฒฉ ์ €์žฅ์†Œ ์ด๋ฆ„] ์›๊ฒฉ ์ €์žฅ์†Œ ์„ธ๋ถ€ ์ •๋ณด ๋ณด๊ธฐ 3. git push ๋กœ์ปฌ ์ €์žฅ์†Œ์— ๋ณ€๊ฒฝ๋œ ํŒŒ์ผ๋“ค์„ ์›๊ฒฉ ์ €์žฅ์†Œ์— ์˜ฌ๋ฆฌ๊ธฐ git add . # ๋ณ€๊ฒฝ๋œ ๋ชจ๋“  ํŒŒ์ผ ์ถ”๊ฐ€ git commit -m "์ปค๋ฐ‹ ๋ฉ”์‹œ์ง€" git push origin master #..

Git 2021.03.04

[GitHub] ๋ธŒ๋žœ์น˜ ๋ฎ์–ด ์”Œ์šฐ๊ธฐ

๋ณ€๊ฒฝ๋œ Upstream branch๋ฅผ develop branch๋กœ ๋ฎ์–ด์”Œ์šฐ๊ธฐ (์ตœ์‹ ์ƒํƒœ๋ฅผ pull) upstream์„ remote๋กœ ๋“ฑ๋ก upstream ๋‚ด์šฉ fetch develop branch์™€ upstream ๋ณ‘ํ•ฉ -> ์—ฌ๊ธฐ๊นŒ์ง€ ํ•˜๋ฉด ๋‚ด ์ฝ”๋“œ๊ฐ€ ์ตœ์‹  ์ฝ”๋“œ๋กœ ๋ฐ”๋€œ ๋‹ค์Œ ์ž‘์—…์„ ์œ„ํ•ด ์ง€๊ธˆ develop branch๋ฅผ push git remote add upstream "upstream git ์ฃผ์†Œ" git fetch upstream git merge upstream/develop git push origin develop (merge๋Š” upstream์ด ์ตœ์‹  ์ƒํƒœ๊ฐ€ ๋˜์—ˆ๋‹ค๋Š” ๋œป, ๋‚˜์™€ ํ˜‘์—…์ž๋“ค์€ ์ด ์ตœ์‹ ์˜ upstream์„ ๋‹ค์‹œ pull๋ฐ›์•„ ์ตœ์‹  ํ™˜๊ฒฝ์—์„œ ์ƒˆ๋กญ๊ฒŒ ์ž‘์—…ํ•ด์•ผํ•จ) ์ฐธ๊ณ : medium.com/..

Git 2021.03.04

[RNN] 2. Vanialla RNN, LSTM(Long Short-Term Memory), GRU(Gated Recurrent Unit)

์ˆœ์ฐจ ๋ฐ์ดํ„ฐ๋ฅผ ์–ด๋–ป๊ฒŒ ์ˆœํ™˜ ์‹ ๊ฒฝ๋ง์„ ํ†ตํ•ด ์ฒ˜๋ฆฌํ•˜๋Š”์ง€ ์•Œ์•„๋ณด์ž. ๊ธฐ์–ต ์‹œ์Šคํ…œ ๋งŒ์•ฝ ์‹œ๋ฆฌ ๊ฐ™์€ ๊ฐœ์ธ ๋น„์„œ์˜ ๊ฒฝ์šฐ ์˜ฌ๋ฐ”๋ฅธ ๋Œ€๋‹ต์„ ํ•˜๋ ค๋ฉด ์ž…๋ ฅ์„ ๋ฐ›์„ ๋•Œ๋งˆ๋‹ค ๊ทธ ๋‚ด์šฉ์„ ๊ธฐ์–ตํ•ด์•ผ ํ•œ๋‹ค. ๋ฐ˜๋Œ€๋กœ ์ด์ „ ์ž…๋ ฅ์„ ๊ธฐ์–ตํ•˜์ง€ ์•Š๋Š” ์‹œ์Šคํ…œ์€ ๋ฌด๊ธฐ์–ต ์‹œ์Šคํ…œ์ด๋ผ ํ•œ๋‹ค. ์–•์€ ์‹ ๊ฒฝ๋ง(Shallow Neural Network)์ด ๋ฌด๊ธฐ์–ต ์‹œ์Šคํ…œ์˜ ์˜ˆ์‹œ n๋ฒˆ์งธ Time-Step์— ๋Œ€ํ•œ ๊ฒฐ๊ณผ๊ฐ€ ์ด์ „ ์ž…๋ ฅ์— ์˜ํ–ฅ ๋ฐ›์ง€ ์•Š๋Š”๋‹ค. ๊ธฐ๋ณธ์ ์ธ ์ˆœํ™˜ ์‹ ๊ฒฝ๋ง (Vanilla Recurrent Network) Vanilla RNN์˜ ๊ตฌ์กฐ๋Š” shallow NN ๊ตฌ์กฐ์— '์ˆœํ™˜(recurrent)'์ด ์ถ”๊ฐ€๋œ ๊ฒƒ์ด๋‹ค. ์ˆœํ™˜: n-1๋ฒˆ์งธ time step์ด n๋ฒˆ์งธ time step์œผ๋กœ ๋‹ค์‹œ ๋Œ์•„์˜ค๋Š” ๊ฒƒ ๊ธฐ์–ต ์‹œ์Šคํ…œ์ด๋ฏ€๋กœ RNN์˜ ์ถœ๋ ฅ์€ ์ด์ „์˜ ๋ชจ๋“  ์ž…๋ ฅ์— ์˜ํ–ฅ..

[RNN] ์ˆœํ™˜ ์‹ ๊ฒฝ๋ง (RNN, Recurrent Neural Network) - 1. ์ˆœ์ฐจ ๋ฐ์ดํ„ฐ

์ˆœํ™˜ ์‹ ๊ฒฝ๋ง์€ ์ž…๋ ฅ์ด๋‚˜ ์ถœ๋ ฅ์„ ์ˆœ์ฐจ ๋ฐ์ดํ„ฐ๋กœ ๋ฝ‘๊ธฐ ์œ„ํ•œ ์‹ ๊ฒฝ๋ง์ด๋‹ค. ๋”ฐ๋ผ์„œ ์ˆœ์ฐจ ๋ฐ์ดํ„ฐ(Sequential Data)์— ๋Œ€ํ•œ ์ดํ•ด๊ฐ€ ํ•„์š”ํ•˜๋‹ค. ์ˆœ์ฐจ๋ฐ์ดํ„ฐ๋ž€? ์ˆœ์„œ๊ฐ€ ๋‹ฌ๋ผ์งˆ ๊ฒฝ์šฐ ์˜๋ฏธ๊ฐ€ ์†์ƒ๋˜๋Š” ๋ฐ์ดํ„ฐ, ์ฆ‰ ์ˆœ์„œ๊ฐ€ ์˜๋ฏธ์žˆ๋Š” ๋ฐ์ดํ„ฐ ์‹œ๊ฐ„์  ์˜๋ฏธ๊ฐ€ ์žˆ๋Š” ๊ฒฝ์šฐ temporal sequence ์ผ์ •ํ•œ ์‹œ๊ฐ„์ฐจ๋ผ๋ฉด time series ex) DNA ์—ผ๊ธฐ ์„œ์—ด(sequential data), ๊ธฐ์˜จ ๋ณ€ํ™”(temporal sequence), ์ƒ˜ํ”Œ๋ง๋œ ์†Œ๋ฆฌ ์‹ ํ˜ธ(time series) โ€ป Resampling (๋ณด๊ฐ„ + ์ƒ˜ํ”Œ๋ง) Temporal Sequence ์‹ ํ˜ธ๋ฅผ Time Series๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ ์œ„ํ•ด ์‹ ํ˜ธ๋ฅผ ๋ณด๊ฐ„(interpolation)ํ•˜๊ณ  ์ด๋ฅผ ๊ท ์ผ ์‹œ๊ฐ„ ๊ฐ„๊ฒฉ์œผ๋กœ sampling ํ•œ๋‹ค. ์ˆœ์ฐจ ๋ฐ์ดํ„ฐ์™€ ์‹ฌ์ธต ์‹ ๊ฒฝ๋ง ์ˆœ..

[Deep Learning] Semantic Segmentation - Deconvolution, Upsampling

CNN(Convolutional Neural Network)์˜ convolution layer๋Š” convolution์„ ํ†ตํ•ด์„œ feature map์˜ ํฌ๊ธฐ๋ฅผ ์ค„์ธ๋‹ค. Deconvolution์€ CNN์˜ ์—ญ์—ฐ์‚ฐ์œผ๋กœ CNN๊ณผ ๋ฐ˜๋Œ€๋กœ feature map์˜ ํฌ๊ธฐ๋ฅผ ์ฆ๊ฐ€์‹œํ‚จ๋‹ค. ์ด๋Ÿฐ Deconvolution์€ ์–ด๋””์— ์“ฐ์ผ๊นŒ? ๋ฐ”๋กœ Semantic Segmantation์ด๋‹ค. Semantic Segmentation์ด๋ž€ Computer Vision Tasks๋“ค ์ค‘ ํ•˜๋‚˜์ด๋‹ค. ์œ„์˜ ๊ทธ๋ฆผ์— ์ž˜ ์„ค๋ช…๋˜์–ด ์žˆ๋Š”๋ฐ, Object Detection์€ ๋ฌผ์ฒด๊ฐ€ ์žˆ๋Š” ์œ„์น˜๋ฅผ ์ฐพ์•„ Bounding Box๋ฅผ ๊ทธ๋ฆฌ๋Š” ์ž‘์—…์ด๊ณ  Semantic Segmentation์ด๋ž€, ์ด๋ฏธ์ง€๋ฅผ ํ”ฝ์…€ ๋‹จ์œ„๋กœ ๊ตฌ๋ถ„ํ•ด ๊ฐ ํ”ฝ์…€์ด ์–ด๋–ค object class..

728x90