跳到主要內容

Optical flow光流

Pictures of optical flow by Matlab:







History:
https://vision.in.tum.de/research/optical_flow_estimation

optical flow:
Lucas-Kanade  LK法
Gunnar Farneback
Horn-Schunck  HS法
Thomas Brox's Algorithm as shown in the folder "eccv2004Matlab"

thomas brox:
https://lmb.informatik.uni-freiburg.de/Publications/2004/Bro04a/brox_eccv04_of.pdf
a robust data term with a brightness constancy and
a gradient constancy assumption,
combined with a discontinuitypreserving spatio-temporal TV regulariser.
smaller angular error

https://www.mathworks.com/matlabcentral/fileexchange/17500-high-accuracy-optical-flow

use of optical flow:
Object Tracking
video compression
motion based segmentation
structure from motion(3D shape and motion)
alignment
Alignment(global motion compensation)
camcorder video stabilization
UAV video analysis

FlowNet
SpyNet
FlowNet2.0


       
docker run -it  -v /home/frank/1T/back0529/Downloads/Mathworks_Matlab_R2015a_Linux:/home/frank/Mathworks_Matlab_R2015a_Linux nvidia/caffe /bin/bash
       
 


1.Capture pictures from a video clip by ffmpeg
       
frank@frank-GL753VD:~$ ffmpeg -i ~/Downloads/UCF-101/ApplyEyeMakeup/v_ApplyEyeMakeup_g00_c01.avi -r 30 ~/Downloads/out1/v_ApplyEyeMakeup_g00_c01.%4d.jpg
frank@frank-GL753VD:~/Videos/flow$ ffmpeg -i /home/frank/Videos/rotate1.webm -r 30 /home/frank/Videos/flow/frames/rotate1/rotate1_0001/rotate1.%4d.jpg       
 

2.CNN
開機時,執行daemon, 指示使用者作出指定的動作,並將影像記錄下來。





       
frank@frank-GL753VD:~/docker$ docker run -it -v /tmp/matlab:/home/frank/matlab nvidia/caffe /bin/bash
root@979aeb1c480d:/# cd /home/frank/matlab/
root@979aeb1c480d:/home/frank/matlab# ls
activate.ini  bin  frk.txt  install            installer_input.txt  license_agreement.txt  readme.txt  trademarks.txt
archives      etc  help     install_guide.pdf  java                 patents.txt            sys         version.txt
root@979aeb1c480d:/home/frank/matlab# ./install 
Preparing installation files ...
Installing ...
---------------------------------------------------------------------------
Error: Installation cannot proceed. You may either:
1. Set an X11 display, and restart the install process
2. Use the silent install feature by specifying the -mode silent option
---------------------------------------------------------------------------
Finished
root@979aeb1c480d:/home/frank/matlab#

$ docker run -it -v /tmp/matlab:/home/frank/matlab -e DISPLAY=192.168.59.3:0 nvidia/caffe /bin/bash       
 

mount Mathworks Matlab R2015a Linux/R2015a-glnxa64.iso /media/cdrom -o loop

download matlab mex:
https://lmb.informatik.uni-freiburg.de/resources/software.php

download matlab
https://www.nguyenquanbahong.com/2017/04/27/note-install-crack-matlab-r2015a-64-bit-ubuntu-17-04/

What is an M file?
An M file is a class implementation file used by programs written in Objective-C.
An M file is a text file used by MATLAB




Ref:
Long-term Recurrent Convolutional Networks for Visual Recognition and Description.
https://people.eecs.berkeley.edu/~lisa_anne/LRCN_video

留言

這個網誌中的熱門文章

OCR應用在電子元件上的辨識

 OCR Application Example1: for SMD idenfication : Text detect by CRAFT   OCR文字偵測 原始照片為網路上下載,再套上OCR文字偵測顯示結果,若有侵權請告知移除 彩色區域為偵測到文字的部份 Output 10 coordinates of corresponding text blocks 1.  144,196,286,194,287,259,145,261 2.  298,198,509,196,509,259,298,262 3.  148,262,286,262,286,321,148,321 4.  368,266,513,264,513,321,369,323 5.  145,331,472,333,471,395,145,393 6.  146,404,445,404,445,454,146,454 7.  146,453,512,453,512,502,146,502 8.  147,502,481,499,481,551,148,553 9.  148,550,614,550,614,600,148,600 10.513,600,714,600,714,648,513,648  After image pre-processing:    OCR result1:   After image pre-processing:  OCR result2:     Example2: for datasheet interpretation : Text detect of TI datasheet by CRAFT OCR results: ([[75, 11], [127, 11], [127, 31], [75, 31]], 'TEXAS', 0.999188403930061) ([[474, 4], [928, 4], [928, 32], [474, 32]], 'PACKAGE MATERIALS INFORMATION', 0.6743955072876302) ([[77, 29],...

Face recognition

. . . . . even with mask