跳到主要內容

使用RNN模型作語音訊號的除噪

使用RNN模型作語音訊號的除噪

 O​riginal Voice Clip:錄下的人聲語音訊號

 O​ffice Noise:錄下的辦公室背景噪音

 Mixing:前２項混合而成的訊號

 After RNN:透過RNN模型除噪後的語音訊號波形

 By Directional Mic in F15K:筆電上指向型麥克風的所錄下除噪後的波形

結論：透過RNN模型除噪的功能，具有近似指向型麥克風的除噪功能。也就是以軟體處理的技術來取代實體裝置。

 From lower right 2 pictures, voice clip mixed with background noise was restored well in comparison to audio waveform recording by directional mic and original voice clip waveform.


Ref:
https://people.xiph.org/~jm/demo/rnnoise/
https://hacks.mozilla.org/2017/09/rnnoise-deep-learning-noise-suppression/
https://github.com/xiph/rnnoise

mic denoise rnn
        audacity:
        import -> raw data -> Signed 16bit/Little endian/one channel, 48000
        rnn
        frank@frank-GL753VD:~/1T/back0529/mic
        import format: Signed 16 bit mono format
        frank@frank-GL753VD:~/1T/back0529/mic
        ~/1T/back0529/mic/RNNtest/F15K/tsai1.raw  ---->recorded by 2 mic (directional mic)
        ~/1T/back0529/mic/RNNtest/AS3EA/OUTtsai1.pcm  ---->after RNN
        ~/1T/back0529/mic/RNNtest/AS3EA/tsai1.pcm  ----> after Mixing





留言

張貼留言

這個網誌中的熱門文章

DDPG in Torcs within Docker Container

Dockerfile: FROM tensorflow/tensorflow:0.10.0-gpu WORKDIR /home/frank/old_gym_torcs ADD . /home/old_gym_torcs  RUN apt update RUN apt install -y vim xautomation torcs RUN apt-get install -y libjpeg-dev cmake swig python-pyglet python3-opengl libboost-all-dev \         libsdl2-2.0.0 libsdl2-dev libglu1-mesa libglu1-mesa-dev libgles2-mesa-dev \         freeglut3 xvfb libav-tools RUN pip install gym RUN pip install keras==1.1.0 ENV PATH="/usr/games:${PATH}" CMD ["/bin/bash"] viper1 $ docker run --runtime=nvidia -it -e DISPLAY=$DISPLAY -v /tmp/.X11-unix:/tmp/.X11-unix -v /home/frank/old_gym_torcs:/home/old_gym_torcs -v /var/run/docker.sock:/var/run/docker.sock -v /home/frank/gym_torcs:/home/gym_torcs -v /home/frank/gym:/home/gym -p 3101:3101 --workdir /home/old_gym_torcs -p 8888:8888 ddpgfrk:tf0.10 /bin/bash (grey part is not necessary) After  $ docker commit id ddpg:tf0.10.0-gpu viper1 $ docker r...
張貼留言
閱讀完整內容

增強式學習

   迴力球遊戲－ATARI     賽車遊戲DQN－ATARI 賽車遊戲－TORCS Ref:     李宏毅老師 YOUTUBE DRL 1-3 On-policy VS Off-policy On-policy     The agent learned and the agent interacting with the environment is the same     阿光自已下棋學習 Off-policy     The agent learned and the agent interacting with the environment is different     佐助下棋，阿光在旁邊看 Add a baseline:     It is possible that R is always positive     So R subtract a expectation value Policy in " Policy Gradient" means output action, like left/right/fire gamma-discounted rewards: 時間愈遠的貢獻，降低其權重 Reward Function & Action is defined in prior to training MC v.s. TD MC 蒙弟卡羅: critic after episode end : larger variance(cuz conditions differ a lot in every episode), unbiased (judge until episode end, more fair) TD: Temporal-difference approach: critic during episode :smaller variance, biased maybe atari : a3c  ...
張貼留言
閱讀完整內容