跳到主要內容

DQN-Atari-Enduro porting


For
https://github.com/matrixBT/DQN-Atari-Enduro

Dockerfile:
FROM tensorflow/tensorflow:1.12.0-gpu-py3 

 #https://github.com/yanpanlau/DDPG-Keras-Torcs
WORKDIR /home/frank/rl/DQN-Atari-Enduro
ADD . /home/DQN-Atari-Enduro

 RUN apt-get update
RUN apt-get install -y vim xautomation torcs
RUN apt-get install -y libjpeg-dev cmake swig python-pyglet python3-opengl libboost-all-dev \
        libsdl2-2.0.0 libsdl2-dev libglu1-mesa libglu1-mesa-dev libgles2-mesa-dev \
        freeglut3 xvfb libav-tools

 #optional gtags
RUN apt-get install -y exuberant-ctags libncurses-dev

 RUN pip install jupyter scipy gym
RUN pip install "gym[atari]"
RUN pip install keras-rl
RUN pip install https://pypi.python.org/packages/68/c3/300c6f92b21886b0fe42c13f3a39a06c6cb90c9fbb1b71da85fe59091a7d/pyglet-1.2.4-py3-none-any.whl#md5=08e6404a678f91b4eee85eb33b028d88 
ENV PATH="/usr/games:${PATH}"

CMD ["/bin/bash"]

 launch jupyter notebook within docker container:
1.
(~/rl/DQN-Atari-Enduro) viper1 $ docker run --runtime=nvidia -it -e DISPLAY=$DISPLAY -e XAUTHORITY=$XAUTHORITY -v /tmp/.X11-unix:/tmp/.X11-unix -v /home/frank/rl/DQN-Atari-Enduro:/home/DQN-Atari-Enduro -v /var/run/docker.sock:/var/run/docker.sock --workdir /home/DQN-Atari-Enduro -p 8888:8888 tensorflow/tensorflow:DQN-Atari-Enduro /bin/bash

2.
root@9da3183dad9e:/home/DQN-Atari-Enduro# jupyter notebook --ip 0.0.0.0 --no-browser --allow-root --port 8888

3.
open browser in host and paste
http://localhost:8888

4.
then input token from step2

留言

張貼留言

這個網誌中的熱門文章

A3C in ATARI Pong-V0

ATARI PONG 對戰模式，左邊為遊戲程式，右邊為訓練中的A3C模型。一局以21分決勝負，對手MISS 一球得一分。從LOG可以看出，A3C模型從最初全敗的輸21分，經過2小時左右的TRAINING，已經逆轉至幾乎每局都勝利，偶爾甚至勝出高達13分。 底下為TRAINING A3C MODEL過程的LOG， (base) frank@viper1:~/a3c$ python main.py --env-name "Pong-v0" --num-processes 8 Time 00h 00m 10s, episode reward -21.0, episode length 1026 Time 00h 01m 18s, episode reward -21.0, episode length 1020 Time 00h 02m 26s, episode reward -21.0, episode length 1029 Time 00h 03m 35s, episode reward -21.0, episode length 1023 Time 00h 04m 42s, episode reward -21.0, episode length 1014 Time 00h 05m 50s, episode reward -21.0, episode length 1087 Time 00h 07m 00s, episode reward -21.0, episode length 1359 Time 00h 08m 14s, episode reward -16.0, episode length 1922 Time 00h 09m 30s, episode reward -14.0, episode length 2220 Time 00h 10m 48s, episode reward -15.0, episode length 2431 Time 00h 12m 04s, episode reward -15.0, episode length 2211 Time 00h 13m 23s, episode reward -8.0, episode length 2600 Time 00h 14m 38s, episod...
張貼留言
閱讀完整內容

DDPG in Torcs within Docker Container

Dockerfile: FROM tensorflow/tensorflow:0.10.0-gpu WORKDIR /home/frank/old_gym_torcs ADD . /home/old_gym_torcs  RUN apt update RUN apt install -y vim xautomation torcs RUN apt-get install -y libjpeg-dev cmake swig python-pyglet python3-opengl libboost-all-dev \         libsdl2-2.0.0 libsdl2-dev libglu1-mesa libglu1-mesa-dev libgles2-mesa-dev \         freeglut3 xvfb libav-tools RUN pip install gym RUN pip install keras==1.1.0 ENV PATH="/usr/games:${PATH}" CMD ["/bin/bash"] viper1 $ docker run --runtime=nvidia -it -e DISPLAY=$DISPLAY -v /tmp/.X11-unix:/tmp/.X11-unix -v /home/frank/old_gym_torcs:/home/old_gym_torcs -v /var/run/docker.sock:/var/run/docker.sock -v /home/frank/gym_torcs:/home/gym_torcs -v /home/frank/gym:/home/gym -p 3101:3101 --workdir /home/old_gym_torcs -p 8888:8888 ddpgfrk:tf0.10 /bin/bash (grey part is not necessary) After  $ docker commit id ddpg:tf0.10.0-gpu viper1 $ docker r...
張貼留言
閱讀完整內容

Loss function

why cross entroy is more suitable for categorical classcification? ref: https://www.youtube.com/watch?v=Li5sVEXTIJw
張貼留言
閱讀完整內容