welcome.pyの実行エラー

[AkihitoToda]

以前の指摘を踏まえて、修正等を行い、welcome.pyを実行したところエラーが出る。何がおかしいか指摘してほしい。

指摘箇所
[〇] Day1: 強化学習の位置づけを知る
Day2: 強化学習の解法(1): 環境から計画を立てる
Day3: 強化学習の解法(2): 経験から計画を立てる
Day4: 強化学習に対するニューラルネットワークの適用
Day5: 強化学習の弱点
Day6: 強化学習の弱点を克服するための手法
Day7: 強化学習の活用領域
ページ番号: p６

実行環境
OS: Windows 10
Python version: 3.7.13
pip freezeの実行結果 (下に添付)
absl-py==0.15.0
astunparse==1.6.3
cachetools==5.0.0
certifi==2021.10.8
charset-normalizer==2.0.12
cloudpickle==1.2.2
cycler==0.11.0
flatbuffers==1.12
fonttools==4.31.2
future==0.18.2
gast==0.4.0
google-auth==2.6.2
google-auth-oauthlib==0.4.6
google-pasta==0.2.0
grpcio==1.34.1
gym==0.14.0
-e git+https://github.com/lusob/gym-ple.git@7cedbf4e31be86f5ca2aae5c0dfd9d38825af64e#egg=gym_ple
h5py==3.1.0
idna==3.3
importlib-metadata==4.11.3
joblib==1.1.0
keras-nightly==2.5.0.dev2021032900
Keras-Preprocessing==1.1.2
kiwisolver==1.4.0
Markdown==3.3.6
matplotlib==3.5.1
numpy==1.19.5
oauthlib==3.2.0
opt-einsum==3.3.0
Pillow==9.0.1
-e git+https://github.com/ntasfi/PyGame-Learning-Environment.git@3dbe79dc0c35559bb441b9359948aabf9bb3d331#egg=ple
protobuf==3.19.4
pyasn1==0.4.8
pyasn1-modules==0.2.8
pygame==2.0.0
pyglet==1.3.2
Pygments==2.11.2
pyparsing==3.0.7
python-dateutil==2.8.2
pywin32==303
requests==2.27.1
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
six==1.15.0
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.5.0
tensorflow-estimator==2.5.0
termcolor==1.1.0
threadpoolctl==3.1.0
tqdm==4.63.1
typing-extensions==3.7.4.3
urllib3==1.26.9
Werkzeug==2.0.3
wincertstore==0.2
wrapt==1.12.1
zipp==3.7.0
エラー内容
(例外のメッセージ、ログ、画面ショットなどを添付)

(rl-book) C:\Users\May1217\baby-steps-of-rl-ja>python welcome.py
2022-04-01 21:34:41.444872: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'cudart64_110.dll'; dlerror: cudart64_110.dll not found
2022-04-01 21:34:41.445852: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
pygame 2.0.0 (SDL 2.0.12, python 3.9.11)
Hello from the pygame community. https://www.pygame.org/contribute.html
couldn't import doomish
Couldn't import doom
C:\Users\May1217\miniconda3\envs\rl-book\lib\site-packages\gym\logger.py:30: UserWarning: �[33mWARN: Environment '<class 'gym_ple.ple_env.PLEEnv'>' has deprecated methods '_step' and '_reset' rather than 'step' and 'reset'. Compatibility code invoked. Set _gym_disable_underscore_compat = True to disable this behavior.�[0m
warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
2022-04-01 21:35:13.657265: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'nvcuda.dll'; dlerror: nvcuda.dll not found
2022-04-01 21:35:13.657446: W tensorflow/stream_executor/cuda/cuda_driver.cc:326] failed call to cuInit: UNKNOWN ERROR (303)
2022-04-01 21:35:13.670938: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:169] retrieving CUDA diagnostic information for host: DESKTOP-BMCCV3C
2022-04-01 21:35:13.671347: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:176] hostname: DESKTOP-BMCCV3C
2022-04-01 21:35:13.725261: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX AVX2
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-04-01 21:35:25.884504: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:176] None of the MLIR Optimization Passes are enabled (registered 2)
Traceback (most recent call last):
File "C:\Users\May1217\baby-steps-of-rl-ja\welcome.py", line 36, in
welcome()
File "C:\Users\May1217\baby-steps-of-rl-ja\welcome.py", line 31, in welcome
n_state, reward, done, info = env.step(a)
File "C:\Users\May1217\miniconda3\envs\rl-book\lib\site-packages\gym\wrappers\time_limit.py", line 16, in step
observation, reward, done, info = self.env.step(action)
File "c:\users\may1217\baby-steps-of-rl-ja\src\gym-ple\gym_ple\ple_env.py", line 32, in _step
reward = self.game_state.act(self._action_set[a])
File "c:\users\may1217\baby-steps-of-rl-ja\src\ple\ple\ple.py", line 376, in act
return sum(self._oneStepAct(action) for i in range(self.frame_skip))
File "c:\users\may1217\baby-steps-of-rl-ja\src\ple\ple\ple.py", line 376, in
return sum(self._oneStepAct(action) for i in range(self.frame_skip))
File "c:\users\may1217\baby-steps-of-rl-ja\src\ple\ple\ple.py", line 395, in _oneStepAct
self._setAction(action)
File "c:\users\may1217\baby-steps-of-rl-ja\src\ple\ple\ple.py", line 411, in _setAction
self.game._setAction(action, self.last_action)
File "c:\users\may1217\baby-steps-of-rl-ja\src\ple\ple\games\base\pygamewrapper.py", line 79, in _setAction
pygame.event.post(ku)
pygame.error: posted event keycode must be int