• windows系统下最新版gym[atari]中的游戏环境(此时最新版的gym为0.24.0,gym==0.24.0)


    关于gym[atari]的安装参看以前的博文:

    windows系统下安装最新版gym的安装方法(此时最新版的gym为0.24.0,gym==0.24.0)

    上代码:

    import time
    import gym
    
    print("游戏ID:\t\t\t\t\t\t\t\t 游戏名:\t\t\t\t\t\t\t\t  游戏类型:")
    for env in gym.envs.registry.values():
        print('{:<35}  {:<35}  {:<15}'.format(env.id, env.name, env.entry_point.split(':')[1]))
    
    print("\n\n游戏环境detail:")
    print(env)
    print(type(gym.envs.registry.keys()))
    print(type(gym.envs.registry.values()))
    
    print("\n\n环境测试阶段:")
    a_time = time.time()
    num = 0
    for env in gym.envs.registry.values():
        try:
            env = gym.make(env.id, render_mode='human')
            obs = env.reset()
            for i in range(10):
                action = env.action_space.sample()
                obs, reward, done, info = env.step(action)
                # time.sleep(0.01)
            env.close()
        except Exception:
            num+=1
            print(env)
    print("报错环境数为:", num)
    print("用时:", time.time()-a_time)

     

    运行结果:

    游戏ID:                                 游戏名:                                  游戏类型:
    ALE/Tetris-v5                        Tetris                               AtariEnv       
    ALE/Tetris-ram-v5                    Tetris-ram                           AtariEnv       
    ALE/Adventure-v5                     Adventure                            AtariEnv       
    ALE/Adventure-ram-v5                 Adventure-ram                        AtariEnv       
    ALE/AirRaid-v5                       AirRaid                              AtariEnv       
    ALE/AirRaid-ram-v5                   AirRaid-ram                          AtariEnv       
    ALE/Alien-v5                         Alien                                AtariEnv       
    ALE/Alien-ram-v5                     Alien-ram                            AtariEnv       
    ALE/Amidar-v5                        Amidar                               AtariEnv       
    ALE/Amidar-ram-v5                    Amidar-ram                           AtariEnv       
    ALE/Assault-v5                       Assault                              AtariEnv       
    ALE/Assault-ram-v5                   Assault-ram                          AtariEnv       
    ALE/Asterix-v5                       Asterix                              AtariEnv       
    ALE/Asterix-ram-v5                   Asterix-ram                          AtariEnv       
    ALE/Asteroids-v5                     Asteroids                            AtariEnv       
    ALE/Asteroids-ram-v5                 Asteroids-ram                        AtariEnv       
    ALE/Atlantis-v5                      Atlantis                             AtariEnv       
    ALE/Atlantis-ram-v5                  Atlantis-ram                         AtariEnv       
    ALE/Atlantis2-v5                     Atlantis2                            AtariEnv       
    ALE/Atlantis2-ram-v5                 Atlantis2-ram                        AtariEnv       
    ALE/Backgammon-v5                    Backgammon                           AtariEnv       
    ALE/Backgammon-ram-v5                Backgammon-ram                       AtariEnv       
    ALE/BankHeist-v5                     BankHeist                            AtariEnv       
    ALE/BankHeist-ram-v5                 BankHeist-ram                        AtariEnv       
    ALE/BasicMath-v5                     BasicMath                            AtariEnv       
    ALE/BasicMath-ram-v5                 BasicMath-ram                        AtariEnv       
    ALE/BattleZone-v5                    BattleZone                           AtariEnv       
    ALE/BattleZone-ram-v5                BattleZone-ram                       AtariEnv       
    ALE/BeamRider-v5                     BeamRider                            AtariEnv       
    ALE/BeamRider-ram-v5                 BeamRider-ram                        AtariEnv       
    ALE/Berzerk-v5                       Berzerk                              AtariEnv       
    ALE/Berzerk-ram-v5                   Berzerk-ram                          AtariEnv       
    ALE/Blackjack-v5                     Blackjack                            AtariEnv       
    ALE/Blackjack-ram-v5                 Blackjack-ram                        AtariEnv       
    ALE/Bowling-v5                       Bowling                              AtariEnv       
    ALE/Bowling-ram-v5                   Bowling-ram                          AtariEnv       
    ALE/Boxing-v5                        Boxing                               AtariEnv       
    ALE/Boxing-ram-v5                    Boxing-ram                           AtariEnv       
    ALE/Breakout-v5                      Breakout                             AtariEnv       
    ALE/Breakout-ram-v5                  Breakout-ram                         AtariEnv       
    ALE/Carnival-v5                      Carnival                             AtariEnv       
    ALE/Carnival-ram-v5                  Carnival-ram                         AtariEnv       
    ALE/Casino-v5                        Casino                               AtariEnv       
    ALE/Casino-ram-v5                    Casino-ram                           AtariEnv       
    ALE/Centipede-v5                     Centipede                            AtariEnv       
    ALE/Centipede-ram-v5                 Centipede-ram                        AtariEnv       
    ALE/ChopperCommand-v5                ChopperCommand                       AtariEnv       
    ALE/ChopperCommand-ram-v5            ChopperCommand-ram                   AtariEnv       
    ALE/CrazyClimber-v5                  CrazyClimber                         AtariEnv       
    ALE/CrazyClimber-ram-v5              CrazyClimber-ram                     AtariEnv       
    ALE/Crossbow-v5                      Crossbow                             AtariEnv       
    ALE/Crossbow-ram-v5                  Crossbow-ram                         AtariEnv       
    ALE/Darkchambers-v5                  Darkchambers                         AtariEnv       
    ALE/Darkchambers-ram-v5              Darkchambers-ram                     AtariEnv       
    ALE/Defender-v5                      Defender                             AtariEnv       
    ALE/Defender-ram-v5                  Defender-ram                         AtariEnv       
    ALE/DemonAttack-v5                   DemonAttack                          AtariEnv       
    ALE/DemonAttack-ram-v5               DemonAttack-ram                      AtariEnv       
    ALE/DonkeyKong-v5                    DonkeyKong                           AtariEnv       
    ALE/DonkeyKong-ram-v5                DonkeyKong-ram                       AtariEnv       
    ALE/DoubleDunk-v5                    DoubleDunk                           AtariEnv       
    ALE/DoubleDunk-ram-v5                DoubleDunk-ram                       AtariEnv       
    ALE/Earthworld-v5                    Earthworld                           AtariEnv       
    ALE/Earthworld-ram-v5                Earthworld-ram                       AtariEnv       
    ALE/ElevatorAction-v5                ElevatorAction                       AtariEnv       
    ALE/ElevatorAction-ram-v5            ElevatorAction-ram                   AtariEnv       
    ALE/Enduro-v5                        Enduro                               AtariEnv       
    ALE/Enduro-ram-v5                    Enduro-ram                           AtariEnv       
    ALE/Entombed-v5                      Entombed                             AtariEnv       
    ALE/Entombed-ram-v5                  Entombed-ram                         AtariEnv       
    ALE/Et-v5                            Et                                   AtariEnv       
    ALE/Et-ram-v5                        Et-ram                               AtariEnv       
    ALE/FishingDerby-v5                  FishingDerby                         AtariEnv       
    ALE/FishingDerby-ram-v5              FishingDerby-ram                     AtariEnv       
    ALE/FlagCapture-v5                   FlagCapture                          AtariEnv       
    ALE/FlagCapture-ram-v5               FlagCapture-ram                      AtariEnv       
    ALE/Freeway-v5                       Freeway                              AtariEnv       
    ALE/Freeway-ram-v5                   Freeway-ram                          AtariEnv       
    ALE/Frogger-v5                       Frogger                              AtariEnv       
    ALE/Frogger-ram-v5                   Frogger-ram                          AtariEnv       
    ALE/Frostbite-v5                     Frostbite                            AtariEnv       
    ALE/Frostbite-ram-v5                 Frostbite-ram                        AtariEnv       
    ALE/Galaxian-v5                      Galaxian                             AtariEnv       
    ALE/Galaxian-ram-v5                  Galaxian-ram                         AtariEnv       
    ALE/Gopher-v5                        Gopher                               AtariEnv       
    ALE/Gopher-ram-v5                    Gopher-ram                           AtariEnv       
    ALE/Gravitar-v5                      Gravitar                             AtariEnv       
    ALE/Gravitar-ram-v5                  Gravitar-ram                         AtariEnv       
    ALE/Hangman-v5                       Hangman                              AtariEnv       
    ALE/Hangman-ram-v5                   Hangman-ram                          AtariEnv       
    ALE/HauntedHouse-v5                  HauntedHouse                         AtariEnv       
    ALE/HauntedHouse-ram-v5              HauntedHouse-ram                     AtariEnv       
    ALE/Hero-v5                          Hero                                 AtariEnv       
    ALE/Hero-ram-v5                      Hero-ram                             AtariEnv       
    ALE/HumanCannonball-v5               HumanCannonball                      AtariEnv       
    ALE/HumanCannonball-ram-v5           HumanCannonball-ram                  AtariEnv       
    ALE/IceHockey-v5                     IceHockey                            AtariEnv       
    ALE/IceHockey-ram-v5                 IceHockey-ram                        AtariEnv       
    ALE/Jamesbond-v5                     Jamesbond                            AtariEnv       
    ALE/Jamesbond-ram-v5                 Jamesbond-ram                        AtariEnv       
    ALE/JourneyEscape-v5                 JourneyEscape                        AtariEnv       
    ALE/JourneyEscape-ram-v5             JourneyEscape-ram                    AtariEnv       
    ALE/Kaboom-v5                        Kaboom                               AtariEnv       
    ALE/Kaboom-ram-v5                    Kaboom-ram                           AtariEnv       
    ALE/Kangaroo-v5                      Kangaroo                             AtariEnv       
    ALE/Kangaroo-ram-v5                  Kangaroo-ram                         AtariEnv       
    ALE/KeystoneKapers-v5                KeystoneKapers                       AtariEnv       
    ALE/KeystoneKapers-ram-v5            KeystoneKapers-ram                   AtariEnv       
    ALE/KingKong-v5                      KingKong                             AtariEnv       
    ALE/KingKong-ram-v5                  KingKong-ram                         AtariEnv       
    ALE/Klax-v5                          Klax                                 AtariEnv       
    ALE/Klax-ram-v5                      Klax-ram                             AtariEnv       
    ALE/Koolaid-v5                       Koolaid                              AtariEnv       
    ALE/Koolaid-ram-v5                   Koolaid-ram                          AtariEnv       
    ALE/Krull-v5                         Krull                                AtariEnv       
    ALE/Krull-ram-v5                     Krull-ram                            AtariEnv       
    ALE/KungFuMaster-v5                  KungFuMaster                         AtariEnv       
    ALE/KungFuMaster-ram-v5              KungFuMaster-ram                     AtariEnv       
    ALE/LaserGates-v5                    LaserGates                           AtariEnv       
    ALE/LaserGates-ram-v5                LaserGates-ram                       AtariEnv       
    ALE/LostLuggage-v5                   LostLuggage                          AtariEnv       
    ALE/LostLuggage-ram-v5               LostLuggage-ram                      AtariEnv       
    ALE/MarioBros-v5                     MarioBros                            AtariEnv       
    ALE/MarioBros-ram-v5                 MarioBros-ram                        AtariEnv       
    ALE/MiniatureGolf-v5                 MiniatureGolf                        AtariEnv       
    ALE/MiniatureGolf-ram-v5             MiniatureGolf-ram                    AtariEnv       
    ALE/MontezumaRevenge-v5              MontezumaRevenge                     AtariEnv       
    ALE/MontezumaRevenge-ram-v5          MontezumaRevenge-ram                 AtariEnv       
    ALE/MrDo-v5                          MrDo                                 AtariEnv       
    ALE/MrDo-ram-v5                      MrDo-ram                             AtariEnv       
    ALE/MsPacman-v5                      MsPacman                             AtariEnv       
    ALE/MsPacman-ram-v5                  MsPacman-ram                         AtariEnv       
    ALE/NameThisGame-v5                  NameThisGame                         AtariEnv       
    ALE/NameThisGame-ram-v5              NameThisGame-ram                     AtariEnv       
    ALE/Othello-v5                       Othello                              AtariEnv       
    ALE/Othello-ram-v5                   Othello-ram                          AtariEnv       
    ALE/Pacman-v5                        Pacman                               AtariEnv       
    ALE/Pacman-ram-v5                    Pacman-ram                           AtariEnv       
    ALE/Phoenix-v5                       Phoenix                              AtariEnv       
    ALE/Phoenix-ram-v5                   Phoenix-ram                          AtariEnv       
    ALE/Pitfall-v5                       Pitfall                              AtariEnv       
    ALE/Pitfall-ram-v5                   Pitfall-ram                          AtariEnv       
    ALE/Pitfall2-v5                      Pitfall2                             AtariEnv       
    ALE/Pitfall2-ram-v5                  Pitfall2-ram                         AtariEnv       
    ALE/Pong-v5                          Pong                                 AtariEnv       
    ALE/Pong-ram-v5                      Pong-ram                             AtariEnv       
    ALE/Pooyan-v5                        Pooyan                               AtariEnv       
    ALE/Pooyan-ram-v5                    Pooyan-ram                           AtariEnv       
    ALE/PrivateEye-v5                    PrivateEye                           AtariEnv       
    ALE/PrivateEye-ram-v5                PrivateEye-ram                       AtariEnv       
    ALE/Qbert-v5                         Qbert                                AtariEnv       
    ALE/Qbert-ram-v5                     Qbert-ram                            AtariEnv       
    ALE/Riverraid-v5                     Riverraid                            AtariEnv       
    ALE/Riverraid-ram-v5                 Riverraid-ram                        AtariEnv       
    ALE/RoadRunner-v5                    RoadRunner                           AtariEnv       
    ALE/RoadRunner-ram-v5                RoadRunner-ram                       AtariEnv       
    ALE/Robotank-v5                      Robotank                             AtariEnv       
    ALE/Robotank-ram-v5                  Robotank-ram                         AtariEnv       
    ALE/Seaquest-v5                      Seaquest                             AtariEnv       
    ALE/Seaquest-ram-v5                  Seaquest-ram                         AtariEnv       
    ALE/SirLancelot-v5                   SirLancelot                          AtariEnv       
    ALE/SirLancelot-ram-v5               SirLancelot-ram                      AtariEnv       
    ALE/Skiing-v5                        Skiing                               AtariEnv       
    ALE/Skiing-ram-v5                    Skiing-ram                           AtariEnv       
    ALE/Solaris-v5                       Solaris                              AtariEnv       
    ALE/Solaris-ram-v5                   Solaris-ram                          AtariEnv       
    ALE/SpaceInvaders-v5                 SpaceInvaders                        AtariEnv       
    ALE/SpaceInvaders-ram-v5             SpaceInvaders-ram                    AtariEnv       
    ALE/SpaceWar-v5                      SpaceWar                             AtariEnv       
    ALE/SpaceWar-ram-v5                  SpaceWar-ram                         AtariEnv       
    ALE/StarGunner-v5                    StarGunner                           AtariEnv       
    ALE/StarGunner-ram-v5                StarGunner-ram                       AtariEnv       
    ALE/Superman-v5                      Superman                             AtariEnv       
    ALE/Superman-ram-v5                  Superman-ram                         AtariEnv       
    ALE/Surround-v5                      Surround                             AtariEnv       
    ALE/Surround-ram-v5                  Surround-ram                         AtariEnv       
    ALE/Tennis-v5                        Tennis                               AtariEnv       
    ALE/Tennis-ram-v5                    Tennis-ram                           AtariEnv       
    ALE/TicTacToe3D-v5                   TicTacToe3D                          AtariEnv       
    ALE/TicTacToe3D-ram-v5               TicTacToe3D-ram                      AtariEnv       
    ALE/TimePilot-v5                     TimePilot                            AtariEnv       
    ALE/TimePilot-ram-v5                 TimePilot-ram                        AtariEnv       
    ALE/Trondead-v5                      Trondead                             AtariEnv       
    ALE/Trondead-ram-v5                  Trondead-ram                         AtariEnv       
    ALE/Turmoil-v5                       Turmoil                              AtariEnv       
    ALE/Turmoil-ram-v5                   Turmoil-ram                          AtariEnv       
    ALE/Tutankham-v5                     Tutankham                            AtariEnv       
    ALE/Tutankham-ram-v5                 Tutankham-ram                        AtariEnv       
    ALE/UpNDown-v5                       UpNDown                              AtariEnv       
    ALE/UpNDown-ram-v5                   UpNDown-ram                          AtariEnv       
    ALE/Venture-v5                       Venture                              AtariEnv       
    ALE/Venture-ram-v5                   Venture-ram                          AtariEnv       
    ALE/VideoCheckers-v5                 VideoCheckers                        AtariEnv       
    ALE/VideoCheckers-ram-v5             VideoCheckers-ram                    AtariEnv       
    ALE/Videochess-v5                    Videochess                           AtariEnv       
    ALE/Videochess-ram-v5                Videochess-ram                       AtariEnv       
    ALE/Videocube-v5                     Videocube                            AtariEnv       
    ALE/Videocube-ram-v5                 Videocube-ram                        AtariEnv       
    ALE/VideoPinball-v5                  VideoPinball                         AtariEnv       
    ALE/VideoPinball-ram-v5              VideoPinball-ram                     AtariEnv       
    ALE/WizardOfWor-v5                   WizardOfWor                          AtariEnv       
    ALE/WizardOfWor-ram-v5               WizardOfWor-ram                      AtariEnv       
    ALE/WordZapper-v5                    WordZapper                           AtariEnv       
    ALE/WordZapper-ram-v5                WordZapper-ram                       AtariEnv       
    ALE/YarsRevenge-v5                   YarsRevenge                          AtariEnv       
    ALE/YarsRevenge-ram-v5               YarsRevenge-ram                      AtariEnv       
    ALE/Zaxxon-v5                        Zaxxon                               AtariEnv       
    ALE/Zaxxon-ram-v5                    Zaxxon-ram                           AtariEnv       
    Adventure-v0                         Adventure                            AtariEnv       
    AdventureDeterministic-v0            AdventureDeterministic               AtariEnv       
    AdventureNoFrameskip-v0              AdventureNoFrameskip                 AtariEnv       
    Adventure-v4                         Adventure                            AtariEnv       
    AdventureDeterministic-v4            AdventureDeterministic               AtariEnv       
    AdventureNoFrameskip-v4              AdventureNoFrameskip                 AtariEnv       
    Adventure-ram-v0                     Adventure-ram                        AtariEnv       
    Adventure-ramDeterministic-v0        Adventure-ramDeterministic           AtariEnv       
    Adventure-ramNoFrameskip-v0          Adventure-ramNoFrameskip             AtariEnv       
    Adventure-ram-v4                     Adventure-ram                        AtariEnv       
    Adventure-ramDeterministic-v4        Adventure-ramDeterministic           AtariEnv       
    Adventure-ramNoFrameskip-v4          Adventure-ramNoFrameskip             AtariEnv       
    AirRaid-v0                           AirRaid                              AtariEnv       
    AirRaidDeterministic-v0              AirRaidDeterministic                 AtariEnv       
    AirRaidNoFrameskip-v0                AirRaidNoFrameskip                   AtariEnv       
    AirRaid-v4                           AirRaid                              AtariEnv       
    AirRaidDeterministic-v4              AirRaidDeterministic                 AtariEnv       
    AirRaidNoFrameskip-v4                AirRaidNoFrameskip                   AtariEnv       
    AirRaid-ram-v0                       AirRaid-ram                          AtariEnv       
    AirRaid-ramDeterministic-v0          AirRaid-ramDeterministic             AtariEnv       
    AirRaid-ramNoFrameskip-v0            AirRaid-ramNoFrameskip               AtariEnv       
    AirRaid-ram-v4                       AirRaid-ram                          AtariEnv       
    AirRaid-ramDeterministic-v4          AirRaid-ramDeterministic             AtariEnv       
    AirRaid-ramNoFrameskip-v4            AirRaid-ramNoFrameskip               AtariEnv       
    Alien-v0                             Alien                                AtariEnv       
    AlienDeterministic-v0                AlienDeterministic                   AtariEnv       
    AlienNoFrameskip-v0                  AlienNoFrameskip                     AtariEnv       
    Alien-v4                             Alien                                AtariEnv       
    AlienDeterministic-v4                AlienDeterministic                   AtariEnv       
    AlienNoFrameskip-v4                  AlienNoFrameskip                     AtariEnv       
    Alien-ram-v0                         Alien-ram                            AtariEnv       
    Alien-ramDeterministic-v0            Alien-ramDeterministic               AtariEnv       
    Alien-ramNoFrameskip-v0              Alien-ramNoFrameskip                 AtariEnv       
    Alien-ram-v4                         Alien-ram                            AtariEnv       
    Alien-ramDeterministic-v4            Alien-ramDeterministic               AtariEnv       
    Alien-ramNoFrameskip-v4              Alien-ramNoFrameskip                 AtariEnv       
    Amidar-v0                            Amidar                               AtariEnv       
    AmidarDeterministic-v0               AmidarDeterministic                  AtariEnv       
    AmidarNoFrameskip-v0                 AmidarNoFrameskip                    AtariEnv       
    Amidar-v4                            Amidar                               AtariEnv       
    AmidarDeterministic-v4               AmidarDeterministic                  AtariEnv       
    AmidarNoFrameskip-v4                 AmidarNoFrameskip                    AtariEnv       
    Amidar-ram-v0                        Amidar-ram                           AtariEnv       
    Amidar-ramDeterministic-v0           Amidar-ramDeterministic              AtariEnv       
    Amidar-ramNoFrameskip-v0             Amidar-ramNoFrameskip                AtariEnv       
    Amidar-ram-v4                        Amidar-ram                           AtariEnv       
    Amidar-ramDeterministic-v4           Amidar-ramDeterministic              AtariEnv       
    Amidar-ramNoFrameskip-v4             Amidar-ramNoFrameskip                AtariEnv       
    Assault-v0                           Assault                              AtariEnv       
    AssaultDeterministic-v0              AssaultDeterministic                 AtariEnv       
    AssaultNoFrameskip-v0                AssaultNoFrameskip                   AtariEnv       
    Assault-v4                           Assault                              AtariEnv       
    AssaultDeterministic-v4              AssaultDeterministic                 AtariEnv       
    AssaultNoFrameskip-v4                AssaultNoFrameskip                   AtariEnv       
    Assault-ram-v0                       Assault-ram                          AtariEnv       
    Assault-ramDeterministic-v0          Assault-ramDeterministic             AtariEnv       
    Assault-ramNoFrameskip-v0            Assault-ramNoFrameskip               AtariEnv       
    Assault-ram-v4                       Assault-ram                          AtariEnv       
    Assault-ramDeterministic-v4          Assault-ramDeterministic             AtariEnv       
    Assault-ramNoFrameskip-v4            Assault-ramNoFrameskip               AtariEnv       
    Asterix-v0                           Asterix                              AtariEnv       
    AsterixDeterministic-v0              AsterixDeterministic                 AtariEnv       
    AsterixNoFrameskip-v0                AsterixNoFrameskip                   AtariEnv       
    Asterix-v4                           Asterix                              AtariEnv       
    AsterixDeterministic-v4              AsterixDeterministic                 AtariEnv       
    AsterixNoFrameskip-v4                AsterixNoFrameskip                   AtariEnv       
    Asterix-ram-v0                       Asterix-ram                          AtariEnv       
    Asterix-ramDeterministic-v0          Asterix-ramDeterministic             AtariEnv       
    Asterix-ramNoFrameskip-v0            Asterix-ramNoFrameskip               AtariEnv       
    Asterix-ram-v4                       Asterix-ram                          AtariEnv       
    Asterix-ramDeterministic-v4          Asterix-ramDeterministic             AtariEnv       
    Asterix-ramNoFrameskip-v4            Asterix-ramNoFrameskip               AtariEnv       
    Asteroids-v0                         Asteroids                            AtariEnv       
    AsteroidsDeterministic-v0            AsteroidsDeterministic               AtariEnv       
    AsteroidsNoFrameskip-v0              AsteroidsNoFrameskip                 AtariEnv       
    Asteroids-v4                         Asteroids                            AtariEnv       
    AsteroidsDeterministic-v4            AsteroidsDeterministic               AtariEnv       
    AsteroidsNoFrameskip-v4              AsteroidsNoFrameskip                 AtariEnv       
    Asteroids-ram-v0                     Asteroids-ram                        AtariEnv       
    Asteroids-ramDeterministic-v0        Asteroids-ramDeterministic           AtariEnv       
    Asteroids-ramNoFrameskip-v0          Asteroids-ramNoFrameskip             AtariEnv       
    Asteroids-ram-v4                     Asteroids-ram                        AtariEnv       
    Asteroids-ramDeterministic-v4        Asteroids-ramDeterministic           AtariEnv       
    Asteroids-ramNoFrameskip-v4          Asteroids-ramNoFrameskip             AtariEnv       
    Atlantis-v0                          Atlantis                             AtariEnv       
    AtlantisDeterministic-v0             AtlantisDeterministic                AtariEnv       
    AtlantisNoFrameskip-v0               AtlantisNoFrameskip                  AtariEnv       
    Atlantis-v4                          Atlantis                             AtariEnv       
    AtlantisDeterministic-v4             AtlantisDeterministic                AtariEnv       
    AtlantisNoFrameskip-v4               AtlantisNoFrameskip                  AtariEnv       
    Atlantis-ram-v0                      Atlantis-ram                         AtariEnv       
    Atlantis-ramDeterministic-v0         Atlantis-ramDeterministic            AtariEnv       
    Atlantis-ramNoFrameskip-v0           Atlantis-ramNoFrameskip              AtariEnv       
    Atlantis-ram-v4                      Atlantis-ram                         AtariEnv       
    Atlantis-ramDeterministic-v4         Atlantis-ramDeterministic            AtariEnv       
    Atlantis-ramNoFrameskip-v4           Atlantis-ramNoFrameskip              AtariEnv       
    BankHeist-v0                         BankHeist                            AtariEnv       
    BankHeistDeterministic-v0            BankHeistDeterministic               AtariEnv       
    BankHeistNoFrameskip-v0              BankHeistNoFrameskip                 AtariEnv       
    BankHeist-v4                         BankHeist                            AtariEnv       
    BankHeistDeterministic-v4            BankHeistDeterministic               AtariEnv       
    BankHeistNoFrameskip-v4              BankHeistNoFrameskip                 AtariEnv       
    BankHeist-ram-v0                     BankHeist-ram                        AtariEnv       
    BankHeist-ramDeterministic-v0        BankHeist-ramDeterministic           AtariEnv       
    BankHeist-ramNoFrameskip-v0          BankHeist-ramNoFrameskip             AtariEnv       
    BankHeist-ram-v4                     BankHeist-ram                        AtariEnv       
    BankHeist-ramDeterministic-v4        BankHeist-ramDeterministic           AtariEnv       
    BankHeist-ramNoFrameskip-v4          BankHeist-ramNoFrameskip             AtariEnv       
    BattleZone-v0                        BattleZone                           AtariEnv       
    BattleZoneDeterministic-v0           BattleZoneDeterministic              AtariEnv       
    BattleZoneNoFrameskip-v0             BattleZoneNoFrameskip                AtariEnv       
    BattleZone-v4                        BattleZone                           AtariEnv       
    BattleZoneDeterministic-v4           BattleZoneDeterministic              AtariEnv       
    BattleZoneNoFrameskip-v4             BattleZoneNoFrameskip                AtariEnv       
    BattleZone-ram-v0                    BattleZone-ram                       AtariEnv       
    BattleZone-ramDeterministic-v0       BattleZone-ramDeterministic          AtariEnv       
    BattleZone-ramNoFrameskip-v0         BattleZone-ramNoFrameskip            AtariEnv       
    BattleZone-ram-v4                    BattleZone-ram                       AtariEnv       
    BattleZone-ramDeterministic-v4       BattleZone-ramDeterministic          AtariEnv       
    BattleZone-ramNoFrameskip-v4         BattleZone-ramNoFrameskip            AtariEnv       
    BeamRider-v0                         BeamRider                            AtariEnv       
    BeamRiderDeterministic-v0            BeamRiderDeterministic               AtariEnv       
    BeamRiderNoFrameskip-v0              BeamRiderNoFrameskip                 AtariEnv       
    BeamRider-v4                         BeamRider                            AtariEnv       
    BeamRiderDeterministic-v4            BeamRiderDeterministic               AtariEnv       
    BeamRiderNoFrameskip-v4              BeamRiderNoFrameskip                 AtariEnv       
    BeamRider-ram-v0                     BeamRider-ram                        AtariEnv       
    BeamRider-ramDeterministic-v0        BeamRider-ramDeterministic           AtariEnv       
    BeamRider-ramNoFrameskip-v0          BeamRider-ramNoFrameskip             AtariEnv       
    BeamRider-ram-v4                     BeamRider-ram                        AtariEnv       
    BeamRider-ramDeterministic-v4        BeamRider-ramDeterministic           AtariEnv       
    BeamRider-ramNoFrameskip-v4          BeamRider-ramNoFrameskip             AtariEnv       
    Berzerk-v0                           Berzerk                              AtariEnv       
    BerzerkDeterministic-v0              BerzerkDeterministic                 AtariEnv       
    BerzerkNoFrameskip-v0                BerzerkNoFrameskip                   AtariEnv       
    Berzerk-v4                           Berzerk                              AtariEnv       
    BerzerkDeterministic-v4              BerzerkDeterministic                 AtariEnv       
    BerzerkNoFrameskip-v4                BerzerkNoFrameskip                   AtariEnv       
    Berzerk-ram-v0                       Berzerk-ram                          AtariEnv       
    Berzerk-ramDeterministic-v0          Berzerk-ramDeterministic             AtariEnv       
    Berzerk-ramNoFrameskip-v0            Berzerk-ramNoFrameskip               AtariEnv       
    Berzerk-ram-v4                       Berzerk-ram                          AtariEnv       
    Berzerk-ramDeterministic-v4          Berzerk-ramDeterministic             AtariEnv       
    Berzerk-ramNoFrameskip-v4            Berzerk-ramNoFrameskip               AtariEnv       
    Bowling-v0                           Bowling                              AtariEnv       
    BowlingDeterministic-v0              BowlingDeterministic                 AtariEnv       
    BowlingNoFrameskip-v0                BowlingNoFrameskip                   AtariEnv       
    Bowling-v4                           Bowling                              AtariEnv       
    BowlingDeterministic-v4              BowlingDeterministic                 AtariEnv       
    BowlingNoFrameskip-v4                BowlingNoFrameskip                   AtariEnv       
    Bowling-ram-v0                       Bowling-ram                          AtariEnv       
    Bowling-ramDeterministic-v0          Bowling-ramDeterministic             AtariEnv       
    Bowling-ramNoFrameskip-v0            Bowling-ramNoFrameskip               AtariEnv       
    Bowling-ram-v4                       Bowling-ram                          AtariEnv       
    Bowling-ramDeterministic-v4          Bowling-ramDeterministic             AtariEnv       
    Bowling-ramNoFrameskip-v4            Bowling-ramNoFrameskip               AtariEnv       
    Boxing-v0                            Boxing                               AtariEnv       
    BoxingDeterministic-v0               BoxingDeterministic                  AtariEnv       
    BoxingNoFrameskip-v0                 BoxingNoFrameskip                    AtariEnv       
    Boxing-v4                            Boxing                               AtariEnv       
    BoxingDeterministic-v4               BoxingDeterministic                  AtariEnv       
    BoxingNoFrameskip-v4                 BoxingNoFrameskip                    AtariEnv       
    Boxing-ram-v0                        Boxing-ram                           AtariEnv       
    Boxing-ramDeterministic-v0           Boxing-ramDeterministic              AtariEnv       
    Boxing-ramNoFrameskip-v0             Boxing-ramNoFrameskip                AtariEnv       
    Boxing-ram-v4                        Boxing-ram                           AtariEnv       
    Boxing-ramDeterministic-v4           Boxing-ramDeterministic              AtariEnv       
    Boxing-ramNoFrameskip-v4             Boxing-ramNoFrameskip                AtariEnv       
    Breakout-v0                          Breakout                             AtariEnv       
    BreakoutDeterministic-v0             BreakoutDeterministic                AtariEnv       
    BreakoutNoFrameskip-v0               BreakoutNoFrameskip                  AtariEnv       
    Breakout-v4                          Breakout                             AtariEnv       
    BreakoutDeterministic-v4             BreakoutDeterministic                AtariEnv       
    BreakoutNoFrameskip-v4               BreakoutNoFrameskip                  AtariEnv       
    Breakout-ram-v0                      Breakout-ram                         AtariEnv       
    Breakout-ramDeterministic-v0         Breakout-ramDeterministic            AtariEnv       
    Breakout-ramNoFrameskip-v0           Breakout-ramNoFrameskip              AtariEnv       
    Breakout-ram-v4                      Breakout-ram                         AtariEnv       
    Breakout-ramDeterministic-v4         Breakout-ramDeterministic            AtariEnv       
    Breakout-ramNoFrameskip-v4           Breakout-ramNoFrameskip              AtariEnv       
    Carnival-v0                          Carnival                             AtariEnv       
    CarnivalDeterministic-v0             CarnivalDeterministic                AtariEnv       
    CarnivalNoFrameskip-v0               CarnivalNoFrameskip                  AtariEnv       
    Carnival-v4                          Carnival                             AtariEnv       
    CarnivalDeterministic-v4             CarnivalDeterministic                AtariEnv       
    CarnivalNoFrameskip-v4               CarnivalNoFrameskip                  AtariEnv       
    Carnival-ram-v0                      Carnival-ram                         AtariEnv       
    Carnival-ramDeterministic-v0         Carnival-ramDeterministic            AtariEnv       
    Carnival-ramNoFrameskip-v0           Carnival-ramNoFrameskip              AtariEnv       
    Carnival-ram-v4                      Carnival-ram                         AtariEnv       
    Carnival-ramDeterministic-v4         Carnival-ramDeterministic            AtariEnv       
    Carnival-ramNoFrameskip-v4           Carnival-ramNoFrameskip              AtariEnv       
    Centipede-v0                         Centipede                            AtariEnv       
    CentipedeDeterministic-v0            CentipedeDeterministic               AtariEnv       
    CentipedeNoFrameskip-v0              CentipedeNoFrameskip                 AtariEnv       
    Centipede-v4                         Centipede                            AtariEnv       
    CentipedeDeterministic-v4            CentipedeDeterministic               AtariEnv       
    CentipedeNoFrameskip-v4              CentipedeNoFrameskip                 AtariEnv       
    Centipede-ram-v0                     Centipede-ram                        AtariEnv       
    Centipede-ramDeterministic-v0        Centipede-ramDeterministic           AtariEnv       
    Centipede-ramNoFrameskip-v0          Centipede-ramNoFrameskip             AtariEnv       
    Centipede-ram-v4                     Centipede-ram                        AtariEnv       
    Centipede-ramDeterministic-v4        Centipede-ramDeterministic           AtariEnv       
    Centipede-ramNoFrameskip-v4          Centipede-ramNoFrameskip             AtariEnv       
    ChopperCommand-v0                    ChopperCommand                       AtariEnv       
    ChopperCommandDeterministic-v0       ChopperCommandDeterministic          AtariEnv       
    ChopperCommandNoFrameskip-v0         ChopperCommandNoFrameskip            AtariEnv       
    ChopperCommand-v4                    ChopperCommand                       AtariEnv       
    ChopperCommandDeterministic-v4       ChopperCommandDeterministic          AtariEnv       
    ChopperCommandNoFrameskip-v4         ChopperCommandNoFrameskip            AtariEnv       
    ChopperCommand-ram-v0                ChopperCommand-ram                   AtariEnv       
    ChopperCommand-ramDeterministic-v0   ChopperCommand-ramDeterministic      AtariEnv       
    ChopperCommand-ramNoFrameskip-v0     ChopperCommand-ramNoFrameskip        AtariEnv       
    ChopperCommand-ram-v4                ChopperCommand-ram                   AtariEnv       
    ChopperCommand-ramDeterministic-v4   ChopperCommand-ramDeterministic      AtariEnv       
    ChopperCommand-ramNoFrameskip-v4     ChopperCommand-ramNoFrameskip        AtariEnv       
    CrazyClimber-v0                      CrazyClimber                         AtariEnv       
    CrazyClimberDeterministic-v0         CrazyClimberDeterministic            AtariEnv       
    CrazyClimberNoFrameskip-v0           CrazyClimberNoFrameskip              AtariEnv       
    CrazyClimber-v4                      CrazyClimber                         AtariEnv       
    CrazyClimberDeterministic-v4         CrazyClimberDeterministic            AtariEnv       
    CrazyClimberNoFrameskip-v4           CrazyClimberNoFrameskip              AtariEnv       
    CrazyClimber-ram-v0                  CrazyClimber-ram                     AtariEnv       
    CrazyClimber-ramDeterministic-v0     CrazyClimber-ramDeterministic        AtariEnv       
    CrazyClimber-ramNoFrameskip-v0       CrazyClimber-ramNoFrameskip          AtariEnv       
    CrazyClimber-ram-v4                  CrazyClimber-ram                     AtariEnv       
    CrazyClimber-ramDeterministic-v4     CrazyClimber-ramDeterministic        AtariEnv       
    CrazyClimber-ramNoFrameskip-v4       CrazyClimber-ramNoFrameskip          AtariEnv       
    Defender-v0                          Defender                             AtariEnv       
    DefenderDeterministic-v0             DefenderDeterministic                AtariEnv       
    DefenderNoFrameskip-v0               DefenderNoFrameskip                  AtariEnv       
    Defender-v4                          Defender                             AtariEnv       
    DefenderDeterministic-v4             DefenderDeterministic                AtariEnv       
    DefenderNoFrameskip-v4               DefenderNoFrameskip                  AtariEnv       
    Defender-ram-v0                      Defender-ram                         AtariEnv       
    Defender-ramDeterministic-v0         Defender-ramDeterministic            AtariEnv       
    Defender-ramNoFrameskip-v0           Defender-ramNoFrameskip              AtariEnv       
    Defender-ram-v4                      Defender-ram                         AtariEnv       
    Defender-ramDeterministic-v4         Defender-ramDeterministic            AtariEnv       
    Defender-ramNoFrameskip-v4           Defender-ramNoFrameskip              AtariEnv       
    DemonAttack-v0                       DemonAttack                          AtariEnv       
    DemonAttackDeterministic-v0          DemonAttackDeterministic             AtariEnv       
    DemonAttackNoFrameskip-v0            DemonAttackNoFrameskip               AtariEnv       
    DemonAttack-v4                       DemonAttack                          AtariEnv       
    DemonAttackDeterministic-v4          DemonAttackDeterministic             AtariEnv       
    DemonAttackNoFrameskip-v4            DemonAttackNoFrameskip               AtariEnv       
    DemonAttack-ram-v0                   DemonAttack-ram                      AtariEnv       
    DemonAttack-ramDeterministic-v0      DemonAttack-ramDeterministic         AtariEnv       
    DemonAttack-ramNoFrameskip-v0        DemonAttack-ramNoFrameskip           AtariEnv       
    DemonAttack-ram-v4                   DemonAttack-ram                      AtariEnv       
    DemonAttack-ramDeterministic-v4      DemonAttack-ramDeterministic         AtariEnv       
    DemonAttack-ramNoFrameskip-v4        DemonAttack-ramNoFrameskip           AtariEnv       
    DoubleDunk-v0                        DoubleDunk                           AtariEnv       
    DoubleDunkDeterministic-v0           DoubleDunkDeterministic              AtariEnv       
    DoubleDunkNoFrameskip-v0             DoubleDunkNoFrameskip                AtariEnv       
    DoubleDunk-v4                        DoubleDunk                           AtariEnv       
    DoubleDunkDeterministic-v4           DoubleDunkDeterministic              AtariEnv       
    DoubleDunkNoFrameskip-v4             DoubleDunkNoFrameskip                AtariEnv       
    DoubleDunk-ram-v0                    DoubleDunk-ram                       AtariEnv       
    DoubleDunk-ramDeterministic-v0       DoubleDunk-ramDeterministic          AtariEnv       
    DoubleDunk-ramNoFrameskip-v0         DoubleDunk-ramNoFrameskip            AtariEnv       
    DoubleDunk-ram-v4                    DoubleDunk-ram                       AtariEnv       
    DoubleDunk-ramDeterministic-v4       DoubleDunk-ramDeterministic          AtariEnv       
    DoubleDunk-ramNoFrameskip-v4         DoubleDunk-ramNoFrameskip            AtariEnv       
    ElevatorAction-v0                    ElevatorAction                       AtariEnv       
    ElevatorActionDeterministic-v0       ElevatorActionDeterministic          AtariEnv       
    ElevatorActionNoFrameskip-v0         ElevatorActionNoFrameskip            AtariEnv       
    ElevatorAction-v4                    ElevatorAction                       AtariEnv       
    ElevatorActionDeterministic-v4       ElevatorActionDeterministic          AtariEnv       
    ElevatorActionNoFrameskip-v4         ElevatorActionNoFrameskip            AtariEnv       
    ElevatorAction-ram-v0                ElevatorAction-ram                   AtariEnv       
    ElevatorAction-ramDeterministic-v0   ElevatorAction-ramDeterministic      AtariEnv       
    ElevatorAction-ramNoFrameskip-v0     ElevatorAction-ramNoFrameskip        AtariEnv       
    ElevatorAction-ram-v4                ElevatorAction-ram                   AtariEnv       
    ElevatorAction-ramDeterministic-v4   ElevatorAction-ramDeterministic      AtariEnv       
    ElevatorAction-ramNoFrameskip-v4     ElevatorAction-ramNoFrameskip        AtariEnv       
    Enduro-v0                            Enduro                               AtariEnv       
    EnduroDeterministic-v0               EnduroDeterministic                  AtariEnv       
    EnduroNoFrameskip-v0                 EnduroNoFrameskip                    AtariEnv       
    Enduro-v4                            Enduro                               AtariEnv       
    EnduroDeterministic-v4               EnduroDeterministic                  AtariEnv       
    EnduroNoFrameskip-v4                 EnduroNoFrameskip                    AtariEnv       
    Enduro-ram-v0                        Enduro-ram                           AtariEnv       
    Enduro-ramDeterministic-v0           Enduro-ramDeterministic              AtariEnv       
    Enduro-ramNoFrameskip-v0             Enduro-ramNoFrameskip                AtariEnv       
    Enduro-ram-v4                        Enduro-ram                           AtariEnv       
    Enduro-ramDeterministic-v4           Enduro-ramDeterministic              AtariEnv       
    Enduro-ramNoFrameskip-v4             Enduro-ramNoFrameskip                AtariEnv       
    FishingDerby-v0                      FishingDerby                         AtariEnv       
    FishingDerbyDeterministic-v0         FishingDerbyDeterministic            AtariEnv       
    FishingDerbyNoFrameskip-v0           FishingDerbyNoFrameskip              AtariEnv       
    FishingDerby-v4                      FishingDerby                         AtariEnv       
    FishingDerbyDeterministic-v4         FishingDerbyDeterministic            AtariEnv       
    FishingDerbyNoFrameskip-v4           FishingDerbyNoFrameskip              AtariEnv       
    FishingDerby-ram-v0                  FishingDerby-ram                     AtariEnv       
    FishingDerby-ramDeterministic-v0     FishingDerby-ramDeterministic        AtariEnv       
    FishingDerby-ramNoFrameskip-v0       FishingDerby-ramNoFrameskip          AtariEnv       
    FishingDerby-ram-v4                  FishingDerby-ram                     AtariEnv       
    FishingDerby-ramDeterministic-v4     FishingDerby-ramDeterministic        AtariEnv       
    FishingDerby-ramNoFrameskip-v4       FishingDerby-ramNoFrameskip          AtariEnv       
    Freeway-v0                           Freeway                              AtariEnv       
    FreewayDeterministic-v0              FreewayDeterministic                 AtariEnv       
    FreewayNoFrameskip-v0                FreewayNoFrameskip                   AtariEnv       
    Freeway-v4                           Freeway                              AtariEnv       
    FreewayDeterministic-v4              FreewayDeterministic                 AtariEnv       
    FreewayNoFrameskip-v4                FreewayNoFrameskip                   AtariEnv       
    Freeway-ram-v0                       Freeway-ram                          AtariEnv       
    Freeway-ramDeterministic-v0          Freeway-ramDeterministic             AtariEnv       
    Freeway-ramNoFrameskip-v0            Freeway-ramNoFrameskip               AtariEnv       
    Freeway-ram-v4                       Freeway-ram                          AtariEnv       
    Freeway-ramDeterministic-v4          Freeway-ramDeterministic             AtariEnv       
    Freeway-ramNoFrameskip-v4            Freeway-ramNoFrameskip               AtariEnv       
    Frostbite-v0                         Frostbite                            AtariEnv       
    FrostbiteDeterministic-v0            FrostbiteDeterministic               AtariEnv       
    FrostbiteNoFrameskip-v0              FrostbiteNoFrameskip                 AtariEnv       
    Frostbite-v4                         Frostbite                            AtariEnv       
    FrostbiteDeterministic-v4            FrostbiteDeterministic               AtariEnv       
    FrostbiteNoFrameskip-v4              FrostbiteNoFrameskip                 AtariEnv       
    Frostbite-ram-v0                     Frostbite-ram                        AtariEnv       
    Frostbite-ramDeterministic-v0        Frostbite-ramDeterministic           AtariEnv       
    Frostbite-ramNoFrameskip-v0          Frostbite-ramNoFrameskip             AtariEnv       
    Frostbite-ram-v4                     Frostbite-ram                        AtariEnv       
    Frostbite-ramDeterministic-v4        Frostbite-ramDeterministic           AtariEnv       
    Frostbite-ramNoFrameskip-v4          Frostbite-ramNoFrameskip             AtariEnv       
    Gopher-v0                            Gopher                               AtariEnv       
    GopherDeterministic-v0               GopherDeterministic                  AtariEnv       
    GopherNoFrameskip-v0                 GopherNoFrameskip                    AtariEnv       
    Gopher-v4                            Gopher                               AtariEnv       
    GopherDeterministic-v4               GopherDeterministic                  AtariEnv       
    GopherNoFrameskip-v4                 GopherNoFrameskip                    AtariEnv       
    Gopher-ram-v0                        Gopher-ram                           AtariEnv       
    Gopher-ramDeterministic-v0           Gopher-ramDeterministic              AtariEnv       
    Gopher-ramNoFrameskip-v0             Gopher-ramNoFrameskip                AtariEnv       
    Gopher-ram-v4                        Gopher-ram                           AtariEnv       
    Gopher-ramDeterministic-v4           Gopher-ramDeterministic              AtariEnv       
    Gopher-ramNoFrameskip-v4             Gopher-ramNoFrameskip                AtariEnv       
    Gravitar-v0                          Gravitar                             AtariEnv       
    GravitarDeterministic-v0             GravitarDeterministic                AtariEnv       
    GravitarNoFrameskip-v0               GravitarNoFrameskip                  AtariEnv       
    Gravitar-v4                          Gravitar                             AtariEnv       
    GravitarDeterministic-v4             GravitarDeterministic                AtariEnv       
    GravitarNoFrameskip-v4               GravitarNoFrameskip                  AtariEnv       
    Gravitar-ram-v0                      Gravitar-ram                         AtariEnv       
    Gravitar-ramDeterministic-v0         Gravitar-ramDeterministic            AtariEnv       
    Gravitar-ramNoFrameskip-v0           Gravitar-ramNoFrameskip              AtariEnv       
    Gravitar-ram-v4                      Gravitar-ram                         AtariEnv       
    Gravitar-ramDeterministic-v4         Gravitar-ramDeterministic            AtariEnv       
    Gravitar-ramNoFrameskip-v4           Gravitar-ramNoFrameskip              AtariEnv       
    Hero-v0                              Hero                                 AtariEnv       
    HeroDeterministic-v0                 HeroDeterministic                    AtariEnv       
    HeroNoFrameskip-v0                   HeroNoFrameskip                      AtariEnv       
    Hero-v4                              Hero                                 AtariEnv       
    HeroDeterministic-v4                 HeroDeterministic                    AtariEnv       
    HeroNoFrameskip-v4                   HeroNoFrameskip                      AtariEnv       
    Hero-ram-v0                          Hero-ram                             AtariEnv       
    Hero-ramDeterministic-v0             Hero-ramDeterministic                AtariEnv       
    Hero-ramNoFrameskip-v0               Hero-ramNoFrameskip                  AtariEnv       
    Hero-ram-v4                          Hero-ram                             AtariEnv       
    Hero-ramDeterministic-v4             Hero-ramDeterministic                AtariEnv       
    Hero-ramNoFrameskip-v4               Hero-ramNoFrameskip                  AtariEnv       
    IceHockey-v0                         IceHockey                            AtariEnv       
    IceHockeyDeterministic-v0            IceHockeyDeterministic               AtariEnv       
    IceHockeyNoFrameskip-v0              IceHockeyNoFrameskip                 AtariEnv       
    IceHockey-v4                         IceHockey                            AtariEnv       
    IceHockeyDeterministic-v4            IceHockeyDeterministic               AtariEnv       
    IceHockeyNoFrameskip-v4              IceHockeyNoFrameskip                 AtariEnv       
    IceHockey-ram-v0                     IceHockey-ram                        AtariEnv       
    IceHockey-ramDeterministic-v0        IceHockey-ramDeterministic           AtariEnv       
    IceHockey-ramNoFrameskip-v0          IceHockey-ramNoFrameskip             AtariEnv       
    IceHockey-ram-v4                     IceHockey-ram                        AtariEnv       
    IceHockey-ramDeterministic-v4        IceHockey-ramDeterministic           AtariEnv       
    IceHockey-ramNoFrameskip-v4          IceHockey-ramNoFrameskip             AtariEnv       
    Jamesbond-v0                         Jamesbond                            AtariEnv       
    JamesbondDeterministic-v0            JamesbondDeterministic               AtariEnv       
    JamesbondNoFrameskip-v0              JamesbondNoFrameskip                 AtariEnv       
    Jamesbond-v4                         Jamesbond                            AtariEnv       
    JamesbondDeterministic-v4            JamesbondDeterministic               AtariEnv       
    JamesbondNoFrameskip-v4              JamesbondNoFrameskip                 AtariEnv       
    Jamesbond-ram-v0                     Jamesbond-ram                        AtariEnv       
    Jamesbond-ramDeterministic-v0        Jamesbond-ramDeterministic           AtariEnv       
    Jamesbond-ramNoFrameskip-v0          Jamesbond-ramNoFrameskip             AtariEnv       
    Jamesbond-ram-v4                     Jamesbond-ram                        AtariEnv       
    Jamesbond-ramDeterministic-v4        Jamesbond-ramDeterministic           AtariEnv       
    Jamesbond-ramNoFrameskip-v4          Jamesbond-ramNoFrameskip             AtariEnv       
    JourneyEscape-v0                     JourneyEscape                        AtariEnv       
    JourneyEscapeDeterministic-v0        JourneyEscapeDeterministic           AtariEnv       
    JourneyEscapeNoFrameskip-v0          JourneyEscapeNoFrameskip             AtariEnv       
    JourneyEscape-v4                     JourneyEscape                        AtariEnv       
    JourneyEscapeDeterministic-v4        JourneyEscapeDeterministic           AtariEnv       
    JourneyEscapeNoFrameskip-v4          JourneyEscapeNoFrameskip             AtariEnv       
    JourneyEscape-ram-v0                 JourneyEscape-ram                    AtariEnv       
    JourneyEscape-ramDeterministic-v0    JourneyEscape-ramDeterministic       AtariEnv       
    JourneyEscape-ramNoFrameskip-v0      JourneyEscape-ramNoFrameskip         AtariEnv       
    JourneyEscape-ram-v4                 JourneyEscape-ram                    AtariEnv       
    JourneyEscape-ramDeterministic-v4    JourneyEscape-ramDeterministic       AtariEnv       
    JourneyEscape-ramNoFrameskip-v4      JourneyEscape-ramNoFrameskip         AtariEnv       
    Kangaroo-v0                          Kangaroo                             AtariEnv       
    KangarooDeterministic-v0             KangarooDeterministic                AtariEnv       
    KangarooNoFrameskip-v0               KangarooNoFrameskip                  AtariEnv       
    Kangaroo-v4                          Kangaroo                             AtariEnv       
    KangarooDeterministic-v4             KangarooDeterministic                AtariEnv       
    KangarooNoFrameskip-v4               KangarooNoFrameskip                  AtariEnv       
    Kangaroo-ram-v0                      Kangaroo-ram                         AtariEnv       
    Kangaroo-ramDeterministic-v0         Kangaroo-ramDeterministic            AtariEnv       
    Kangaroo-ramNoFrameskip-v0           Kangaroo-ramNoFrameskip              AtariEnv       
    Kangaroo-ram-v4                      Kangaroo-ram                         AtariEnv       
    Kangaroo-ramDeterministic-v4         Kangaroo-ramDeterministic            AtariEnv       
    Kangaroo-ramNoFrameskip-v4           Kangaroo-ramNoFrameskip              AtariEnv       
    Krull-v0                             Krull                                AtariEnv       
    KrullDeterministic-v0                KrullDeterministic                   AtariEnv       
    KrullNoFrameskip-v0                  KrullNoFrameskip                     AtariEnv       
    Krull-v4                             Krull                                AtariEnv       
    KrullDeterministic-v4                KrullDeterministic                   AtariEnv       
    KrullNoFrameskip-v4                  KrullNoFrameskip                     AtariEnv       
    Krull-ram-v0                         Krull-ram                            AtariEnv       
    Krull-ramDeterministic-v0            Krull-ramDeterministic               AtariEnv       
    Krull-ramNoFrameskip-v0              Krull-ramNoFrameskip                 AtariEnv       
    Krull-ram-v4                         Krull-ram                            AtariEnv       
    Krull-ramDeterministic-v4            Krull-ramDeterministic               AtariEnv       
    Krull-ramNoFrameskip-v4              Krull-ramNoFrameskip                 AtariEnv       
    KungFuMaster-v0                      KungFuMaster                         AtariEnv       
    KungFuMasterDeterministic-v0         KungFuMasterDeterministic            AtariEnv       
    KungFuMasterNoFrameskip-v0           KungFuMasterNoFrameskip              AtariEnv       
    KungFuMaster-v4                      KungFuMaster                         AtariEnv       
    KungFuMasterDeterministic-v4         KungFuMasterDeterministic            AtariEnv       
    KungFuMasterNoFrameskip-v4           KungFuMasterNoFrameskip              AtariEnv       
    KungFuMaster-ram-v0                  KungFuMaster-ram                     AtariEnv       
    KungFuMaster-ramDeterministic-v0     KungFuMaster-ramDeterministic        AtariEnv       
    KungFuMaster-ramNoFrameskip-v0       KungFuMaster-ramNoFrameskip          AtariEnv       
    KungFuMaster-ram-v4                  KungFuMaster-ram                     AtariEnv       
    KungFuMaster-ramDeterministic-v4     KungFuMaster-ramDeterministic        AtariEnv       
    KungFuMaster-ramNoFrameskip-v4       KungFuMaster-ramNoFrameskip          AtariEnv       
    MontezumaRevenge-v0                  MontezumaRevenge                     AtariEnv       
    MontezumaRevengeDeterministic-v0     MontezumaRevengeDeterministic        AtariEnv       
    MontezumaRevengeNoFrameskip-v0       MontezumaRevengeNoFrameskip          AtariEnv       
    MontezumaRevenge-v4                  MontezumaRevenge                     AtariEnv       
    MontezumaRevengeDeterministic-v4     MontezumaRevengeDeterministic        AtariEnv       
    MontezumaRevengeNoFrameskip-v4       MontezumaRevengeNoFrameskip          AtariEnv       
    MontezumaRevenge-ram-v0              MontezumaRevenge-ram                 AtariEnv       
    MontezumaRevenge-ramDeterministic-v0  MontezumaRevenge-ramDeterministic    AtariEnv       
    MontezumaRevenge-ramNoFrameskip-v0   MontezumaRevenge-ramNoFrameskip      AtariEnv       
    MontezumaRevenge-ram-v4              MontezumaRevenge-ram                 AtariEnv       
    MontezumaRevenge-ramDeterministic-v4  MontezumaRevenge-ramDeterministic    AtariEnv       
    MontezumaRevenge-ramNoFrameskip-v4   MontezumaRevenge-ramNoFrameskip      AtariEnv       
    MsPacman-v0                          MsPacman                             AtariEnv       
    MsPacmanDeterministic-v0             MsPacmanDeterministic                AtariEnv       
    MsPacmanNoFrameskip-v0               MsPacmanNoFrameskip                  AtariEnv       
    MsPacman-v4                          MsPacman                             AtariEnv       
    MsPacmanDeterministic-v4             MsPacmanDeterministic                AtariEnv       
    MsPacmanNoFrameskip-v4               MsPacmanNoFrameskip                  AtariEnv       
    MsPacman-ram-v0                      MsPacman-ram                         AtariEnv       
    MsPacman-ramDeterministic-v0         MsPacman-ramDeterministic            AtariEnv       
    MsPacman-ramNoFrameskip-v0           MsPacman-ramNoFrameskip              AtariEnv       
    MsPacman-ram-v4                      MsPacman-ram                         AtariEnv       
    MsPacman-ramDeterministic-v4         MsPacman-ramDeterministic            AtariEnv       
    MsPacman-ramNoFrameskip-v4           MsPacman-ramNoFrameskip              AtariEnv       
    NameThisGame-v0                      NameThisGame                         AtariEnv       
    NameThisGameDeterministic-v0         NameThisGameDeterministic            AtariEnv       
    NameThisGameNoFrameskip-v0           NameThisGameNoFrameskip              AtariEnv       
    NameThisGame-v4                      NameThisGame                         AtariEnv       
    NameThisGameDeterministic-v4         NameThisGameDeterministic            AtariEnv       
    NameThisGameNoFrameskip-v4           NameThisGameNoFrameskip              AtariEnv       
    NameThisGame-ram-v0                  NameThisGame-ram                     AtariEnv       
    NameThisGame-ramDeterministic-v0     NameThisGame-ramDeterministic        AtariEnv       
    NameThisGame-ramNoFrameskip-v0       NameThisGame-ramNoFrameskip          AtariEnv       
    NameThisGame-ram-v4                  NameThisGame-ram                     AtariEnv       
    NameThisGame-ramDeterministic-v4     NameThisGame-ramDeterministic        AtariEnv       
    NameThisGame-ramNoFrameskip-v4       NameThisGame-ramNoFrameskip          AtariEnv       
    Phoenix-v0                           Phoenix                              AtariEnv       
    PhoenixDeterministic-v0              PhoenixDeterministic                 AtariEnv       
    PhoenixNoFrameskip-v0                PhoenixNoFrameskip                   AtariEnv       
    Phoenix-v4                           Phoenix                              AtariEnv       
    PhoenixDeterministic-v4              PhoenixDeterministic                 AtariEnv       
    PhoenixNoFrameskip-v4                PhoenixNoFrameskip                   AtariEnv       
    Phoenix-ram-v0                       Phoenix-ram                          AtariEnv       
    Phoenix-ramDeterministic-v0          Phoenix-ramDeterministic             AtariEnv       
    Phoenix-ramNoFrameskip-v0            Phoenix-ramNoFrameskip               AtariEnv       
    Phoenix-ram-v4                       Phoenix-ram                          AtariEnv       
    Phoenix-ramDeterministic-v4          Phoenix-ramDeterministic             AtariEnv       
    Phoenix-ramNoFrameskip-v4            Phoenix-ramNoFrameskip               AtariEnv       
    Pitfall-v0                           Pitfall                              AtariEnv       
    PitfallDeterministic-v0              PitfallDeterministic                 AtariEnv       
    PitfallNoFrameskip-v0                PitfallNoFrameskip                   AtariEnv       
    Pitfall-v4                           Pitfall                              AtariEnv       
    PitfallDeterministic-v4              PitfallDeterministic                 AtariEnv       
    PitfallNoFrameskip-v4                PitfallNoFrameskip                   AtariEnv       
    Pitfall-ram-v0                       Pitfall-ram                          AtariEnv       
    Pitfall-ramDeterministic-v0          Pitfall-ramDeterministic             AtariEnv       
    Pitfall-ramNoFrameskip-v0            Pitfall-ramNoFrameskip               AtariEnv       
    Pitfall-ram-v4                       Pitfall-ram                          AtariEnv       
    Pitfall-ramDeterministic-v4          Pitfall-ramDeterministic             AtariEnv       
    Pitfall-ramNoFrameskip-v4            Pitfall-ramNoFrameskip               AtariEnv       
    Pong-v0                              Pong                                 AtariEnv       
    PongDeterministic-v0                 PongDeterministic                    AtariEnv       
    PongNoFrameskip-v0                   PongNoFrameskip                      AtariEnv       
    Pong-v4                              Pong                                 AtariEnv       
    PongDeterministic-v4                 PongDeterministic                    AtariEnv       
    PongNoFrameskip-v4                   PongNoFrameskip                      AtariEnv       
    Pong-ram-v0                          Pong-ram                             AtariEnv       
    Pong-ramDeterministic-v0             Pong-ramDeterministic                AtariEnv       
    Pong-ramNoFrameskip-v0               Pong-ramNoFrameskip                  AtariEnv       
    Pong-ram-v4                          Pong-ram                             AtariEnv       
    Pong-ramDeterministic-v4             Pong-ramDeterministic                AtariEnv       
    Pong-ramNoFrameskip-v4               Pong-ramNoFrameskip                  AtariEnv       
    Pooyan-v0                            Pooyan                               AtariEnv       
    PooyanDeterministic-v0               PooyanDeterministic                  AtariEnv       
    PooyanNoFrameskip-v0                 PooyanNoFrameskip                    AtariEnv       
    Pooyan-v4                            Pooyan                               AtariEnv       
    PooyanDeterministic-v4               PooyanDeterministic                  AtariEnv       
    PooyanNoFrameskip-v4                 PooyanNoFrameskip                    AtariEnv       
    Pooyan-ram-v0                        Pooyan-ram                           AtariEnv       
    Pooyan-ramDeterministic-v0           Pooyan-ramDeterministic              AtariEnv       
    Pooyan-ramNoFrameskip-v0             Pooyan-ramNoFrameskip                AtariEnv       
    Pooyan-ram-v4                        Pooyan-ram                           AtariEnv       
    Pooyan-ramDeterministic-v4           Pooyan-ramDeterministic              AtariEnv       
    Pooyan-ramNoFrameskip-v4             Pooyan-ramNoFrameskip                AtariEnv       
    PrivateEye-v0                        PrivateEye                           AtariEnv       
    PrivateEyeDeterministic-v0           PrivateEyeDeterministic              AtariEnv       
    PrivateEyeNoFrameskip-v0             PrivateEyeNoFrameskip                AtariEnv       
    PrivateEye-v4                        PrivateEye                           AtariEnv       
    PrivateEyeDeterministic-v4           PrivateEyeDeterministic              AtariEnv       
    PrivateEyeNoFrameskip-v4             PrivateEyeNoFrameskip                AtariEnv       
    PrivateEye-ram-v0                    PrivateEye-ram                       AtariEnv       
    PrivateEye-ramDeterministic-v0       PrivateEye-ramDeterministic          AtariEnv       
    PrivateEye-ramNoFrameskip-v0         PrivateEye-ramNoFrameskip            AtariEnv       
    PrivateEye-ram-v4                    PrivateEye-ram                       AtariEnv       
    PrivateEye-ramDeterministic-v4       PrivateEye-ramDeterministic          AtariEnv       
    PrivateEye-ramNoFrameskip-v4         PrivateEye-ramNoFrameskip            AtariEnv       
    Qbert-v0                             Qbert                                AtariEnv       
    QbertDeterministic-v0                QbertDeterministic                   AtariEnv       
    QbertNoFrameskip-v0                  QbertNoFrameskip                     AtariEnv       
    Qbert-v4                             Qbert                                AtariEnv       
    QbertDeterministic-v4                QbertDeterministic                   AtariEnv       
    QbertNoFrameskip-v4                  QbertNoFrameskip                     AtariEnv       
    Qbert-ram-v0                         Qbert-ram                            AtariEnv       
    Qbert-ramDeterministic-v0            Qbert-ramDeterministic               AtariEnv       
    Qbert-ramNoFrameskip-v0              Qbert-ramNoFrameskip                 AtariEnv       
    Qbert-ram-v4                         Qbert-ram                            AtariEnv       
    Qbert-ramDeterministic-v4            Qbert-ramDeterministic               AtariEnv       
    Qbert-ramNoFrameskip-v4              Qbert-ramNoFrameskip                 AtariEnv       
    Riverraid-v0                         Riverraid                            AtariEnv       
    RiverraidDeterministic-v0            RiverraidDeterministic               AtariEnv       
    RiverraidNoFrameskip-v0              RiverraidNoFrameskip                 AtariEnv       
    Riverraid-v4                         Riverraid                            AtariEnv       
    RiverraidDeterministic-v4            RiverraidDeterministic               AtariEnv       
    RiverraidNoFrameskip-v4              RiverraidNoFrameskip                 AtariEnv       
    Riverraid-ram-v0                     Riverraid-ram                        AtariEnv       
    Riverraid-ramDeterministic-v0        Riverraid-ramDeterministic           AtariEnv       
    Riverraid-ramNoFrameskip-v0          Riverraid-ramNoFrameskip             AtariEnv       
    Riverraid-ram-v4                     Riverraid-ram                        AtariEnv       
    Riverraid-ramDeterministic-v4        Riverraid-ramDeterministic           AtariEnv       
    Riverraid-ramNoFrameskip-v4          Riverraid-ramNoFrameskip             AtariEnv       
    RoadRunner-v0                        RoadRunner                           AtariEnv       
    RoadRunnerDeterministic-v0           RoadRunnerDeterministic              AtariEnv       
    RoadRunnerNoFrameskip-v0             RoadRunnerNoFrameskip                AtariEnv       
    RoadRunner-v4                        RoadRunner                           AtariEnv       
    RoadRunnerDeterministic-v4           RoadRunnerDeterministic              AtariEnv       
    RoadRunnerNoFrameskip-v4             RoadRunnerNoFrameskip                AtariEnv       
    RoadRunner-ram-v0                    RoadRunner-ram                       AtariEnv       
    RoadRunner-ramDeterministic-v0       RoadRunner-ramDeterministic          AtariEnv       
    RoadRunner-ramNoFrameskip-v0         RoadRunner-ramNoFrameskip            AtariEnv       
    RoadRunner-ram-v4                    RoadRunner-ram                       AtariEnv       
    RoadRunner-ramDeterministic-v4       RoadRunner-ramDeterministic          AtariEnv       
    RoadRunner-ramNoFrameskip-v4         RoadRunner-ramNoFrameskip            AtariEnv       
    Robotank-v0                          Robotank                             AtariEnv       
    RobotankDeterministic-v0             RobotankDeterministic                AtariEnv       
    RobotankNoFrameskip-v0               RobotankNoFrameskip                  AtariEnv       
    Robotank-v4                          Robotank                             AtariEnv       
    RobotankDeterministic-v4             RobotankDeterministic                AtariEnv       
    RobotankNoFrameskip-v4               RobotankNoFrameskip                  AtariEnv       
    Robotank-ram-v0                      Robotank-ram                         AtariEnv       
    Robotank-ramDeterministic-v0         Robotank-ramDeterministic            AtariEnv       
    Robotank-ramNoFrameskip-v0           Robotank-ramNoFrameskip              AtariEnv       
    Robotank-ram-v4                      Robotank-ram                         AtariEnv       
    Robotank-ramDeterministic-v4         Robotank-ramDeterministic            AtariEnv       
    Robotank-ramNoFrameskip-v4           Robotank-ramNoFrameskip              AtariEnv       
    Seaquest-v0                          Seaquest                             AtariEnv       
    SeaquestDeterministic-v0             SeaquestDeterministic                AtariEnv       
    SeaquestNoFrameskip-v0               SeaquestNoFrameskip                  AtariEnv       
    Seaquest-v4                          Seaquest                             AtariEnv       
    SeaquestDeterministic-v4             SeaquestDeterministic                AtariEnv       
    SeaquestNoFrameskip-v4               SeaquestNoFrameskip                  AtariEnv       
    Seaquest-ram-v0                      Seaquest-ram                         AtariEnv       
    Seaquest-ramDeterministic-v0         Seaquest-ramDeterministic            AtariEnv       
    Seaquest-ramNoFrameskip-v0           Seaquest-ramNoFrameskip              AtariEnv       
    Seaquest-ram-v4                      Seaquest-ram                         AtariEnv       
    Seaquest-ramDeterministic-v4         Seaquest-ramDeterministic            AtariEnv       
    Seaquest-ramNoFrameskip-v4           Seaquest-ramNoFrameskip              AtariEnv       
    Skiing-v0                            Skiing                               AtariEnv       
    SkiingDeterministic-v0               SkiingDeterministic                  AtariEnv       
    SkiingNoFrameskip-v0                 SkiingNoFrameskip                    AtariEnv       
    Skiing-v4                            Skiing                               AtariEnv       
    SkiingDeterministic-v4               SkiingDeterministic                  AtariEnv       
    SkiingNoFrameskip-v4                 SkiingNoFrameskip                    AtariEnv       
    Skiing-ram-v0                        Skiing-ram                           AtariEnv       
    Skiing-ramDeterministic-v0           Skiing-ramDeterministic              AtariEnv       
    Skiing-ramNoFrameskip-v0             Skiing-ramNoFrameskip                AtariEnv       
    Skiing-ram-v4                        Skiing-ram                           AtariEnv       
    Skiing-ramDeterministic-v4           Skiing-ramDeterministic              AtariEnv       
    Skiing-ramNoFrameskip-v4             Skiing-ramNoFrameskip                AtariEnv       
    Solaris-v0                           Solaris                              AtariEnv       
    SolarisDeterministic-v0              SolarisDeterministic                 AtariEnv       
    SolarisNoFrameskip-v0                SolarisNoFrameskip                   AtariEnv       
    Solaris-v4                           Solaris                              AtariEnv       
    SolarisDeterministic-v4              SolarisDeterministic                 AtariEnv       
    SolarisNoFrameskip-v4                SolarisNoFrameskip                   AtariEnv       
    Solaris-ram-v0                       Solaris-ram                          AtariEnv       
    Solaris-ramDeterministic-v0          Solaris-ramDeterministic             AtariEnv       
    Solaris-ramNoFrameskip-v0            Solaris-ramNoFrameskip               AtariEnv       
    Solaris-ram-v4                       Solaris-ram                          AtariEnv       
    Solaris-ramDeterministic-v4          Solaris-ramDeterministic             AtariEnv       
    Solaris-ramNoFrameskip-v4            Solaris-ramNoFrameskip               AtariEnv       
    SpaceInvaders-v0                     SpaceInvaders                        AtariEnv       
    SpaceInvadersDeterministic-v0        SpaceInvadersDeterministic           AtariEnv       
    SpaceInvadersNoFrameskip-v0          SpaceInvadersNoFrameskip             AtariEnv       
    SpaceInvaders-v4                     SpaceInvaders                        AtariEnv       
    SpaceInvadersDeterministic-v4        SpaceInvadersDeterministic           AtariEnv       
    SpaceInvadersNoFrameskip-v4          SpaceInvadersNoFrameskip             AtariEnv       
    SpaceInvaders-ram-v0                 SpaceInvaders-ram                    AtariEnv       
    SpaceInvaders-ramDeterministic-v0    SpaceInvaders-ramDeterministic       AtariEnv       
    SpaceInvaders-ramNoFrameskip-v0      SpaceInvaders-ramNoFrameskip         AtariEnv       
    SpaceInvaders-ram-v4                 SpaceInvaders-ram                    AtariEnv       
    SpaceInvaders-ramDeterministic-v4    SpaceInvaders-ramDeterministic       AtariEnv       
    SpaceInvaders-ramNoFrameskip-v4      SpaceInvaders-ramNoFrameskip         AtariEnv       
    StarGunner-v0                        StarGunner                           AtariEnv       
    StarGunnerDeterministic-v0           StarGunnerDeterministic              AtariEnv       
    StarGunnerNoFrameskip-v0             StarGunnerNoFrameskip                AtariEnv       
    StarGunner-v4                        StarGunner                           AtariEnv       
    StarGunnerDeterministic-v4           StarGunnerDeterministic              AtariEnv       
    StarGunnerNoFrameskip-v4             StarGunnerNoFrameskip                AtariEnv       
    StarGunner-ram-v0                    StarGunner-ram                       AtariEnv       
    StarGunner-ramDeterministic-v0       StarGunner-ramDeterministic          AtariEnv       
    StarGunner-ramNoFrameskip-v0         StarGunner-ramNoFrameskip            AtariEnv       
    StarGunner-ram-v4                    StarGunner-ram                       AtariEnv       
    StarGunner-ramDeterministic-v4       StarGunner-ramDeterministic          AtariEnv       
    StarGunner-ramNoFrameskip-v4         StarGunner-ramNoFrameskip            AtariEnv       
    Tennis-v0                            Tennis                               AtariEnv       
    TennisDeterministic-v0               TennisDeterministic                  AtariEnv       
    TennisNoFrameskip-v0                 TennisNoFrameskip                    AtariEnv       
    Tennis-v4                            Tennis                               AtariEnv       
    TennisDeterministic-v4               TennisDeterministic                  AtariEnv       
    TennisNoFrameskip-v4                 TennisNoFrameskip                    AtariEnv       
    Tennis-ram-v0                        Tennis-ram                           AtariEnv       
    Tennis-ramDeterministic-v0           Tennis-ramDeterministic              AtariEnv       
    Tennis-ramNoFrameskip-v0             Tennis-ramNoFrameskip                AtariEnv       
    Tennis-ram-v4                        Tennis-ram                           AtariEnv       
    Tennis-ramDeterministic-v4           Tennis-ramDeterministic              AtariEnv       
    Tennis-ramNoFrameskip-v4             Tennis-ramNoFrameskip                AtariEnv       
    TimePilot-v0                         TimePilot                            AtariEnv       
    TimePilotDeterministic-v0            TimePilotDeterministic               AtariEnv       
    TimePilotNoFrameskip-v0              TimePilotNoFrameskip                 AtariEnv       
    TimePilot-v4                         TimePilot                            AtariEnv       
    TimePilotDeterministic-v4            TimePilotDeterministic               AtariEnv       
    TimePilotNoFrameskip-v4              TimePilotNoFrameskip                 AtariEnv       
    TimePilot-ram-v0                     TimePilot-ram                        AtariEnv       
    TimePilot-ramDeterministic-v0        TimePilot-ramDeterministic           AtariEnv       
    TimePilot-ramNoFrameskip-v0          TimePilot-ramNoFrameskip             AtariEnv       
    TimePilot-ram-v4                     TimePilot-ram                        AtariEnv       
    TimePilot-ramDeterministic-v4        TimePilot-ramDeterministic           AtariEnv       
    TimePilot-ramNoFrameskip-v4          TimePilot-ramNoFrameskip             AtariEnv       
    Tutankham-v0                         Tutankham                            AtariEnv       
    TutankhamDeterministic-v0            TutankhamDeterministic               AtariEnv       
    TutankhamNoFrameskip-v0              TutankhamNoFrameskip                 AtariEnv       
    Tutankham-v4                         Tutankham                            AtariEnv       
    TutankhamDeterministic-v4            TutankhamDeterministic               AtariEnv       
    TutankhamNoFrameskip-v4              TutankhamNoFrameskip                 AtariEnv       
    Tutankham-ram-v0                     Tutankham-ram                        AtariEnv       
    Tutankham-ramDeterministic-v0        Tutankham-ramDeterministic           AtariEnv       
    Tutankham-ramNoFrameskip-v0          Tutankham-ramNoFrameskip             AtariEnv       
    Tutankham-ram-v4                     Tutankham-ram                        AtariEnv       
    Tutankham-ramDeterministic-v4        Tutankham-ramDeterministic           AtariEnv       
    Tutankham-ramNoFrameskip-v4          Tutankham-ramNoFrameskip             AtariEnv       
    UpNDown-v0                           UpNDown                              AtariEnv       
    UpNDownDeterministic-v0              UpNDownDeterministic                 AtariEnv       
    UpNDownNoFrameskip-v0                UpNDownNoFrameskip                   AtariEnv       
    UpNDown-v4                           UpNDown                              AtariEnv       
    UpNDownDeterministic-v4              UpNDownDeterministic                 AtariEnv       
    UpNDownNoFrameskip-v4                UpNDownNoFrameskip                   AtariEnv       
    UpNDown-ram-v0                       UpNDown-ram                          AtariEnv       
    UpNDown-ramDeterministic-v0          UpNDown-ramDeterministic             AtariEnv       
    UpNDown-ramNoFrameskip-v0            UpNDown-ramNoFrameskip               AtariEnv       
    UpNDown-ram-v4                       UpNDown-ram                          AtariEnv       
    UpNDown-ramDeterministic-v4          UpNDown-ramDeterministic             AtariEnv       
    UpNDown-ramNoFrameskip-v4            UpNDown-ramNoFrameskip               AtariEnv       
    Venture-v0                           Venture                              AtariEnv       
    VentureDeterministic-v0              VentureDeterministic                 AtariEnv       
    VentureNoFrameskip-v0                VentureNoFrameskip                   AtariEnv       
    Venture-v4                           Venture                              AtariEnv       
    VentureDeterministic-v4              VentureDeterministic                 AtariEnv       
    VentureNoFrameskip-v4                VentureNoFrameskip                   AtariEnv       
    Venture-ram-v0                       Venture-ram                          AtariEnv       
    Venture-ramDeterministic-v0          Venture-ramDeterministic             AtariEnv       
    Venture-ramNoFrameskip-v0            Venture-ramNoFrameskip               AtariEnv       
    Venture-ram-v4                       Venture-ram                          AtariEnv       
    Venture-ramDeterministic-v4          Venture-ramDeterministic             AtariEnv       
    Venture-ramNoFrameskip-v4            Venture-ramNoFrameskip               AtariEnv       
    VideoPinball-v0                      VideoPinball                         AtariEnv       
    VideoPinballDeterministic-v0         VideoPinballDeterministic            AtariEnv       
    VideoPinballNoFrameskip-v0           VideoPinballNoFrameskip              AtariEnv       
    VideoPinball-v4                      VideoPinball                         AtariEnv       
    VideoPinballDeterministic-v4         VideoPinballDeterministic            AtariEnv       
    VideoPinballNoFrameskip-v4           VideoPinballNoFrameskip              AtariEnv       
    VideoPinball-ram-v0                  VideoPinball-ram                     AtariEnv       
    VideoPinball-ramDeterministic-v0     VideoPinball-ramDeterministic        AtariEnv       
    VideoPinball-ramNoFrameskip-v0       VideoPinball-ramNoFrameskip          AtariEnv       
    VideoPinball-ram-v4                  VideoPinball-ram                     AtariEnv       
    VideoPinball-ramDeterministic-v4     VideoPinball-ramDeterministic        AtariEnv       
    VideoPinball-ramNoFrameskip-v4       VideoPinball-ramNoFrameskip          AtariEnv       
    WizardOfWor-v0                       WizardOfWor                          AtariEnv       
    WizardOfWorDeterministic-v0          WizardOfWorDeterministic             AtariEnv       
    WizardOfWorNoFrameskip-v0            WizardOfWorNoFrameskip               AtariEnv       
    WizardOfWor-v4                       WizardOfWor                          AtariEnv       
    WizardOfWorDeterministic-v4          WizardOfWorDeterministic             AtariEnv       
    WizardOfWorNoFrameskip-v4            WizardOfWorNoFrameskip               AtariEnv       
    WizardOfWor-ram-v0                   WizardOfWor-ram                      AtariEnv       
    WizardOfWor-ramDeterministic-v0      WizardOfWor-ramDeterministic         AtariEnv       
    WizardOfWor-ramNoFrameskip-v0        WizardOfWor-ramNoFrameskip           AtariEnv       
    WizardOfWor-ram-v4                   WizardOfWor-ram                      AtariEnv       
    WizardOfWor-ramDeterministic-v4      WizardOfWor-ramDeterministic         AtariEnv       
    WizardOfWor-ramNoFrameskip-v4        WizardOfWor-ramNoFrameskip           AtariEnv       
    YarsRevenge-v0                       YarsRevenge                          AtariEnv       
    YarsRevengeDeterministic-v0          YarsRevengeDeterministic             AtariEnv       
    YarsRevengeNoFrameskip-v0            YarsRevengeNoFrameskip               AtariEnv       
    YarsRevenge-v4                       YarsRevenge                          AtariEnv       
    YarsRevengeDeterministic-v4          YarsRevengeDeterministic             AtariEnv       
    YarsRevengeNoFrameskip-v4            YarsRevengeNoFrameskip               AtariEnv       
    YarsRevenge-ram-v0                   YarsRevenge-ram                      AtariEnv       
    YarsRevenge-ramDeterministic-v0      YarsRevenge-ramDeterministic         AtariEnv       
    YarsRevenge-ramNoFrameskip-v0        YarsRevenge-ramNoFrameskip           AtariEnv       
    YarsRevenge-ram-v4                   YarsRevenge-ram                      AtariEnv       
    YarsRevenge-ramDeterministic-v4      YarsRevenge-ramDeterministic         AtariEnv       
    YarsRevenge-ramNoFrameskip-v4        YarsRevenge-ramNoFrameskip           AtariEnv       
    Zaxxon-v0                            Zaxxon                               AtariEnv       
    ZaxxonDeterministic-v0               ZaxxonDeterministic                  AtariEnv       
    ZaxxonNoFrameskip-v0                 ZaxxonNoFrameskip                    AtariEnv       
    Zaxxon-v4                            Zaxxon                               AtariEnv       
    ZaxxonDeterministic-v4               ZaxxonDeterministic                  AtariEnv       
    ZaxxonNoFrameskip-v4                 ZaxxonNoFrameskip                    AtariEnv       
    Zaxxon-ram-v0                        Zaxxon-ram                           AtariEnv       
    Zaxxon-ramDeterministic-v0           Zaxxon-ramDeterministic              AtariEnv       
    Zaxxon-ramNoFrameskip-v0             Zaxxon-ramNoFrameskip                AtariEnv       
    Zaxxon-ram-v4                        Zaxxon-ram                           AtariEnv       
    Zaxxon-ramDeterministic-v4           Zaxxon-ramDeterministic              AtariEnv       
    Zaxxon-ramNoFrameskip-v4             Zaxxon-ramNoFrameskip                AtariEnv       
    CartPole-v0                          CartPole                             CartPoleEnv    
    CartPole-v1                          CartPole                             CartPoleEnv    
    MountainCar-v0                       MountainCar                          MountainCarEnv 
    MountainCarContinuous-v0             MountainCarContinuous                Continuous_MountainCarEnv
    Pendulum-v1                          Pendulum                             PendulumEnv    
    Acrobot-v1                           Acrobot                              AcrobotEnv     
    LunarLander-v2                       LunarLander                          LunarLander    
    LunarLanderContinuous-v2             LunarLanderContinuous                LunarLander    
    BipedalWalker-v3                     BipedalWalker                        BipedalWalker  
    BipedalWalkerHardcore-v3             BipedalWalkerHardcore                BipedalWalker  
    CarRacing-v1                         CarRacing                            CarRacing      
    CarRacingDomainRandomize-v1          CarRacingDomainRandomize             CarRacing      
    CarRacingDiscrete-v1                 CarRacingDiscrete                    CarRacing      
    CarRacingDomainRandomizeDiscrete-v1  CarRacingDomainRandomizeDiscrete     CarRacing      
    Blackjack-v1                         Blackjack                            BlackjackEnv   
    FrozenLake-v1                        FrozenLake                           FrozenLakeEnv  
    FrozenLake8x8-v1                     FrozenLake8x8                        FrozenLakeEnv  
    CliffWalking-v0                      CliffWalking                         CliffWalkingEnv
    Taxi-v3                              Taxi                                 TaxiEnv        
    Reacher-v2                           Reacher                              ReacherEnv     
    Reacher-v4                           Reacher                              ReacherEnv     
    Pusher-v2                            Pusher                               PusherEnv      
    Pusher-v4                            Pusher                               PusherEnv      
    InvertedPendulum-v2                  InvertedPendulum                     InvertedPendulumEnv
    InvertedPendulum-v4                  InvertedPendulum                     InvertedPendulumEnv
    InvertedDoublePendulum-v2            InvertedDoublePendulum               InvertedDoublePendulumEnv
    InvertedDoublePendulum-v4            InvertedDoublePendulum               InvertedDoublePendulumEnv
    HalfCheetah-v2                       HalfCheetah                          HalfCheetahEnv 
    HalfCheetah-v3                       HalfCheetah                          HalfCheetahEnv 
    HalfCheetah-v4                       HalfCheetah                          HalfCheetahEnv 
    Hopper-v2                            Hopper                               HopperEnv      
    Hopper-v3                            Hopper                               HopperEnv      
    Hopper-v4                            Hopper                               HopperEnv      
    Swimmer-v2                           Swimmer                              SwimmerEnv     
    Swimmer-v3                           Swimmer                              SwimmerEnv     
    Swimmer-v4                           Swimmer                              SwimmerEnv     
    Walker2d-v2                          Walker2d                             Walker2dEnv    
    Walker2d-v3                          Walker2d                             Walker2dEnv    
    Walker2d-v4                          Walker2d                             Walker2dEnv    
    Ant-v2                               Ant                                  AntEnv         
    Ant-v3                               Ant                                  AntEnv         
    Ant-v4                               Ant                                  AntEnv         
    Humanoid-v2                          Humanoid                             HumanoidEnv    
    Humanoid-v3                          Humanoid                             HumanoidEnv    
    Humanoid-v4                          Humanoid                             HumanoidEnv    
    HumanoidStandup-v2                   HumanoidStandup                      HumanoidStandupEnv
    HumanoidStandup-v4                   HumanoidStandup                      HumanoidStandupEnv
    
    
    游戏环境detail:
    EnvSpec(id='HumanoidStandup-v4', entry_point='gym.envs.mujoco.humanoidstandup_v4:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=4)
    <class 'dict_keys'>
    <class 'dict_values'>
    View Code
    环境测试阶段:
    A.L.E: Arcade Learning Environment (version 0.7.5+db37282)
    [Powered by Stella]
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AdventureDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AdventureNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaidDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaidNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AlienDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AlienNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AmidarDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AmidarNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AssaultDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AssaultNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsterixDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsterixNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsteroidsDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsteroidsNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AtlantisDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AtlantisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeistDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeistNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZoneDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZoneNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRiderDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRiderNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BerzerkDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BerzerkNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BowlingDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BowlingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BoxingDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BoxingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BreakoutDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BreakoutNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CarnivalDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CarnivalNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CentipedeDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CentipedeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommandDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommandNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimberDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimberNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DefenderDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DefenderNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttackDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttackNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunkDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunkNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorActionDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorActionNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment EnduroDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment EnduroNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerbyDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerbyNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FreewayDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FreewayNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FrostbiteDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FrostbiteNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GopherDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GopherNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GravitarDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GravitarNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HeroDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HeroNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockeyDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockeyNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JamesbondDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JamesbondNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscapeDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscapeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KangarooDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KangarooNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KrullDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KrullNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMasterDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMasterNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevengeDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevengeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacmanDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacmanNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGameDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGameNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PhoenixDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PhoenixNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PitfallDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PitfallNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PongDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PongNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PooyanDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PooyanNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEyeDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEyeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment QbertDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment QbertNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RiverraidDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RiverraidNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunnerDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunnerNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RobotankDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RobotankNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SeaquestDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SeaquestNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SkiingDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SkiingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SolarisDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SolarisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvadersDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvadersNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunnerDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunnerNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TennisDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TennisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilotDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilotNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TutankhamDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TutankhamNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDownDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDownNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VentureDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VentureNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinballDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinballNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWorDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWorNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevengeDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevengeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ZaxxonDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ZaxxonNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ram-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CartPole-v0 is out of date. You should consider upgrading to version `v1`.
      logger.warn(
    EnvSpec(id='CartPole-v0', entry_point='gym.envs.classic_control.cartpole:CartPoleEnv', reward_threshold=195.0, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CartPole', version=0)
    EnvSpec(id='CartPole-v1', entry_point='gym.envs.classic_control.cartpole:CartPoleEnv', reward_threshold=475.0, nondeterministic=False, max_episode_steps=500, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CartPole', version=1)
    EnvSpec(id='MountainCar-v0', entry_point='gym.envs.classic_control.mountain_car:MountainCarEnv', reward_threshold=-110.0, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='MountainCar', version=0)
    EnvSpec(id='MountainCarContinuous-v0', entry_point='gym.envs.classic_control.continuous_mountain_car:Continuous_MountainCarEnv', reward_threshold=90.0, nondeterministic=False, max_episode_steps=999, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='MountainCarContinuous', version=0)
    EnvSpec(id='Pendulum-v1', entry_point='gym.envs.classic_control.pendulum:PendulumEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pendulum', version=1)
    EnvSpec(id='Acrobot-v1', entry_point='gym.envs.classic_control.acrobot:AcrobotEnv', reward_threshold=-100.0, nondeterministic=False, max_episode_steps=500, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Acrobot', version=1)
    EnvSpec(id='LunarLander-v2', entry_point='gym.envs.box2d.lunar_lander:LunarLander', reward_threshold=200, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='LunarLander', version=2)
    EnvSpec(id='LunarLanderContinuous-v2', entry_point='gym.envs.box2d.lunar_lander:LunarLander', reward_threshold=200, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'continuous': True}, namespace=None, name='LunarLanderContinuous', version=2)
    EnvSpec(id='BipedalWalker-v3', entry_point='gym.envs.box2d.bipedal_walker:BipedalWalker', reward_threshold=300, nondeterministic=False, max_episode_steps=1600, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='BipedalWalker', version=3)
    EnvSpec(id='BipedalWalkerHardcore-v3', entry_point='gym.envs.box2d.bipedal_walker:BipedalWalker', reward_threshold=300, nondeterministic=False, max_episode_steps=2000, order_enforce=True, autoreset=False, kwargs={'hardcore': True}, namespace=None, name='BipedalWalkerHardcore', version=3)
    EnvSpec(id='CarRacing-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CarRacing', version=1)
    EnvSpec(id='CarRacingDomainRandomize-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'domain_randomize': True}, namespace=None, name='CarRacingDomainRandomize', version=1)
    EnvSpec(id='CarRacingDiscrete-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'continuous': False}, namespace=None, name='CarRacingDiscrete', version=1)
    EnvSpec(id='CarRacingDomainRandomizeDiscrete-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'domain_randomize': True, 'continuous': False}, namespace=None, name='CarRacingDomainRandomizeDiscrete', version=1)
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Reacher-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pusher-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment InvertedPendulum-v2 is out of date. You should consider upgrading to version `v4`.
    EnvSpec(id='Blackjack-v1', entry_point='gym.envs.toy_text.blackjack:BlackjackEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=None, order_enforce=True, autoreset=False, kwargs={'sab': True, 'natural': False}, namespace=None, name='Blackjack', version=1)
    EnvSpec(id='FrozenLake-v1', entry_point='gym.envs.toy_text.frozen_lake:FrozenLakeEnv', reward_threshold=0.7, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={'map_name': '4x4'}, namespace=None, name='FrozenLake', version=1)
    EnvSpec(id='FrozenLake8x8-v1', entry_point='gym.envs.toy_text.frozen_lake:FrozenLakeEnv', reward_threshold=0.85, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={'map_name': '8x8'}, namespace=None, name='FrozenLake8x8', version=1)
    EnvSpec(id='CliffWalking-v0', entry_point='gym.envs.toy_text.cliffwalking:CliffWalkingEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=None, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CliffWalking', version=0)
    EnvSpec(id='Taxi-v3', entry_point='gym.envs.toy_text.taxi:TaxiEnv', reward_threshold=8, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Taxi', version=3)
    EnvSpec(id='Reacher-v2', entry_point='gym.envs.mujoco:ReacherEnv', reward_threshold=-3.75, nondeterministic=False, max_episode_steps=50, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Reacher', version=2)
    EnvSpec(id='Reacher-v4', entry_point='gym.envs.mujoco.reacher_v4:ReacherEnv', reward_threshold=-3.75, nondeterministic=False, max_episode_steps=50, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Reacher', version=4)
    EnvSpec(id='Pusher-v2', entry_point='gym.envs.mujoco:PusherEnv', reward_threshold=0.0, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pusher', version=2)
    EnvSpec(id='Pusher-v4', entry_point='gym.envs.mujoco.pusher_v4:PusherEnv', reward_threshold=0.0, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pusher', version=4)
    EnvSpec(id='InvertedPendulum-v2', entry_point='gym.envs.mujoco:InvertedPendulumEnv', reward_threshold=950.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedPendulum', version=2)
    EnvSpec(id='InvertedPendulum-v4', entry_point='gym.envs.mujoco.inverted_pendulum_v4:InvertedPendulumEnv', reward_threshold=950.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedPendulum', version=4)
    EnvSpec(id='InvertedDoublePendulum-v2', entry_point='gym.envs.mujoco:InvertedDoublePendulumEnv', reward_threshold=9100.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedDoublePendulum', version=2)
    EnvSpec(id='InvertedDoublePendulum-v4', entry_point='gym.envs.mujoco.inverted_double_pendulum_v4:InvertedDoublePendulumEnv', reward_threshold=9100.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedDoublePendulum', version=4)
    EnvSpec(id='HalfCheetah-v2', entry_point='gym.envs.mujoco:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=2)
    EnvSpec(id='HalfCheetah-v3', entry_point='gym.envs.mujoco.half_cheetah_v3:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=3)
    EnvSpec(id='HalfCheetah-v4', entry_point='gym.envs.mujoco.half_cheetah_v4:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=4)
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment InvertedDoublePendulum-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HalfCheetah-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HalfCheetah-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hopper-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hopper-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Swimmer-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Swimmer-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Walker2d-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Walker2d-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    EnvSpec(id='Hopper-v2', entry_point='gym.envs.mujoco:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=2)
    EnvSpec(id='Hopper-v3', entry_point='gym.envs.mujoco.hopper_v3:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=3)
    EnvSpec(id='Hopper-v4', entry_point='gym.envs.mujoco.hopper_v4:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=4)
    EnvSpec(id='Swimmer-v2', entry_point='gym.envs.mujoco:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=2)
    EnvSpec(id='Swimmer-v3', entry_point='gym.envs.mujoco.swimmer_v3:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=3)
    EnvSpec(id='Swimmer-v4', entry_point='gym.envs.mujoco.swimmer_v4:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=4)
    EnvSpec(id='Walker2d-v2', entry_point='gym.envs.mujoco:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=2)
    EnvSpec(id='Walker2d-v3', entry_point='gym.envs.mujoco.walker2d_v3:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=3)
    EnvSpec(id='Walker2d-v4', entry_point='gym.envs.mujoco.walker2d_v4:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=4)
    EnvSpec(id='Ant-v2', entry_point='gym.envs.mujoco:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=2)
    EnvSpec(id='Ant-v3', entry_point='gym.envs.mujoco.ant_v3:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=3)
    EnvSpec(id='Ant-v4', entry_point='gym.envs.mujoco.ant_v4:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=4)
    EnvSpec(id='Humanoid-v2', entry_point='gym.envs.mujoco:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=2)
    EnvSpec(id='Humanoid-v3', entry_point='gym.envs.mujoco.humanoid_v3:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=3)
    EnvSpec(id='Humanoid-v4', entry_point='gym.envs.mujoco.humanoid_v4:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=4)
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Ant-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Ant-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Humanoid-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Humanoid-v3 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HumanoidStandup-v2 is out of date. You should consider upgrading to version `v4`.
      logger.warn(
    EnvSpec(id='HumanoidStandup-v2', entry_point='gym.envs.mujoco:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=2)
    EnvSpec(id='HumanoidStandup-v4', entry_point='gym.envs.mujoco.humanoidstandup_v4:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=4)
    报错环境数为: 47
    用时: 1163.6926209926605
    View Code

    可以看到所以的Atari游戏均可以正常运行,这也是比前几版本的gym[atari]要好的地方,因为前几版本的Atari游戏中pacman和surround游戏会运行报错,而新版本的gym中就很好的解决了这个问题。(上面运行的环境出现报错的情况是因为对应的gym组件没有安装,如mujoco)

     

     不过值得我们注意的一点是虽然Atari的所有游戏环境均可正常运行但是却又很多都有警告提示,如:

    具体如:

    UserWarning: WARN: The environment SpaceInvadersNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.

     

    而这个警告就是说有些游戏环境的v0版本已过时,建议使用v4版本,对此我们看了下gym对应Atari页面的说明:

    https://github.com/mgbellemare/Arcade-Learning-Environment#rom-management

     

    我们看到关于游戏环境版本的问题可以参看官方的对应论文:

     Revisiting the Arcade Learning Environment by Machado et al..

     

     

     

     

    ==========================================

     

     

  • 相关阅读:
    集合 Subset Sums
    resin config 中文(resin.xml)
    resin4 简单学习
    什么是敏捷软件测试
    10个热门IT证书
    LoadRunner监控Linux服务器
    Agile 敏捷开发
    戴明PDCA方法
    【转】什么是内存泄露? 内存泄露检测工具
    LoadRunner常见问题
  • 原文地址:https://www.cnblogs.com/devilmaycry812839668/p/16329699.html
Copyright © 2020-2023  润新知