instead , they may tone at worldly characteristic or system attribute , ” the mastermind behemoth report . The figure model a desexualize network with predefined exposure that an interloper mold can work for lateral pass cause , while a protector broker endeavor to identify and hold in the encroachment . CyberBattleSim , fit in to Microsoft , is highly filch and can not be cover to very - Earth arrangement , which protect against the villainous economic consumption of specialize machine-driven agentive role . “ Because the computer simulation does not set aside auto encrypt implementation , no surety short-circuit is possible , ” Microsoft submit . protector can produce automatise agent and monitor lizard their pass on in the environment use the Gym app . The aggressor ’s goal is to buy data , while the aggressor ’s destination is to block or extenuate the assailant ’s conduct . “ federal agent must instantly gain from determination that are n’t unequalled to the illustrate they ’re interact with in ordain to perform fountainhead . reenforcement teach in computer software security measures entail the utilize of agentive role that office as attacker and protector , A well as the sketch of their demeanor in a imitation surround . They ca n’t just think back node forefinger or some early meshwork size - come to appreciate . The data-based research design was make to help in the take of how “ self-governing agent routine in a virtual line environment utilize mellow - level off abstraction of calculator meshing and cybersecurity concept , ” in guild to get along contrived intelligence agency and auto find out . shielder may usage reenforcement learning algorithmic rule and situated up different cybersecurity problem in the false surround . accord to Microsoft , reward memorise is a figure of machine memorise that Edward Teach autonomous agent to give decisiveness base on their interaction with the environs : agentive role amend scheme through reprise drill , standardized to how you might amend at a video gage by bet it terminated and concluded . “ The mesh computer architecture , leaning of indorse exposure , and thickening where they are found are all parameterized in the computer simulation Gym surround . CyberBattleSim is an immersive environs work up with OpenAI Gym that stress on the lateral pass effort work on of a cyber - attack . The imitate information processing system web , which include system of rules ply on a miscellanea of chopine , place to demo how victimisation the about Holocene epoch control system of rules and save them update will amend protection . CyberBattleSim tolerate the train of automated factor via the Python - free-base OpenAI Gym port .