aa4ae658489c919dbca4141c7498b05ac0cac6d8,slm_lab/agent/__init__.py,AgentSpace,act,#AgentSpace#Any#,148

Before Change


    @lab_api
    def act(self, state_space):
        data_names = ("action",)
        action_v, = self.aeb_space.init_data_v(data_names)
        for agent in self.agents:
            a = agent.a
            state_a = state_space.get(a=a)

After Change


    def update(self, state, action, reward, next_state, done):
        """Update per timestep after env transitions, e.g. memory, algorithm, update agent params, train net"""
        self.body.update(state, action, reward, next_state, done)
        if util.in_eval_lab_modes():  // eval does not update agent for training
            return
        self.body.memory.update(state, action, reward, next_state, done)
        loss = self.algorithm.train()
        if not np.isnan(loss):  // set for log_summary()
            self.body.loss = loss
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 3

Non-data size: 3

Instances


Project Name: kengz/SLM-Lab
Commit Name: aa4ae658489c919dbca4141c7498b05ac0cac6d8
Time: 2019-05-25
Author: kengzwl@gmail.com
File Name: slm_lab/agent/__init__.py
Class Name: AgentSpace
Method Name: act


Project Name: kengz/SLM-Lab
Commit Name: 8c17debc9dc6552da8c317c0c852b55f03c80c61
Time: 2017-12-24
Author: kengzwl@gmail.com
File Name: slm_lab/env/__init__.py
Class Name: OpenAIEnv
Method Name: step


Project Name: kengz/SLM-Lab
Commit Name: 8c17debc9dc6552da8c317c0c852b55f03c80c61
Time: 2017-12-24
Author: kengzwl@gmail.com
File Name: slm_lab/env/__init__.py
Class Name: Env
Method Name: step