At the moment memory is only available when using the ipython magic %%chat. I think some type of memory should be implemented at the level of the agent executor, by using e.g. ConversationBufferWindowMemory. I can give it a try.