posted on 2008-01-01, 00:00authored byRonald Rosenfeld, David S Touretzky, Artificial Intelligence and Psychology Project.
Abstract: "Coarse-coded symbol memories have appeared in several neural network symbol processing models. In order to determine how these models would scale, one must first have some understanding of the mathematics of coarse-coded representations. We define the general structure of coarse-coded symbol memories, and discuss their strengths and weaknesses. Memory schemes can be characterized by their memory size, symbol-set size and capacity. We derive mathematical relationships between these parameters for various memory schemes, using both analysis and numerical methods. Finally, we compare the predicted capacity of one of the schemes with actual measurements of the coarse-coded working memory of DCPS, Touretzky and Hinton's distributed connectionist production system."