... et al.'s system, which is given only a corpus of sentences as input, MAIMRA is given two correlated streams of input, one linguistic and one non -linguistic, the later modeling the visual context ... sentences, and non -linguistic information The non -linguistic information is a sequence of conceptual structure [STATE] descriptions which describe a sequence of visual scenes MAIMRA produces as output, ... linker, as meanings of entire utterances, are represented as either conceptual structure [STATE] or [EVENT] descriptions Second, the observation sequence comprising the non -linguistic input is represented...