core.tokenizer.Tokenizer Class Reference

DVM Token creator. More...

Inherits object.

Public Member Functions
def	__init__
def	add
	Add a token to the runtime. More...
def	simple
	Create a simple token, with a known destination. More...
def	stopToken
	Create a stop token. More...

Public Attributes
	core
	switcher
	contexts
	contextMap
	restoreMap

Detailed Description

DVM Token creator.

The token creator is responsible for wrapping results of instructions in tokens.

Constructor & Destructor Documentation

def core.tokenizer.Tokenizer.__init__	(		self,
			core
	)

Member Function Documentation

def core.tokenizer.Tokenizer.add	(		self,
			token,
			core = None
	)

Add a token to the runtime.

Use instead of directly using the core, so that we have a central point for redirecting the token to a different core.

def core.tokenizer.Tokenizer.simple	(		self,
			datum,
			toInst,
			toPort,
			context,
			core = None
	)

Create a simple token, with a known destination.

def core.tokenizer.Tokenizer.stopToken	(		self,
			tok
	)

Create a stop token.

Parameters

tok	The token to convert to a stop token.

Member Data Documentation

core.tokenizer.Tokenizer.core

core.tokenizer.Tokenizer.switcher

core.tokenizer.Tokenizer.contexts

core.tokenizer.Tokenizer.contextMap

core.tokenizer.Tokenizer.restoreMap