ezToken Struct Reference

Represents one piece of tokenized text in a document. More...

#include <Tokenizer.h>

Public Attributes
ezInt32	m_iType
	Typically of type ezTokenType, but users can put anything in there, that they like.
ezUInt32	m_uiLine
	The line in which the token appeared.
ezUInt32	m_uiColumn
	The column in the line, at which the token string started.
ezStringView	m_DataView
ezUInt32	m_uiCustomFlags
	For users to be able to store additional info for a token.
ezHashedString	m_File
	The file in which the token appeared.

Detailed Description

Represents one piece of tokenized text in a document.

Member Data Documentation

m_DataView

ezStringView ezToken::m_DataView

The actual string data that represents the token. Note that this is a view to a substring of some larger text data. To get only the relevant piece as one zero-terminated string, assign m_DataView to an ezStringBuilder and read that instead.

---

The documentation for this struct was generated from the following file:

• /home/runner/work/ezEngine/ezEngine/Code/Engine/Foundation/CodeUtils/Tokenizer.h