Low-Energy Reduced RISC-V Instruction Subset Processor for Tsetlin Machine Inference at the Edge

Lightweight machine learning models are increasingly explored for edge intelligence due to their reduced computational requirements. Among these, Binarized Neural Networks (BNNs) and Tsetlin Machines (TM) have drawn interest as effective substitutes for traditional deep learning models. Tsetlin Machine (TM) is an logic-based machine learning model that uses propositional logic for pattern recognition tasks [6]. Its core components include Tsetlin Automata (TA) organized into conjunctive clauses, along with summation, threshold, and feedback modules. BNNs are derived from conventional deep neural networks by constraining weights and activations to binary values. They employ multi-layer architectures and backpropagation-based training, replacing costly arithmetic operations with efficient bitwise operations. This significantly reduces computational complexity and memory usage, making BNNs suitable for resource-constrained edge environments. For multi-class classification, we employ the Multiclass TM, where each class is represented by a set of clauses. Since most real-world tasks involve multiple classes, the terms TM and Multiclass TM are used interchangeably in this work. As illustrated in Fig. 1, a Multiclass TM consists of $M$ classes, each containing $N$ clauses. Each clause is constructed from a group of TAs, where the number of automata equals twice the number of Boolean input features to account for both inputs and their negations. A Booleanizer converts raw input features into binary values and their complements, which serve as inputs to the clause computation module. For each datapoint, the clause computation stage produces a 1-bit output per clause based on the collective decisions of the associated TAs. Each class contains an even number of clauses with alternating polarities of $+1$ and $-1$, indicating whether a clause supports or opposes the classification outcome. The clause outputs are aggregated through a summation process to compute a class sum for each class, and an $\arg\max$ operation selects the class with the highest sum as the predicted output. Using straightforward logical procedures, this voting-based system allows for effective and comprehensible classification. The threshold $T$ and the specificity parameter $s$ are two important hyperparameters in TM. While $s$ establishes the likelihood of using literals in clauses, the $T$ regulates the number of clauses that take part in voting.

An open-source, modular, extensible platform for processor design is offered by RISC-V, which enables designers to set up cores for domain-specific applications [3]. A basic standardized base instruction set, such as RV32I, is defined by the RISC-V ISA and can be expanded or decreased. It provides fine-grained control over memory management, execution units, and the processor pipeline to optimize deterministic machine learning workloads. In addition, rapid development and deployment are supported by established toolchains of RISC-V, including open-source cores and GCC-based compilers. Furthermore, efficient mapping of application-specific workloads onto hardware is made possible by the ability to customize both the instruction subset and microarchitecture, which minimizes needless computational cost.Therefore, RISC-V serves as an efficient hardware platform for logic-based, lightweight machine learning models such as the Tsetlin Machine. Scalable edge AI deployments require a balance between programmability and hardware efficiency, which is made possible by such domain-specific customization.

The proposed design flow consists of three stages, as shown in Fig. 2. Stage 1 performs dataset Booleanization and Tsetlin Machine (TM) model generation. Stage 2 focuses on instruction profiling to enable ISA reduction along with initial datapath and control path simplifications. Stage 3 applies further refinement to the datapath and control logic to reduce complexity and improve efficiency for TM inference on the RISC-V processor.

We implemented multiple inference strategies on RISC-V cores for comprehensive evaluation. Two Tsetlin Machine approaches (T1 and T2) were used, differing in clause storage and evaluation, along with a baseline BNN inference for fair comparison due to its similar bitwise operations.

1) Vanilla TM inference (T1): Vanilla TM inference refers to the standard clause evaluation process without any optimization techniques. In this strategy, each clause is evaluated by sequentially checking every literal for inclusion and then comparing it against the input literal vector. After clause evaluation, the vote sum is computed sequentially for each class, and the class with the highest vote sum is selected as the output. The literal states (include/exclude) are stored in memory for each clause as boolean values. This procedure is formalized in Algorithm 1. At lines $1$–$8$, the algorithm iterates over each class and clause, evaluating useful clauses by checking literal inclusion and updating the clause output through logical operations, while non-useful clauses are skipped to avoid unnecessary computation. Subsequently, lines $9$–$16$ compute the vote total for each class by incrementing or decrementing votes based on clause polarity. Finally, at line $17$, the class with the maximum vote value is selected as the predicted output. It is implemented in C++, and the RISC-V GNU toolchain [13] is used for cross-compilation.

2) Modified TM inference (T2): To improve efficiency, we implemented a second inference strategy inspired by [11], in which each clause stores only the indices of literals that are actually included, encoded as half-words (16-bit values). Only these indices are accessed and assessed during inference. The number of memory accesses, memory usage, and logical comparisons needed for clause evaluation are all greatly decreased by this sparse clause structure. For example, even if only 10 literals are active in a sentence containing 128 literals, the usual technique needs keeping 128 inclusion flags, each taking up a byte (in C++ Inference). The improved version, on the other hand, only needs to hold ten indices, each of which usually requires two bytes, greatly lowering the memory footprint in these situations. The improved strategy ensures functional equivalency with the traditional approach while preserving the semantics of clause evaluation in spite of this compression. This procedure is formalized in Algorithm 2. At lines $1$–$9$, the algorithm iterates over each class and clause, evaluating only the literals whose indices are stored in memory. If a clause contains included literals, the clause output is initialized and updated by sequentially checking the referenced literal values; otherwise, the clause output is set to zero to avoid unnecessary computation. Subsequently, lines $10$–$17$ compute the vote total for each class by adjusting votes based on clause polarity. Finally, at line $18$, the class with the maximum vote value is selected as the predicted output.

3) Binarized Neural Networks (BNNs): To ensure a consistent and fair comparison between TM and BNN inference, a baseline BNN inference approach was implemented in C++ and cross-compiled in a similar manner. We use BNNs as a hardware-efficient baseline due to their bitwise operation-based inference. In this approach, inference is performed sequentially across layers, where each neuron evaluates the binary outputs from the previous layer against the corresponding binary weights. Matching pairs contribute positively to an accumulation sum, while mismatches reduce it, effectively realizing XNOR-based comparisons followed by integer accumulation. The accumulated value is then evaluated against a zero threshold to determine the neuron activation. This process continues until the final layer produces class scores, and the class with the highest score is selected as the predicted output.

Tsetlin Machine models were trained using the TMU (Tsetlin Machine Unified) Python library [1]. Multiple datasets and clause configurations were used to evaluate performance across diverse conditions. BNN models were trained using Larq, a TensorFlow framework for BNNs, and model weights were extracted. The extracted clauses and weights were strategically placed in the data-memory (DMEM) alongside the test input before simulation. Inference logic was implemented in C++, cross-compiled using the same RISC-V toolchain, and converted into instruction memory using the same assembly flow. This ensured a consistent and fair comparison between TM and BNN inference in terms of memory structure, control flow, and execution overhead.

Instruction profiling was performed by analyzing the assembly generated from TM inference to identify frequently used instructions. In the absence of function calls in the RISC-V simulation, stack behavior is emulated by initializing the stack pointer and assigning memory addresses to parameters and local variables. Pseudo-instructions are converted into base RISC-V ISA instructions for compatibility with the reduced instruction subset. The conversions are as follows:

1. (i)

   li x, imm $\rightarrow$ addi x, x0, imm

2. (ii)

   mv x, y $\rightarrow$ addi x, y, 0

3. (iii)

   beqz x, label $\rightarrow$ beq x, x0, label

4. (iv)

   snez x, y $\rightarrow$ sltu x, x0, y

5. (v)

   zext.b x, y $\rightarrow$ andi x, y, 0xff

6. (vi)

   bge x, y, label $\rightarrow$ blt y, x, label

7. (vii)

   nop $\rightarrow$ add x0, x0, x0

The impact of reducing high frequency instructions is shown in Fig. 3(a), demonstrating significant instruction count reduction using the modified approach. A subset of instructions contributes most to this reduction. The trend of absolute reduction with increasing clauses is illustrated in Fig. 3(b).

We utilised two versions of a single-core RISC-V processor from the UltraEmbedded open-source GitHub repository [16]. Both cores were synthesized and simulated using Xilinx Vivado, enabling us to accurately capture instruction execution behavior and analyze resource utilization.