Type alias ModelInternal

Model: {
    sample: ((logits, temperature, top_p) => number);
    tokenizer: Tokenizer;
    tvm: Instance;
}

Type declaration

  • sample: ((logits, temperature, top_p) => number)
      • (logits, temperature, top_p): number
      • Parameters

        • logits: CpuNDArray
        • temperature: number
        • top_p: number

        Returns number

  • tokenizer: Tokenizer
  • tvm: Instance

Generated using TypeDoc