Type alias Template

Template: {
    collect: ((stream?) => Promise<string>);
    collect_refs: ((stream?) => Promise<{
        completion: string;
        refs: Record<string, string>;
    }>);
    model: LoadedModel;
}

A defined template ready for inferencing

Type declaration

  • collect: ((stream?) => Promise<string>)
      • (stream?): Promise<string>
      • Collect the template as a string - optionally with a streaming handler

        Parameters

        Returns Promise<string>

  • collect_refs: ((stream?) => Promise<{
        completion: string;
        refs: Record<string, string>;
    }>)
      • (stream?): Promise<{
            completion: string;
            refs: Record<string, string>;
        }>
      • Like collect but returns the completion and refs

        Parameters

        Returns Promise<{
            completion: string;
            refs: Record<string, string>;
        }>

  • model: LoadedModel

Generated using TypeDoc