Code

8-bit inference (#512)#513

Code

Open

glerzing wants to merge 6 commits intoCarperAI:mainCarperAI/trlx:mainfrom glerzing:quantizationglerzing/trlx:quantizationCopy head branch name to clipboard

+96-25

Commits

Commits on Aug 7, 2023

• 8-bit inference (CarperAI#512)

  glerzing

  committed
  a7b5067

• Add an example + the possibility to configure the from_pretrained arguments

  glerzing

  committed
  a81428a

• Minor renaming

  glerzing

  committed
  4467337

• Setting torch_dtype to bfloat16

  glerzing

  committed
  4a6896b

• Fixes

  Show description for 9dae10c
  glerzing

  committed
  9dae10c

Commits on Aug 8, 2023

• missing attribute

  glerzing

  committed
  5cc4a17