Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Apr 17, 2023

• Fixed worker requirements wrt transformers (#2621)

  yk

  authored
  a570b04

  Copy full SHA for a570b04

Commits on Apr 14, 2023

• Safety level control (#2516)

  Show description for 8069ebc
  

  shahules786

  and

  olliestanley

  authored
  8069ebc

  Copy full SHA for 8069ebc

Commits on Apr 13, 2023

• Add safety server to inference (#2449)

  Show description for 50cb3b0
  

  olliestanley

  and

  shahules786

  authored
  50cb3b0

  Copy full SHA for 50cb3b0

Commits on Apr 9, 2023

• Improvements to the HF worker container (#2339)

  yk

  authored
  6cdf5ab

  Copy full SHA for 6cdf5ab

• Added docker image for standalone worker (#2300)

  yk

  authored
  5a17d93

  Copy full SHA for 5a17d93

Commits on Apr 3, 2023

• changed basic hf server to support quantization and streaming (#2293)

  Show description for 8a97cd4
  

  9 peopleauthored
  8a97cd4

  Copy full SHA for 8a97cd4

Commits on Mar 28, 2023

• Improved worker script and documentation thereof (#2247)

  yk

  authored
  8411234

  Copy full SHA for 8411234

Commits on Mar 26, 2023

• Enabling Threads and Retry for Web Chat (#2232)

  Show description for 56ded48
  yk

  authored
  56ded48

  Copy full SHA for 56ded48

• Create worker metrics manually for more control (#2229)

  yk

  authored
  dc5580f

  Copy full SHA for dc5580f

Commits on Mar 24, 2023

• Introduce model configs to abstract pairings of models and hardware (#2194)

  Show description for 0331e69
  yk

  authored
  0331e69

  Copy full SHA for 0331e69

Commits on Mar 23, 2023

• Fix inconsistent sources of max token length (#2178)

  yk

  authored
  f6fc5c6

  Copy full SHA for f6fc5c6

Commits on Mar 22, 2023

• Fix: Correctly sending error to waiting client on message abort (#2169)

  yk

  authored
  7eb95ae

  Copy full SHA for 7eb95ae

• Added param configs from eval to pass to the frontend (#2163)

  yk

  authored
  30cfe1d

  Copy full SHA for 30cfe1d

• Diabling stop sequences in inference, since we are using eos_tokens in most models (#2168)

  yk

  authored
  7e3768f

  Copy full SHA for 7e3768f

Commits on Mar 21, 2023

• Changed worker config into worker info and unified model input and total lengths (#2160)

  yk

  authored
  6165f2e

  Copy full SHA for 6165f2e

• Fixes auth TokenPair change bug (also fix for null logprob from inference server) (#2155)

  yk

  authored
  e2f2184

  Copy full SHA for e2f2184

• Robustification: Specific message type for protocol upgrade, everything else will re-connect (#2152)

  yk

  authored
  f1e41d1

  Copy full SHA for f1e41d1

• hotfix for max_new_tokens parameter being None (#2146)

  Show description for 998d13c
  yk

  authored
  998d13c

  Copy full SHA for 998d13c

• Llama inference (#2144)

  Show description for 792fd18
  yk

  authored
  792fd18

  Copy full SHA for 792fd18

Commits on Mar 19, 2023

• some improvements to hf server

  yk

  committed
  307db95

  Copy full SHA for 307db95

• Basic-hf-server (#2130)

  yk

  authored
  94e9bb3

  Copy full SHA for 94e9bb3

• updated dockerfile

  yk

  committed
  ebf50cb

  Copy full SHA for ebf50cb

• calling hf server from worker

  yk

  committed
  f1252ce

  Copy full SHA for f1252ce

• added hf server

  yk

  committed
  dd0657a

  Copy full SHA for dd0657a

• added sentencepiece to inference worker

  yk

  committed
  d749632

  Copy full SHA for d749632

• added llama tokenizer

  yk

  committed
  4b6c6dd

  Copy full SHA for 4b6c6dd

• updated main scripts

  yk

  committed
  8eff31f

  Copy full SHA for 8eff31f

• added newest transformers

  yk

  committed
  397dff2

  Copy full SHA for 397dff2

Commits on Mar 18, 2023

• added typical_p

  yk

  committed
  aa772c2

  Copy full SHA for aa772c2

• added hf token placements

  yk

  committed
  b8eb7c9

  Copy full SHA for b8eb7c9

• adjusted token buffer to pop EOS

  yk

  committed
  86ea502

  Copy full SHA for 86ea502

• shifted max new tokens to user input

  yk

  committed
  750c7d0

  Copy full SHA for 750c7d0

• improvements

  yk

  committed
  594314a

  Copy full SHA for 594314a

• added hf_transfer to worker

  yk

  committed
  98926c4

  Copy full SHA for 98926c4

• adding shards and model id to dockerfile

  yk

  committed
  902198c

  Copy full SHA for 902198c