Welcome to the eighth edition of our newsletter The Token! In this episode we take a brief look at the various options that can speedup LLM inference, a new technique that could act as replacement to RLHF and a new LLM adapted to use more than 16K tools 🛠. We also discuss a new prompting technique that can parallelize LLM word generation as well as a new assistant from Dimensions, the most popular tool used by funders and research institutions to analyse their data.
Share this post
LLM inference, RRTF, ToolLLM and more
Share this post
Welcome to the eighth edition of our newsletter The Token! In this episode we take a brief look at the various options that can speedup LLM inference, a new technique that could act as replacement to RLHF and a new LLM adapted to use more than 16K tools 🛠. We also discuss a new prompting technique that can parallelize LLM word generation as well as a new assistant from Dimensions, the most popular tool used by funders and research institutions to analyse their data.