Blog – Homepage

Understanding Structured Generation (Draft)

code

analysis

import torch
from typing import List
from threading import Thread
from transformers import AutoModelForCausalLM, AutoTokenizer, TextIteratorStreamer
from tran…

Force a language model not to use the letter ‘e’

code

analysis

Georges Perec (1936-1982) was a French novelist, famous among other things for writing a \(300\)-page novel called « La disparition », without using during the whole novel…

Understanding Logits Processors

code

analysis

Logits processors are incredibly powerful and I think they should receive more attention from the community. Logits processors, as their name implies, process the logits…

Understanding Structured Outputs

code

analysis

In my previous post, I explained that we can provide a description of a function to the language model and the language model will call that function even if the function…

Understanding Function Calling

code

analysis

Language models take text as input and predict which text should come next. Taking that into consideration, what does function calling even mean?

Understanding LLM Memory

code

analysis

Despite what some people think (even some researchers I’ve met), language models don’t have any memory. The confusion comes, I suppose, from the fact that most people…

Understanding Chat Templates

code

analysis

If you have worked with LLMs, you might have worked with lists of messages. Indeed, when you send a request to an LLM, we can call it a user messsage and the response can be…

Understanding Tokenizers

code

analysis

This post is largely inspired by Understanding GPT tokenizers by Simon Willison.

Build a basic widget with AnyWidget in a Solara app

code

analysis

Let’s build the app below (try it out by clicking on the button and moving the slider).

Build a basic LLM chat app with Solara

code

analysis

In this post, we will build a basic LLM chat app with Solara. Large Language Models (LLMs) have become increasingly popular and Solara provides several components to work…

Observatorio de sueldos en Chile

code

analysis

Los datos de sueldos en Chile se pueden obtener de la encuesta suplementaria de ingresos (ESI). La última ESI disponible es la del año 2021 y se puede descargar aquí.