Skip to main content

Glossary

The words and abbreviations miStudio uses, in plain language. The in-app Help screen links here from its "Words used here" topic. Each entry is a short definition; the linked pages explain the idea in full.

Words​

WordWhat it means
ActivationHow strongly a feature (or a neuron) responds to one token. Zero means it did not fire.
CircuitA set of features at different layers that work together, such as an earlier feature that drives a later one. See Circuits.
ClusterA group of features that respond most strongly to the same word, split by the context the word appears in. See Clusters.
Dead featureA feature that almost never fires on the text it was measured on. Extraction drops them.
Evidence rungThe grade of how strong the evidence for a circuit or one of its links is, from "mined" to "faithfulness-tested". See The Evidence Ladder.
ExtractionA job that runs the model over text and records, for each feature, the passages where it fires most strongly. See Feature Extraction.
FeatureOne direction a sparse autoencoder learned, which tends to stand for one idea. Features are what you label, group and steer.
Hook pointThe place inside a layer where miStudio reads (or changes) the model's activations, for example the residual stream after the layer.
J-LensThe screen that shows what the model is poised to say at each token and layer. See J-Lens.
Jacobian lensA fitted, per-layer view used by J-Lens that recovers what the model is preparing to say earlier in the model than the logit lens does. It needs a lens fitted for that model.
LabelA short name and category for a feature, written by a language model from the feature's strongest passages. See Auto-Labeling.
LayerOne step of the model's processing. A model has a stack of them; earlier layers tend to handle spelling and grammar, later ones meaning.
Logit lensReading a layer's activations through the model's own output step, to see which tokens they point towards. It needs no training.
ProbeA small detector that reads one layer and answers one question about the text, such as "is this sarcastic?". See Probe Monitors.
QuantizationStoring a model's numbers in a smaller format so it fits in less memory, at a small cost in accuracy.
Residual streamThe running total each layer reads from and adds to. Most sparse autoencoders and probes read it.
Sparse autoencoderA small network trained to rewrite one layer's activations as a few active features out of many. See SAE Training.
SteeringTurning chosen features up or down while the model writes, to test what they do. See Model Steering.
StrengthHow far steering pushes a feature. Too high and the text falls apart.
TemplateA saved set of settings, so an experiment can be repeated or shared. See Templates.
TokenA piece of text the model reads, often part of a word.
TokenizationSplitting text into a particular model's tokens. Each model family splits text differently, so a dataset is tokenized once per model.

Abbreviations​

Every abbreviation the in-app Help uses is listed here; a test in the app's frontend fails if one is missing.

AbbreviationStands forWhat it means
AIartificial intelligenceSoftware that does work a person would otherwise do; here, the agents that call miStudio's tools and ask for your approval. See Approvals.
APIapplication programming interfaceThe web addresses the frontend, scripts and agents call to drive miStudio.
AUROCarea under the receiver operating characteristic curveOne number for how well a detector, such as a probe, separates two classes: 0.5 is chance and 1.0 is perfect.
FPRfalse-positive rateThe share of negative examples a detector wrongly flags as positive; a probe's threshold is set to spend a chosen FPR, such as 1%.
FVUfraction of variance unexplainedHow much of a layer's activity a sparse autoencoder fails to reconstruct. Lower is better.
JSONJavaScript Object NotationA plain-text format for structured data, such as {"answer": "yes"}. Judge prompts usually ask the judge to reply in it.
GPUgraphics processing unitThe graphics card that runs the model, training and extraction.
LLMlarge language modelA model that reads and writes text, such as the model you study or the one that writes labels.
MCPModel Context ProtocolThe protocol AI agents use to call miStudio's tools. See MCP Server.
PINpersonal identification numberThe code that locks the API Keys, Storage and Environment tabs of Settings. A convenience lock, not a login. See Settings Reference.
PIIpersonally identifiable informationData that identifies a person: a name, an email address, a phone number, an account number. One of the seeded judge prompts detects it.
PMIpointwise mutual informationHow much more often two features fire together than chance would predict. Circuit discovery uses it.
SAEsparse autoencoderSee Sparse autoencoder above.
TF-IDFterm frequency–inverse document frequencyA way of weighting words by how distinctive they are, used to split clusters by context.