What a 0.6B language model can and cannot do

A small language model can answer questions, reword a paragraph and explain a simple idea without sending your words to a server. It can also be wrong in exactly the same confident tone it uses when it is right. Knowing where a model of this size is useful, and where it is not, matters more than any single feature.

What 0.6B means

“0.6B” means about 600 million parameters. A parameter is one of the learned numbers inside the network, and the count is a rough guide to how much a model can store. Flyingkiwi’s English model has 528 million parameters after its vocabulary was trimmed, and the Turkish model has 521 million. Large general assistants are far larger than this. The gap shows most in breadth, and in fine detail such as exact figures and obscure names.

In the browser, the weights are stored as 8-bit integers. The English weights take 561 MB. The full download, including the engine, the tokenizer and a cache of the fixed system prompt, is 571 MB for English and 567 MB for Turkish. Either language is therefore a download of about 570 MB, which is worth knowing before the first message.

Why choose a small model anyway

The case for a small model is practical, not a claim that it is as capable as a large one. It runs on your own device, and your messages are never sent to a server. It needs no account, it works after one download, and it has no cost per message. The article on local AI in your browser explains what that download involves and what stays on your device.

What it does reasonably well

On Flyingkiwi’s English frozen set, the model got 20 of 30 answerable questions right. It said it could not know the answer in 18 of 20 cases where that was the right response, kept a friendly conversation going in 6 of 10, and kept track of context in 11 of 20 multi-turn follow-ups. It handled ambiguous requests in 3 of 10 cases, where the unchanged base model managed none.

These strengths are real but narrow. Each category has only 10 to 30 cases, so a single case moves a category score by 3 to 10 points. The categories test different things. The answerable questions have known answers. The “cannot know” questions ask about live, private or future information, where the honest reply is to say so. The false premise questions contain an assumption that is wrong. The grading was done by AI graders against reference answers, not by a panel of people, and the results describe one release. Treat them as a useful signal, not a verdict.

Where it fails

Small models fail in predictable places. Arithmetic is unreliable, and so are niche facts, precise numbers and anything recent. The model does not know today’s date, cannot browse, cannot use tools, cannot see files you attach and cannot remember earlier conversations. It can produce a hallucination, a fluent claim with no support behind it, as confidently as a correct answer, which is why its answers need checking. The riskiest case is a confident, precise figure, such as a date or a measurement, that looks checked but is not. Precise numbers deserve the same scepticism as names.

Two results are sobering. The English model corrected false premises in 5 of 10 cases, down from 7 of 10 for the base model. On TruthfulQA MC1, a multiple-choice test of 817 questions, it scored 25.1%, against 25.8% for the base model, and that gap is within the test’s sampling error. Turkish is better than the base model, which managed 12 out of 100, but 37 out of 100 is still weak, with frequent errors in facts and arithmetic.

Good uses and bad uses

The model suits tasks where you can see the result and judge it quickly. Each example below produces output you can read and correct in seconds, which matters for a model that makes regular mistakes. Some good uses are:

• Rewording a paragraph you wrote, for example “Make this paragraph shorter, and keep every date.”
• Drafting a short message, for example “Write a two-line reply saying I can join on Thursday but not on Wednesday.”
• Explaining a common concept, for example “Explain what a hash table is in three sentences.”
• Writing a small code snippet, such as removing duplicates from a Python list. This is one of the app’s own example prompts.
• Practising a simple conversation in English, for example ordering a coffee.

Bad uses matter just as much. Do not rely on the model for medical, legal or financial decisions. Do not act on a fact it gives you without checking it. And do not use it for calculations you need to be exact, because its arithmetic is weak.

How fast it runs

Speed depends far more on the device than on the model’s label. In headless Chrome 155 on an AMD Ryzen 5 7530U laptop, the English model produced 21.9 tokens per second on its first reply and 18.1 on its second, using six threads. The phone rows in the table are emulations: a laptop was limited to approximate phone cores and memory. They are rough guides, not measurements on real phones. The emulations show how the engine behaves with fewer cores and less memory, which is useful, but a real phone may differ in both directions.

The live public site gave one more data point. A real English reply arrived after 71.5 seconds, including the 571 MB download, at 25.7 tokens per second, with peak tab memory of 1,286 MB. That was a single run, so treat it as one data point rather than a benchmark. A slow phone waits far longer for the first reply, and long conversations get slower as they grow.

Getting the best from it

Short, specific prompts work best. Ask for one thing at a time, paste in the text the model should work on rather than expecting it to remember, and say what form you want the answer in. The guide to clear prompts in English and Turkish has examples in both languages.

Then check the facts. Names, numbers, dates and quotations are where small models most often go wrong, so verify them against a source you trust. The article on checking AI answers shows how to test a reply without starting over.

When a task needs broad knowledge, long reasoning, exact calculation or current information, reach for a larger model or a tool that shows its sources. A small model is a useful first draft and a reasonable helper for simple jobs. It is not a substitute for the tools that do harder jobs better, and it should not be asked to be one.