WissenFlow
AI · Finance · Engineering

Why FinAI never lets the language model pick the number

Language models write fluent explanations and can still invent a price. How FinAI splits the work between deterministic engines and narration, and what that design does not solve.

Bekim · Co-Founder & CTO4 min read

Ask a general-purpose chatbot what a balanced portfolio for a 30-year-old looks like and you will usually get a confident answer with percentages in it. The percentages read well. The question I kept asking while building FinAI was simpler: where did that number come from?

In most chat products the honest answer is that the model produced it, the same way it produces every other word. That is the problem FinAI is designed around.

A fluent sentence is not a calculation

Ji and colleagues (2023) surveyed the research on hallucination in natural language generation: output that is fluent and plausible but unsupported by the source or simply false. Their review covers summarisation, dialogue, question answering and more, and the pattern is consistent. A language model is optimised to produce likely text, not verified text, and it gives no reliable signal when it is guessing.

In most domains a plausible wrong sentence is an annoyance. In finance it is worse than no answer. "Your expected return is 7.2%" looks precise, and the precision is exactly what makes a reader trust it.

Let programs do the arithmetic

Research on tool use points to a practical fix. Gao and colleagues (2023) showed with program-aided language models (PAL) that letting the model write a program and handing the computation to an interpreter improves accuracy on arithmetic reasoning benchmarks over having the model compute in text. Schick and colleagues (2023) showed with Toolformer that models can learn when to call external tools such as a calculator. Lewis and colleagues (2020) showed with retrieval-augmented generation that grounding a model in retrieved documents makes its answers more factual on knowledge-intensive tasks.

The shared idea: the language model is good at deciding what to do and at explaining a result. It should not be the thing that produces the result.

Four beats

FinAI follows that split strictly. Every question goes through four steps, and only one of them is allowed to create a number.

Routewhat kind of questionComputeengines, real dataNarrateonly the outputCardnumbers + context
Figure 1. FinAI's pipeline. Only the compute step produces figures. The narration may quote them and may not add new ones.

Route. The question is classified before any sentence is written. "Is inflation bad for stocks?" is a macro question and goes to the macro engine. It does not get a portfolio template because the word "stocks" appeared.

Compute. Deterministic engines do the work: market data from providers, allocation shaped by risk, goal and horizon, Monte Carlo simulation, compound-interest and ROI calculation. The same inputs give the same output. The language model chooses which tool runs. It does not supply the number.

Narrate. The model explains the engine output in plain language. If the engine did not produce a price, a weight or a percentage, that figure does not appear in the explanation.

Present. The answer arrives as a structured card with the numbers and their context, not as a wall of chat. A Monte Carlo result is shown as a range of outcomes, not one guessed line, because a single line hides the uncertainty the simulation exists to show.

What this design does not solve

An engine is only as good as its assumptions and its data. A deterministic model with a wrong input is wrong every time, consistently. The split makes errors traceable, not impossible.

Narration can still mislead without inventing a number, by stressing the wrong part of a correct result. Keeping explanations short and tied to the card limits this. It does not remove it.

Routing can misclassify a question. A macro question sent to the portfolio engine gets a precise answer to the wrong question.

Education, not advice

FinAI is educational decision intelligence. It is not regulated investment advice and it is not a licensed advisor. Under MiFID II, investment advice means personal recommendations to a client about specific financial instruments, and FinAI is built to explain concepts and model scenarios, not to make that kind of recommendation. The EU AI Act adds transparency duties, including telling people when they are interacting with an AI system. FinAI is presented as exactly that: an AI system that explains engine output.

That boundary matters for the learning side too. FinBild lets people feel time value and diversification before they are named. FinAI is where someone takes that intuition to their own question, and gets numbers that came from a calculation rather than from a sentence. You can see the pipeline step by step on the FinAI page.

References

  1. Directive 2014/65/EU of the European Parliament and of the Council of 15 May 2014 on markets in financial instruments (MiFID II), Article 4(1)(4). eur-lex.europa.eu
  2. Gao, L., Madaan, A., Zhou, S., Alon, U., Liu, P., Yang, Y., Callan, J., & Neubig, G. (2023). PAL: Program-aided language models. Proceedings of the 40th International Conference on Machine Learning. arXiv:2211.10435
  3. Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), 1–38. doi:10.1145/3571730
  4. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., et al. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems, 33. arXiv:2005.11401
  5. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (AI Act), Article 50. eur-lex.europa.eu
  6. Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. Advances in Neural Information Processing Systems, 36. arXiv:2302.04761

This post describes FinAI's design. It is not a benchmark of FinAI, and the research cited above evaluated other systems. FinAI is in early access.

Consultation

Bring the subject. We will say what can be played.