Skip to content

Commit c1c86b8

Browse files
committed
Add AI integration documentation and update release notes
Introduced initial Large Language Model (LLM) support with details on Ollama and OpenAI engines. Added related configuration options, installation instructions, and usage documentation. Published release notes for version 4.0.0 highlighting AI integration and other updates.
1 parent 90a5d73 commit c1c86b8

File tree

8 files changed

+107
-4
lines changed

8 files changed

+107
-4
lines changed

_config.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
title: Pledger.io
22

33
release:
4-
version: 3.8.0
5-
date: 2025-01-03
4+
version: 4.0.0
5+
date: 2025-02-20
66

77
github:
88
repository: pledger-io/user-documentation

_release-notes/index.adoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11

2+
include::v4.x/index.adoc[]
23
include::v3.x/index.adoc[]
34
include::v2.x/index.adoc[]
45
include::v1.x/index.adoc[]

_release-notes/v4.x/index.adoc

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
2+
include::v4.0.0.adoc[]

_release-notes/v4.x/v4.0.0.adoc

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
2+
== 4.0.0
3+
4+
*Release date: 2025-02-20*
5+
6+
=== Added
7+
8+
- Feature/initial AI integration
9+
10+
=== Changed
11+
12+
- Feature/move to vite for the UX build engine
13+
- Refactor form input handling and enhance transaction suggestions
14+
- Move the eventbus to only the command system

docs/getting-started/advanced/index.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55
:page-section: getting-started
66
:page-layout: section
77
:page-order: 2
8-
:page-status: draft
8+
:page-status: published
99

1010
ifndef::document-root[:document-root: ../../]
1111
include::../../_document-setup.adoc[]
Lines changed: 65 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,65 @@
1+
:page-nav-title: Using the AI features
2+
:page-parent: getting-started::advanced
3+
:page-title: Using the AI features in Pledger.io
4+
:page-section: getting-started
5+
:page-layout: section
6+
:page-order: 1
7+
:page-status: published
8+
9+
ifndef::document-root[:document-root: ../../]
10+
include::../../_document-setup.adoc[]
11+
12+
WARNING: This functionality is still under active development and should be considered a `preview` feature.
13+
Some of the configuration or usage may be a bit more difficult.
14+
15+
Since version `4.0.0` of {application} support for Large Language Models (LLM) has been added.
16+
A Large Language Model (LLM) is an advanced machine learning model trained on vast amounts of text data to understand, generate, and process human-like natural language.
17+
18+
{application} supports the following types of LLM engines:
19+
20+
1. link:https://platform.openai.com[Open AI], a cloud based LLM
21+
2. link:https://ollama.com[Ollama], a local hosted LLM
22+
23+
== How will the AI help you
24+
25+
{application} currently only has very limited features build using the LLM.
26+
The following is added at this time:
27+
28+
* Making suggestions for budget, category and tags based upon the description, bank accounts and amount in the transaction form.
29+
30+
== Privacy focussed option
31+
32+
For those users that want their financial data to remain private you can use the Ollama version.
33+
A special version of the Docker Image is released that contains the Ollama software alongside {application}.
34+
35+
NOTE: Use this docker image `ghcr.io/pledger-io/amd64-embedded-llm`.
36+
37+
When starting the docker image it will automatically download the model configured in the environment.
38+
Please see the page `xref:{document-root}/how-to/installation/configuration.adoc#configure_llm[Large Language Model options]` for how to configure {application} correctly.
39+
40+
For most users it is advised to not change the model used by Ollama, the picked model has the best accuracy vs performance.
41+
If you have an Nvidia or AMD GPU you may be able to utilize that to power Ollama.
42+
This would allow you to pick a larger model like `llama3.3` or `mistral`.
43+
44+
To utilize the GPU you would have to adopt the docker command to something like this:
45+
46+
[source,shell,linenums]
47+
....
48+
docker run -d \
49+
-v pledger_logs:/opt/storage/logs \
50+
-v pledger_uploads:/opt/storage/upload \
51+
-p 8080:8080 \
52+
--gpus=all \
53+
--name pledger \
54+
-e DB_TYPE=mysql
55+
-e DATABASE_HOST=mariadb
56+
-e DATABASE_SCHEMA=pledger
57+
-e DATABASE_USER=pledger
58+
-e DATABASE_PASSWORD=pledger
59+
-e AI_MODEL=llama3.3
60+
ghcr.io/pledger-io/amd64-embedded-llm:stable
61+
....
62+
63+
== OpenAI based AI
64+
65+
TIP: Still to be documented....

docs/how-to/installation/configuration.adoc

Lines changed: 21 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,4 +51,24 @@ When using the mail feature of {application} the following environment variables
5151
| `SMTP_USER` | The SMTP user for authentication | -
5252
| `SMTP_PASSWORD` | The SMTP password for authentication | -
5353

54-
|===
54+
|===
55+
56+
[[configure_llm]]
57+
== Large Language Model options
58+
59+
When either using the docker image `ghcr.io/pledger-io/amd64-embedded-llm` you can configure the following options.
60+
Alternatively you can use the normal image but use link:https://platform.openai.com[OpenAI], at the cost of some privacy.
61+
62+
[%header,cols="1,2,1"]
63+
|===
64+
| Variable | Description | Default
65+
66+
| `AI_ENGINE` | The engine to use. Supported are `ollama` and `open-ai` | ollama
67+
| `AI_MODEL` | The Ollama model to use, only used with AI_ENGINE 'ollama' | qwen2.5-coder:1.5b
68+
| `AI_AUGMENTER_ENABLED` | Should the context for the LLM be expanded with budget, category and tag information | true
69+
| `OPENAI_TOKEN` | The application token for OpenAI, must be set when AI_ENGINE is 'open-ai' | -
70+
71+
|===
72+
73+
NOTE: Please leave `AI_AUGMENTER_ENABLED` enabled with the default model.
74+
This can be disabled when using larger models as they have a better understanding of the transaction information and tools.

docs/how-to/installation/docker.adoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ There are various builds for various different target platforms.
2525
Personal Ledger is currently built for:
2626

2727
- AMD64, under image `{docker-image}`
28+
- AMD64 with Ollama embedded, under image `ghcr.io/pledger-io/amd64-embedded-llm`
2829
- ARMv8, under image `ghcr.io/pledger-io/arm64-core`
2930

3031
The instructions here will assume usage of the tag `stable`.

0 commit comments

Comments
 (0)