Bonsai 2 27B with 256k context running on RTX 4090 24 GiB, and hosted by Puu OS.

Puu OS also has preconfigured Qwen 3.8 27B, which fits easily to DGX Spark.

LLM models, when you actually host them, require their own (manual) shoehorning in order to fly nicely in the environment, and there is no exact template for this. Thus, I focus on one all-arounder model with two different quantizations in the base installation of Puu OS. For those that don't know this Bonsai 2 27B is a ternary quantization of Qwen 3.8 27B.

This is a personal achievement for me despite not being a huge achievement overall as I could never imagine I could have a something with a decent context size with the hardware that I have at hand.

I purposely want to do a small AI assisted contribution with this to kernel when I have a chance :-)

This how I backup now with Restic.

I have restic-env:

# vim:ft=sh

export AWS_SECRET_ACCESS_KEY=$(pass net/mega.nz/s4/secret)
export AWS_ACCESS_KEY_ID=$(pass net/mega.nz/s4/access)
export RESTIC_PASSWORD_COMMAND="pass net/mega.nz/restic/$1"
export RESTIC_REPOSITORY="s3:s3.eu-amsterdam-2.megas4.com/$1"


Then for each system I have own bucket, which I manage as follows:

Backup: restic backup --files-from ~/MEGA/Restic/jarkko-kan-01.local.txt
Restore: restic --target / 4de0c63f.

Note that restore is done relative to the system root i.e., they are full system backups.

I use these more like long-term preserved content, audio plugin presets and stuff like that rather than e.g., config files (for those I rather use Git).

Truecolor vim9 colorschemes that come with Vim 9.2:

- retrobox
- habamax
- lunaperche
- quiet
- sorbet
- zaibatsu
- wildcharm.

I have these written down as I've started with any possible dev tool to pick themes from the built-in, and I've stopped downloding 3rd party themes.

The quantitative gain is the reduced risk to become a victim of a supply chain attack.

I would like note also that limitations accelerate creativity and brain likes variation I woud like to think :-)

#infosec #theme #vim

my quest for finding less cluttered (chrome, firefox) browser; and one which does not have any weird antigay or whatever political bias :-) i don't think vivaldi was bad but definitely was not for me.

helium and zen are pretty strong contenders in the minimalistic space.

Vivaldi is great and *actually* politics free browser, and yeah, simple view gives me similar experience as Brave Origin (and for free of charge, also in macOS).