• 2 Posts
  • 4 Comments
Joined 3 years ago
cake
Cake day: June 6th, 2023

help-circle
  • ChaoticNeutralCzech@lemmy.mlOPtoFuck AI@lemmy.worldEt tu, Joplin?
    link
    fedilink
    arrow-up
    4
    arrow-down
    1
    ·
    16 days ago

    Not to mention, Joplin allows more than structured text (native embedded images/media, even more kinds of content with plugins) and the text-only joplin.ai.chat() will definitely “need” to be supplemented with multi-modal AI support.

    As for new techniques, I imagine the declining AI subsidies will raise the popularity of context reuse (reducing token use by not having the LLM re-read the whole notebook; is that what it’s called? I don’t remember much from videos/articles about AI trends because I don’t use it). This will require a huge framework for managing data structures distilling every cached context window… And I think non-LLM functions will be added too to save tokens, for example an LLM may want to know “is there an unfinished TODO?” without reading all of them.


  • ChaoticNeutralCzech@lemmy.mlOPtoFuck AI@lemmy.worldEt tu, Joplin?
    link
    fedilink
    arrow-up
    9
    arrow-down
    1
    ·
    edit-2
    16 days ago

    Not a bad idea to make infrastructure separating the model-calling backend from user-facing frontend: only a single plugin manages local models and API key to remote models.
    But isn’t this a bit of scope creep for a note-taking app? As I understand it, this whole AI framework has existed as a first-party plugin for a while now, with no AI API in the base app (which is quite bloated as is).

    Not to mention, lots of recent contributions are heavily AI-made: not ideal for an app handling important private stuff.