Filters and Tools for Open-WebUI

• Status: In Development
• Language: Python

I've gotten heavily into running my own privacy-respecting large language models on my own hardware. As more filters, tools, and other extensions to the Web UI's functionality are developed, with better models appearing all the time, Open-WebUI has become a compelling alternative to ChatGPT.

I have developed a number of different filters and tools to enhance the Open-WebUI user experience. Most of these were born from my own needs and frustrations, and I think they will help the community at large, as well.

Documentation

A work-in-progress replacement for the narrative memory filter for more generalized use cases.

Reduce number of GPU layers in use if Ollama crashes due to running out of VRAM.

Remove words, phrases, or characters from the start of model replies. Intended for models like Beyonder v3, which often output unwanted tokens at the start of replies.

Tool for querying OpenStreetMap to look up address details and nearby points of interest.

‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗‗