Wabbit
An LLM interface to chase rabbit trails
I spend a lot of time researching and going deep on various topics of interest. As I comb through the web, info gets stored in my digital brain (sometimes called a second brain) for later reference. I frequently use Perplexity or another LLM chat to answer specific questions or find additional details.
What I really wanted was a tool that complemented my process, allowing me to explore all the rabbit trails that make up the web today. Chat interfaces were not great for this (constant scrolling), what I really wanted was a page (perplexity was close). I discovered Delve and loved it. The more I used it the more I wanted to expand it's capablitie. I wanted node graphs for improved navigation and better markdown export.
Wabbit, emerged. An app that generates pages on any topic in markdown and can quickly be copied to my notes. It is a WIP but beginning to feel like the app I wanted.
June 29, 2024
I got the initial app out. It took me about 5 hours. I opted to go NextJS deployed on Vercel. I am using OpenRouter to serve responses from Llama 3 8B (rated limited verison). Responses are solid but will need to finetune the prompt, particularly for markdown formatting.
June 30, 2024
Decided to call it wabbit, very fitting for chasing "rabbit trails". This was a big update, worked through better prompting using system prompt and user prompt. I setup the UI to display the response as a markdown page and the user message at the top instead of inline chat.
July 1, 2024
I cleaned up the UI a little. Decided to add additional models (gear icon in the message bar) to test performance. I am still using OpenRouter, pleasantly suprised by how easy their API is. Getting a consistent output has been difficult across the models, some seem to listen to system prompt a lot better than others. Gemma 2 9B seems to be the best model so far, but I have not done crazy amounts of testing across topics. I want to add interlinked sub-topics in the next few days.
July 4, 2024
Big update. Interlinking topics is now live. Markdown headers and bullets are rendered as clickable links which kick off a new page detailing that topic in relation to the previous. Lot's of improvement to go but cool to see it working. The UI for this is still a little iffy, need to adjust snap and scrolling but cool to see it working. Mobile will need to be overhauled, you have no clue if anything is happening while waiting for response on mobile. I have some ideas but not sure if this is a priority over fine-tuning results and adding export. Node graph is still not up either. Cool to see it working though.
