Below you will find pages that utilize the taxonomy term “Techblog”
Prompt Architectures
Structuring prompts effectively for AI is essential for getting the desired outcomes. Different prompt frameworks can help you craft prompts that are clear, concise, and likely to yield relevant and accurate responses.
Background
These strategies were extracted for a client side UI that I am working on which utilises these structures to render forms based on a strategy notation (more on that later).
My interest in these is prompted by my work on midJourney where using image references rather than prompts I was able to extract a very unique and controlled set of outcomes. My observation from the exercise with MidJourney was that interaction models and a good understanding of the Model itself can significantly improve outcomes.
Inference Router
As large language models (LLMs) continue to permeate software architectures, a new set of challenges has emerged around optimising their performance, cost, and management at scale. In particular, if you’re working in non-trivial, high-volume environments as we do at HeadGym, efficiently managing the routing of LLM requests is not just an optimisation — it’s a necessity.
At the heart of these optimisations is the inference router, a rather simple yet powerful concept that is becoming increasingly indispensable in the LLM ecosystem. Whether it’s routing traffic to the least expensive model, capturing analytics, or adding governance controls, the inference router serves as a critical middleware layer that streamlines and optimises how LLMs are used in production environments.
PostgREST
While exploring the Supabase documentation, I discovered that Supabase leverages PostgREST, a powerful yet often overlooked tool. Despite its relative obscurity, PostgREST is incredibly valuable for quickly building prototypes and scaling data-driven applications. In this article, I’ll introduce PostgREST and walk you through how to start using it with Supabase.
PostgREST is an open-source tool that automatically turns your PostgreSQL database into a RESTful API. By leveraging PostgreSQL’s powerful features such as stored procedures, views, and triggers, PostgREST enables seamless interaction with your database through standard HTTP methods (GET, POST, PATCH, DELETE), without the need for custom backend code.