LLM | Perilous Tech

Prompt Injection is Social Engineering Applied to Applications

Nathan Hamiel

October 24, 2023

Prompt Injection is a term for a vulnerability in Large Language Model applications that’s entered the technical lexicon. However, the term itself creates its own set of issues. The most problematic is that it conjures images of SQL Injection, leading to problems for developers and security professionals. Association with SQL Injection leads both developers and …

The Brave New World of Degraded Performance

Nathan Hamiel

no comments

July 31, 2023

If we are not careful, we are about to enter an era of software development, where we replace known, reliable methods with less reliable probabilistic ones. Where methods such as prompting a model, even with context, can still lead to fragility causing unexpected and unreliable outputs. Where lack of visibility means you never really know …