Benchmarking vLLM on 2× RTX 3090 — Post-NVLink: The Verdict Flips
Installing an NVLink bridge on 2× RTX 3090 and re-running the sweep — dense models cross the 2500ms TTFT budget, and TP=2 becomes the default across the board.
// the full back-catalogue
Archive
44 posts on systems, data, and AI — dating all the way back.
Benchmarking vLLM on 2× RTX 3090 — Pre-NVLink: What PCIe Costs You
Six sweeps on 2× RTX 3090 without NVLink — which coding models actually work at TP=2, what the TTFT floor is, and why dense models fail without the bridge.
Benchmarking vLLM on 2× RTX 3090: Setup and Aim
Hardware, software, and methodology for a systematic TP=2 coding model sweep on an Ampere dual-GPU rig — what the sweep does, how it works, and what 'best config' actually means.
How a Small Business Should Actually Do AI
What a small to medium enterprise actually needs to do AI now, in a way that makes sense.
The Logstash Config Guide
The ELK stack has been becoming more and more popular, specifically Elasticsearch
Populate a Symfony 2 Form with the referring entity
In any web project it often happens that you have an entity, say a Group, to which you want to add a linked entity, say a Student.
MS-SQL Stored Procedures in Sequel: Getting the value of output variables
We had the opportunity to muck around with a couple of technologies at Tutuka
PHP: The slums of the Programming World?
I presented this at Tech4Africa 2013
A DIY Dynamic DNS service using Cloudflare
Setting a default order for Doctrine 2 / Symfony 2
Usually when you're working with data you expect some kind of default ordering.
Pre-populating an Entity in a Symfony 2 Form
I've been working on teach-a-rific.
A Summary of Symfony 2 Authorization
Symfony 2 comes with a great security component
I'm the most Organized Disorganized person you'll meet
PHP's array_merge_recursive function explained
Reading the PHP docs, it's not immediately clear how the `array_merge_recursive`
Setting up the Swiftmailer Spooler
The Swiftmailer
Building PHP Projects with Jenkins
It can become quite difficult to keep PHP code structured and clean.
Decorator Pattern Implemented Properly In PHP
While working on Backend-PHP I needed to do a proper implementation of the Decorator Pattern in PHP.
The Low Hanging Fruit Of Testing
I've been getting more into Testing (specifically Unit Testing) the past few weeks, and although I'm still struggling to firstly get it right, and secondly see the long term benefits, I know that the quality of my code is already better.
json-encode'ing Private and Protected Properties
When you `json_encode` an object, it will ignore all protected and private properties if the `json_encode` isn't called from within the object.
22seven.com - Folly, or Genius?
Setting up Puppet on Ubuntu 10.4
I'm trying to use puppet to setup standard dev and (eventually) production environments.
Backend-Core: A RESTful MVC PHP Framework
I like frameworks.
PHP Community in South Africa, lack thereof
I really like working with PHP.
Why Johnny Died (or, How I Finally Realised Why Singletons And Global Variables Are Bad)
Johnny (an asthma sufferer and fictitious character) died yesterday.
A PHP Virtual Host
I hate repetitive work.
A JavaScript trim function
Quick Guide To Creating A Website Quickly
The last two weeks I had the privilege of staying in a house on the beach near Mosselbay.
Good Developers Think like a Startup
I have the privilege to be the Head of Development of Branded Internet, a white label ISP in South Africa.
Why Object Orientation is Great
I'm working on some statistics surrounding BI's API Documentation coverage: Just how much user documentation have we written?
Getting Started with node.js
Looking for a new challenge, I started a small project in node.
Email Parser for node.js
I need to parse Emails in node.
Why I Code
A a student I went to a career psychologist to explore my career needs and drives, and got told that I like solving problems in a creative way.
Twitter API Request Entity too large / HTTP 413 error
I've setup zacoders.
How to remove the www from your URL
If you like simplicity, you might like to simplify your website's URL.
New look!
At long last I've been able to find the time to port my website from drupal to backend
Backend 100 Revisions
I've been working on backend
Backend-PHP Framework
Firefox requests a page twice?
I'm busy creating a site for a client who wants to know when certain internal links get clicked.
Importing a file into a Google Gears DB using PHP
I'm playing around with [Google Gears][gears], particularly the database part, just to see what it's usefull for, and if I can use it in an app I'm working on.
My take on single or multiple returns
Parse Http Accept Header
I want to generate CSS on the fly for a personal project.
Redirect All Requests To Index.php Using .htaccess
In one of my pet projects, I redirect all requests to index.
SQLite Viewer
I'm playing around with Google Gears
Update On Backend
Bakend: PHP framework, as it's now called, now has it's own website!