Shrinking a PyTorch Model's Memory Footprint with ONNX
A walkthrough of exporting PyTorch models to ONNX for deployment — what actually gets smaller, what doesn't, and the export gotchas worth knowing before you ship.
Notes on ML engineering, data pipelines, inference optimisation, and things I've learned shipping models to production.
A walkthrough of exporting PyTorch models to ONNX for deployment — what actually gets smaller, what doesn't, and the export gotchas worth knowing before you ship.
Retrieval quality, not generation quality, is where enterprise RAG systems fail. Notes from building ingestion, embedding and vector search for enterprise document corpora.
Third-party data changes shape without telling you. Notes on building ingestion that fails loudly at the boundary instead of silently three tables downstream.