Developer Tools
Mastering LLM Observability: Tracing Agents with OpenTelemetry
Debugging multi-step AI agents is hard. Learn how to use OpenTelemetry and semantic conventions to bring visibility to your probabilistic stack.
Articles by Rody
Developer Tools
Artificial Intelligence
The Rise of SLMs: Efficient AI for Developers and Edge Devices
Small Language Models (SLMs) are challenging the dominance of giants like GPT-4. Discover why efficient, on-device AI is the future.
Security
Securing LLMs: Real-Time Prompt Injection Detection via eBPF
Discover how eBPF offers kernel-level defense against prompt injection attacks in AI pipelines, ensuring real-time security with zero latency overhead.
Security
Securing AI Dependencies: Real-Time Malware Detection via eBPF
Stop AI supply chain attacks in their tracks. Learn how eBPF monitors kernel calls to catch malicious dependencies at runtime.
Artificial Intelligence
Ollama 3.0: Real-Time 70B Inference via Speculative Decoding
Ollama 3.0 utilizes speculative decoding to run Llama 3 70B at real-time speeds on local hardware, revolutionizing AI performance.
Article
PyTorch 3.0: Native 1-bit LLM Training & Distributed Inference
PyTorch 3.0 introduces native 1-bit LLM training and optimized distributed inference, enabling massive models on consumer hardware.