Local LLMs

Understanding Large Language Models: Practical Applications for Non-Programmers In recent years, the buzz around artificial intelligence (AI) and large language models (LLMs) has become ubiquitous, leading many to wonder how…

KRAFTON Pioneers in AI Development with Raon-1 mini: A Breakthrough in Foundation Models In an exciting development within the artificial intelligence community, South Korean gaming giant KRAFTON—best known for creating…

Evaluating The Guardian’s Stance on Chinese AI: A Barrier to Innovation or a Legitimate Concern? Recently, The Guardian published an article urging readers to "reject cheap Chinese AI," a message…

Assessing the Feasibility of Running DeepSeek V4.1 Flash 1017 with 12GB VRAM and 64GB RAM In recent discussions within the AI and machine learning community, a topic has emerged regarding…

Exploring Local Large Language Model Deployment on a Budget: Running 7B-14B Models on an Older Mini PC In recent years, the landscape of artificial intelligence and machine learning has shifted…

Comprehensive Guide to Renting NVIDIA DGX Spark (GB10): Cloud, Physical, and Hourly Options In the rapidly evolving landscape of high-performance computing, access to powerful AI hardware like the NVIDIA DGX…

The Paradox of Large Language Models: Are Trillion-Parameter Models Necessary for Everyday Tasks? In recent years, the development and deployment of large-scale language models have garnered significant attention within the…

Optimizing Local Language Model Performance: 128K Context with Qwen 3.5 4B and Adaptations in Llama.cpp At Atomic Agent, our focus centers on creating open-source AI agents optimized for local deployment.…

Exploring DeepSeek Qwen 3 8B on the iPhone 16 Pro: Performance and Insights In recent testing, I evaluated the latest iteration of the DeepSeek Qwen 3 8B distillation model—specifically, the…

Enhancing LLM Inference on RTX 4090 with Network-Attached KV Cache: Achieving Nearly Infinite Memory In the quest to overcome hardware limitations, especially the constrained VRAM on consumer-grade GPUs like the…