LoRA vs. QLoRA: Fine-Tuning Your Model’s Superpowers on a Budget
Dr. Anjing Wang Have you ever tried running a colossal language model on a GPU that feels more like a toaster than a supercomputer? Enter LoRA and QLoRA—two magical spells for squeezing every…
How to Run a CUDA Docker Image on an AWS Ubuntu LTS Instance
Running a CUDA Docker image on an AWS Ubuntu instance enables you to leverage GPU-accelerated computations directly within Docker containers. In this guide, we’ll walk through the process of installing…
How to Install NVIDIA driver on AWS Ubuntu LTS 24.04
Installing the NVIDIA driver on an AWS EC2 instance running Ubuntu 24.04 can sometimes be challenging due to AWS’s custom environment and kernel. Although the ubuntu-drivers tool is the recommended…
Running One Linux Distribution Inside Another Using Docker: A Deep Dive
Introduction In today’s fast-paced software development landscape, Docker has become an indispensable tool, revolutionizing the way we build, ship, and run applications. One of its remarkable capabilities is enabling developers…
Fine-Tuning Qwen Models: Understanding the Key Parameters
Fine-tuning large language models (LLMs) can be a challenging process due to the variety of parameters and configurations involved. In this blog, we’ll break down key parameters used to fine-tune…
Why PyTorch Uses Its Own Tensor Library Instead of NumPy
If you’re just starting out with Python and have heard of NumPy, you probably know it’s a fantastic library for handling numbers, arrays, and matrices. So, why would PyTorch, a…
Using torch.Tensor to Represent Images in PyTorch: A Beginner’s Guide
In the world of deep learning, images are a critical form of data. Whether you’re building a computer vision model, training on image datasets, or working on image processing tasks,…
Total Available Graphics Memory vs. Dedicated Video Memory – Understanding the Four Types of GPU Memory
When exploring your system’s GPU settings, you may encounter various memory types that can initially be confusing. Terms like Total Available Graphics Memory, Dedicated Video Memory, System Video Memory, and…
How to Import Git Repo into Github?
Importing a Git repo into GitHub is a common task that can be accomplished using either the GitHub web interface or command-line tools. Many developers work with different Git hosting…
How to Install CUDA on WSL?
As the use of WSL (Windows Subsystem for Linux) for development becomes increasingly popular among programmers, many AI engineers are adopting WSL and Visual Studio Code as their preferred environment…
Extract Pip Packages from Source Code
When working on Python projects, it’s often necessary to identify and list all external dependencies to ensure your code runs smoothly across different environments. There are two primary methods to…
Install Tesseract OCR 5 on Ubuntu: A Complete Guide
Upgrade to Tesseract OCR 5 on Ubuntu with a simple PPA addition, unlocking advanced text recognition features and accuracy.
How to Install PPOCRLabel on Windows
This guide will walk you through installing PPOCRLabel on Windows, ensuring you can start your OCR projects quickly.
Use Pydantic to Validate Integer
Our tutorial dives into the essentials of using Pydantic to validate integers, unpacking the intricacies from basic checks to advanced techniques like decorators and type annotations.
Git Repo Nesting – Clone a Git Repo inside another Repo
For small projects, instead of Git Submodule, we recommend directly cloning a repo inside another repo for so-called repo nesting.