Transformer Neural Networks

TRM: Tiny AI Models beating Giants on Complex Puzzles

Models with billions, or trillions, of parameters are becoming the norm. These models can write essays, generate code, as well as create art. But they can still get stuck on

Neural Attention, Transformer Neural Networks

FineTuning Gemma 3n for Medical VQA on ROCOv2

What if a radiologist facing a complex scan in the middle of the night could ask an AI assistant for a second opinion, right from their local workstation? This isn't

Computer Vision, Generative AI, Generative Models, LLMs, Multimodal Models, NLP, Transformer Neural Networks, Vision Language Models, Vision Transformer, VLMs

FramePack: Video Diffusion, but feels like Image Diffusion

Ever watched an AI-generated video and wondered how it was made? Or perhaps dreamed of creating your own dynamic scenes, only to be overwhelmed by the complexity or the need

AI Art Generation, AI Research Papers, Artificial Intelligence, Computer Vision, Deep Learning, Diffusion Models, Generative AI, Generative Models, GPUs, GUI, Neural Network, PyTorch, Transformer Neural Networks, video diffusion, Vision Transformer

RF-DETR by Roboflow: Speed Meets Accuracy in Object Detection

Object detection has come a long way, especially with the rise of transformer-based models. RF-DETR, developed by Roboflow, is one such model that offers both speed and accuracy. Using Roboflow’s

Computer Vision, Object Detection, Transformer Neural Networks

Introduction to GPT-4o Image Generation – Here’s What You Need to Know

GPT-4o image generation is a game-changer! With native support in ChatGPT, you can now create stunning visuals from text prompts, refine them, and explore styles like Studio Ghibli or photorealism.

AI Art Generation, Computer Vision, Deep Learning, Diffusion Models, Generative AI, Generative Models, Transformer Neural Networks

WhisperX Automatic Speech Recognition (ASR) with Nemo Speaker Diarization : Speech-to-Text

This article presents ASR with Diarization using OpenAI Whisper and Nvidia Nemo Toolkit.

Artificial Intelligence, Deep Learning, Speech Recognition, Transformer Neural Networks

Building MobileViT Image Classification Model from Scratch In Keras 3

In the rapidly evolving field of deep learning, the challenge often lies not just in designing powerful models but also in making them accessible and efficient for practical use, especially

AI Research Papers, CNN, Computer Vision, Convolution, Deep Learning, Keras, Transformer Neural Networks, Vision Transformer

Text Summarization using T5: Fine-Tuning and Building Gradio App

In this article, we do text summarization using T5 and fine-tune the model to build a Text Summarization Gradio app.

Hugging Face Transformers, NLP, Transformer Neural Networks

Fine Tuning TrOCR – Training TrOCR to Recognize Curved Text

In this article, we are fine tuning the TrOCR Small Printed model on the SCUT CTW1500 dataset to improve its performance on curved text.

Hugging Face Transformers, OCR, Transformer Neural Networks, Vision Transformer

TrOCR – Getting Started with Transformer Based OCR

In this article, we explore TrOCR architecture, models, training strategy and run inference using HuggingFace.

Hugging Face Transformers, OCR, Transformer Neural Networks

The Future of Image Recognition is Here: PyTorch Vision Transformers

In this article, we show how to implement Vision Transformer using the PyTorch deep learning library.

Deep Learning, Neural Network, PyTorch, Transformer Neural Networks, Vision Transformer

Understanding Attention Mechanism in Transformer Neural Networks

In this article, we cover the attention mechanism in neural networks in detail and also implement it using PyTorch

Neural Attention, Neural Network, Transformer Neural Networks